[c-nsp] Troubleshooting Lag between GigE interfaces
Alex Rubenstein
alex at nac.net
Thu Sep 23 12:33:00 EDT 2004
I believe 32 megs on the VIP is not enough.
For a VIP with a full table, I'd recommend 128, the max.
core2.sne#if-cons 0
VIP-Slot0>sho ver
[...]
cisco VIP2 R5K (R5000) processor (revision 0x02) with 131072K bytes of memory.
VIP-Slot0>sho mem
Head Total(b) Used(b) Free(b) Lowest(b) Largest(b)
Processor 60C7C4C0 121125696 55047224 66078472 66075960 65777980
PCI 30000000 8388616 8388248 368 368 316
If you type 'show ip cef' on the if-cons, if routes return, such as:
VIP-Slot0>sho ip cef
Prefix Next Hop Interface
0.0.0.0/0 209.123.11.185 ATM0/1/0.187
0.0.0.0/32 receive
2.2.2.0/24 209.123.11.185 ATM0/1/0.187
3.0.0.0/8 209.123.11.185 ATM0/1/0.187
Thats a good indicator dCEF is alive and well.
Seeing as there is only 66 megs free with 128, that'd leave 2 with 64,
which is far too few.
Are you running a full view?
On Thu, 23 Sep 2004, Paul Stewart wrote:
> Hmm... I think we're getting warmer..:)
>
> Here's the "sh diag":
>
> gw-7513#sh diagbus
> Slot 3:
> Physical slot 3, ~physical slot 0xC, logical slot 3, CBus 0
> Microcode Status 0x0
> Master Enable, LED, WCS Loaded
> Board is analyzed
> EEPROM format version 1
> FSIP controller, HW rev 1.01, board revision C0
> Serial number: 03496276 Part number: 73-1126-05
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 07 01 01 00 35 59 54 49 04 66 05 00 00 00 00
> 0x30: 60 00 00 00 FF 00 00 00 00 00 00 00 00 00 00 00
>
> Slot database information:
> Flags: 0x4 Insertion time: 0x4380 (1w1d ago)
> Slot 6:
> EEPROM format version 1
> Route/Switch Processor 4, HW rev 1.03, board revision C0
> Serial number: 15308129 Part number: 73-1689-05
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 1A 01 03 00 E9 95 61 49 06 99 05 00 00 00 00
> 0x30: 60 00 00 02 00 00 00 00 00 00 00 00 00 00 00 00
> Slot 7:
> EEPROM format version 1
> Route/Switch Processor 4, HW rev 1.03, board revision C0
> Serial number: 15308150 Part number: 73-1689-05
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 1A 01 03 00 E9 95 76 49 06 99 05 00 00 00 00
> 0x30: 60 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00
> Slot 8:
> Physical slot 8, ~physical slot 0x7, logical slot 8, CBus 1
> Microcode Status 0x4
> Master Enable, LED, WCS Loaded
> Board is analyzed
> Pending I/O Status: None
> EEPROM format version 1
> GEIP controller, HW rev 2.03, board revision A0
> Serial number: 18950511 Part number: 73-2167-06
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 21 02 03 01 21 29 6F 49 08 77 06 00 00 00 00
> 0x30: 50 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00
>
> Slot database information:
> Flags: 0x4 Insertion time: 0x4380 (1w1d ago)
>
> Controller Memory Size: 32 MBytes DRAM, 4096 KBytes SRAM
>
> PA Bay 1 Information:
> Gigabit-Ethernet PA, 1 ports
> EEPROM format version 1
> HW rev 1.00, Board revision A1
> Serial number: 17941328 Part number: 73-3144-03
>
> --Boot log begin--
>
> Cisco Internetwork Operating System Software
> IOS (tm) VIP Software (SVIP-DW-M), Version 12.3(10), RELEASE SOFTWARE
> (fc3)
> Copyright (c) 1986-2004 by cisco Systems, Inc.
> Compiled Mon 16-Aug-04 21:50 by kellythw
> Image text-base: 0x60010AE4, data-base: 0x60560000
>
>
> --Boot log end--
>
> Slot 9:
> Physical slot 9, ~physical slot 0x6, logical slot 9, CBus 1
> Microcode Status 0x4
> Master Enable, LED, WCS Loaded
> Board is analyzed
> Pending I/O Status: None
> EEPROM format version 1
> GEIP controller, HW rev 2.02, board revision C0
> Serial number: 13943816 Part number: 73-2167-05
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 21 02 02 00 D4 C4 08 49 08 77 05 00 00 00 00
> 0x30: 60 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00
>
> Slot database information:
> Flags: 0x4 Insertion time: 0x4380 (1w1d ago)
>
> Controller Memory Size: 32 MBytes DRAM, 4096 KBytes SRAM
>
> PA Bay 1 Information:
> Gigabit-Ethernet PA, 1 ports
> EEPROM format version 1
> HW rev 1.00, Board revision A1
> Serial number: 22598189 Part number: 73-3144-03
>
> --Boot log begin--
>
> Cisco Internetwork Operating System Software
> IOS (tm) VIP Software (SVIP-DW-M), Version 12.3(10), RELEASE SOFTWARE
> (fc3)
> Copyright (c) 1986-2004 by cisco Systems, Inc.
> Compiled Mon 16-Aug-04 21:50 by kellythw
> Image text-base: 0x60010AE4, data-base: 0x60560000
>
>
> --Boot log end--
>
> Slot 10:
> Physical slot 10, ~physical slot 0x5, logical slot 10, CBus 1
> Microcode Status 0x4
> Master Enable, LED, WCS Loaded
> Board is analyzed
> Pending I/O Status: None
> EEPROM format version 1
> VIP2 R5K controller, HW rev 2.03, board revision A0
> Serial number: 17944577 Part number: 73-2167-06
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 1E 02 03 01 11 D0 01 49 08 77 06 00 00 00 00
> 0x30: 50 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00
>
> Slot database information:
> Flags: 0x4 Insertion time: 0x4380 (1w1d ago)
>
> Controller Memory Size: 128 MBytes DRAM, 8192 KBytes SRAM
>
> PA Bay 0 Information:
> Fast-Ethernet PA, 2 ports, 100BaseTX-ISL
> EEPROM format version 1
> HW rev 2.00, Board revision B0
> Serial number: 16413067 Part number: 73-2618-03
>
> PA Bay 1 Information:
> Fast-Ethernet PA, 2 ports, 100BaseTX-ISL
> EEPROM format version 1
> HW rev 1.01, Board revision A0
> Serial number: 14073635 Part number: 73-2618-02
>
> --Boot log begin--
>
> Cisco Internetwork Operating System Software
> IOS (tm) VIP Software (SVIP-DW-M), Version 12.3(10), RELEASE SOFTWARE
> (fc3)
> Copyright (c) 1986-2004 by cisco Systems, Inc.
> Compiled Mon 16-Aug-04 21:50 by kellythw
> Image text-base: 0x60010AE4, data-base: 0x60560000
>
>
> --Boot log end--
>
> Slot 11:
> Physical slot 11, ~physical slot 0x4, logical slot 11, CBus 1
> Microcode Status 0x4
> Master Enable, LED, WCS Loaded
> Board is analyzed
> Pending I/O Status: None
> EEPROM format version 1
> VIP2 R5K controller, HW rev 2.03, board revision A0
> Serial number: 19425523 Part number: 73-2167-06
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board; 7500 compatible
>
> EEPROM contents (hex):
> 0x20: 01 1E 02 03 01 28 68 F3 49 08 77 06 00 00 00 00
> 0x30: 50 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00
>
> Slot database information:
> Flags: 0x4 Insertion time: 0x4380 (1w1d ago)
>
> Controller Memory Size: 128 MBytes DRAM, 8192 KBytes SRAM
>
> PA Bay 0 Information:
> Fast-Ethernet PA, 2 ports, 100BaseTX-ISL
> EEPROM format version 1
> HW rev 2.00, Board revision B0
> Serial number: 16778522 Part number: 73-2618-03
>
> --Boot log begin--
>
> Cisco Internetwork Operating System Software
> IOS (tm) VIP Software (SVIP-DW-M), Version 12.3(10), RELEASE SOFTWARE
> (fc3)
> Copyright (c) 1986-2004 by cisco Systems, Inc.
> Compiled Mon 16-Aug-04 21:50 by kellythw
> Image text-base: 0x60010AE4, data-base: 0x60560000
>
>
> --Boot log end--
>
> Slot 31 (virtual):
> EEPROM format version 1
> Chassis Interface, HW rev 1.01, board revision C0
> Serial number: 18002258 Part number: 73-1306-02
> Test history: 0x00 RMA number: 00-00-00
> Flags: cisco 7000 board
>
> EEPROM contents (hex):
> 0x20: 01 10 01 01 01 12 B1 52 49 05 1A 02 00 00 00 00
> 0x30: 60 00 00 00 FF 00 00 00 00 00 00 00 00 00 00 00
>
>
> On Thu, 2004-09-23 at 12:03, Rodney Dunn wrote:
> > How many routes do you have on the box.
> >
> > 32M isn't nearly enough to hold the full BGP
> > table in distributed mode.
> >
> > Can you post a 'sh diag' for the box here?
> >
> > I can't remember, do we even ship a GEIP with
> > 32M of memory?
> >
> > Here is the one in my lab:
> >
> > Slot 0:
> > Physical slot 0, ~physical slot 0xF, logical slot 0, CBus 0
> > Microcode Status 0x4
> > Master Enable, LED, WCS Loaded
> > Board is analyzed
> > Pending I/O Status: None
> > EEPROM format version 1
> > VIP4-80 RM7000 controller, FRU: VIP4-80=, HW rev 2.04, board revision A0
> > Serial number: 18629786 Part number: 73-3143-10
> > Test history: 0x00 RMA number: 00-00-00
> > Flags: cisco 7000 board; 7500 compatible
> >
> > EEPROM contents (hex):
> > 0x20: 01 22 02 04 01 1C 44 9A 49 0C 47 0A 00 00 00 00
> > 0x30: 50 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
> >
> > Slot database information:
> > Flags: 0x4 Insertion time: 0x32EC (1w3d ago)
> >
> > Controller Memory Size: 256 MBytes CPU SDRAM, 64 MBytes Packet SDRAM
> >
> > PA Bay 0 Information:
> > Gigabit-Ethernet PA(Dual-Wide), 1 ports, FRU: PA-GE=
> > EEPROM format version 4
> > HW rev 0.02, Board revision A0
> > Serial number: FAA045107SV Part number: 73-4520-03
> >
> >
> > it's 256 Meg of DRAM on the GEIP (aka: vip/pa fixed combo).
> >
> > On Thu, Sep 23, 2004 at 11:58:59AM -0400, Paul Stewart wrote:
> > > > Nope. We do ACL's in the distributed path.
> > > > Only caveat there is named ACL's in 12.0S are not supported
> > > > in the dCEF path.
> > > >
> > >
> > > Ah right.. sorry my mistake...
> > > >
> > > > > would that be causing it to punt down?
> > > >
> > > > This doesn't have anything to do with punts. Here dCEF isn't
> > > > even up to the VIP in slot 8 and 9.
> > > >
> > > > For some reason dCEF got disabled to those slots.
> > > > You would have to have the logs from when it got disabled
> > > > to know why.
> > > >
> > > > How much memory are on those cards?
> > > > 'sh diag'
> > > >
> > > 32 Meg on each card..
> > >
> > > >
> > > > You can try to re-enable it via: clear cef linecard
> > > >
> > > > or do:
> > > >
> > > >
> > > > confi t
> > > > ip cef <that converts everything to RSP based CEF switching
> > > > ip cef distributed <that will turn dCEF back on for the box.
> > > >
> > > > You have to get dCEF sync'd up to the cards first.
> > > > That should say "up and sync, table-up" in sh cef linecard.
> > > >
> > >
> > > Tried this...
> > >
> > > They still show as disabled.. weird.. must be my configuration I'm
> > > guessing.. but not sure why...
> > >
> > > Paul
> > >
>
> _______________________________________________
> cisco-nsp mailing list cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
>
-- Alex Rubenstein, AR97, K2AHR, alex at nac.net, latency, Al Reuben --
-- Net Access Corporation, 800-NET-ME-36, http://www.nac.net --
More information about the cisco-nsp
mailing list