[c-nsp] NPE-G2 Gigabit Ignored Errors
Rodney Dunn
rodunn at cisco.com
Tue Sep 23 16:47:32 EDT 2008
Hank,
Every time I've ever worked on this it's microburst.
The only real way to fix it is a hardware forwarding box that
can do packets at line rate gige.
Rodney
On Sun, Sep 14, 2008 at 09:38:26AM +0300, Hank Nussbacher wrote:
> At 02:43 PM 12-09-08 -0400, Rodney Dunn wrote:
>
> Rodney,
>
> On a related note, we are seeing input overruns on almost all native GigaE
> ports on the NPE-G1. Example on 12.4(21):
>
> GigabitEthernet0/2 is up, line protocol is up
> Hardware is BCM1250 Internal MAC, address is 0009.446d.ac1a (bia
> 0009.446d.ac1a)
> MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
> reliability 255/255, txload 23/255, rxload 13/255
> Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
> Keepalive set (10 sec)
> Full-duplex, 1000Mb/s, link type is force-up, media type is SX
> output flow-control is unsupported, input flow-control is XON
> ARP type: ARPA, ARP Timeout 04:00:00
> Last input 00:00:00, output 00:00:00, output hang never
> Last clearing of "show interface" counters never
> Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
> Queueing strategy: fifo
> Output queue: 0/40 (size/max)
> 30 second input rate 52874000 bits/sec, 13178 packets/sec
> 30 second output rate 92696000 bits/sec, 14626 packets/sec
> 13055246077 packets input, 7473426491146 bytes, 0 no buffer
> Received 48343 broadcasts, 0 runts, 0 giants, 0 throttles
> 315 input errors, 0 CRC, 0 frame, 315 overrun, 0 ignored
> 0 watchdog, 2937496 multicast, 0 pause input
> 0 input packets with dribble condition detected
>
> On 12.4(18):
> GigabitEthernet0/1 is up, line protocol is up
> Hardware is BCM1250 Internal MAC, address is 0009.449b.2c1b (bia
> 0009.449b.2c1b)
> MTU 9000 bytes, BW 1000000 Kbit, DLY 10 usec,
> reliability 255/255, txload 29/255, rxload 41/255
> Encapsulation ARPA, loopback not set
> Keepalive set (10 sec)
> Full-duplex, 1000Mb/s, media type is RJ45
> output flow-control is XON, input flow-control is XON
> ARP type: ARPA, ARP Timeout 00:04:00
> Last input 00:00:01, output 00:00:00, output hang never
> Last clearing of "show interface" counters never
> Input queue: 0/2048/0/3 (size/max/drops/flushes); Total output drops:
> 139963
> Queueing strategy: fifo
> Output queue: 0/1024 (size/max)
> 30 second input rate 163604000 bits/sec, 25284 packets/sec
> 30 second output rate 113775000 bits/sec, 23142 packets/sec
> 138829558726 packets input, 110625630435301 bytes, 0 no buffer
> Received 1170089 broadcasts, 0 runts, 0 giants, 0 throttles
> 42963 input errors, 0 CRC, 0 frame, 42963 overrun, 0 ignored
> 0 watchdog, 2939379 multicast, 0 pause input
> 0 input packets with dribble condition detected
>
> On 12.4(9)T2:
> GigabitEthernet0/2 is up, line protocol is up
> Hardware is BCM1250 Internal MAC, address is 0009.449b.441a (bia
> 0009.449b.441a)
> MTU 1500 bytes, BW 450000 Kbit, DLY 10 usec,
> reliability 255/255, txload 21/255, rxload 60/255
> Encapsulation ARPA, loopback not set
> Keepalive set (10 sec)
> Full-duplex, 1000Mb/s, media type is RJ45
> output flow-control is XON, input flow-control is XON
> ARP type: ARPA, ARP Timeout 04:00:00
> Last input 00:00:00, output 00:00:00, output hang never
> Last clearing of "show interface" counters never
> Input queue: 0/1024/369/79002147 (size/max/drops/flushes); Total output
> drops: 82
> Queueing strategy: fifo
> Output queue: 0/1024 (size/max)
> 30 second input rate 105976000 bits/sec, 13665 packets/sec
> 30 second output rate 38207000 bits/sec, 11394 packets/sec
> 2996785111 packets input, 3073612701 bytes, 2279 no buffer
> Received 500907287 broadcasts, 0 runts, 0 giants, 2483 throttles
> 8348 input errors, 0 CRC, 0 frame, 8348 overrun, 0 ignored
> 0 watchdog, 497602409 multicast, 0 pause input
> 0 input packets with dribble condition detected
>
> Any ideas why?
>
> -Hank
>
> >On Fri, Sep 12, 2008 at 02:40:04PM -0400, Clayton Zekelman wrote:
> >>
> >> No luck... didn't fix it. Is it fixed in a subsequent release? Are
> >> there any other parameters I can tune?
> >
> >Not really because you can't tune the rx ring depth.
> >
> >Check 'sh controller'.
> >
> >What does 'sh proc cpu sort | excl 0.00' say?
> >
> >Can you post the configuration..I'm curious what your features
> >look like because the more you have the less pps you get through
> >this box..it's all done in software and can't do all features at line
> >rate during a microburst.
> >
> >sh int stat
> >
> >
> >Rodney
> >
> >
> >>
> >> GigabitEthernet0/1 is up, line protocol is up
> >> Hardware is MV64460 Internal MAC, address is 001a.6d30.091b (bia
> >> 001a.6d30.091b)
> >> Description: to gig-fastiron Ethernet11
> >> MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
> >> reliability 255/255, txload 23/255, rxload 48/255
> >> Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
> >> Keepalive set (10 sec)
> >> Full-duplex, 1000Mb/s, media type is RJ45
> >> output flow-control is XON, input flow-control is XON
> >> ARP type: ARPA, ARP Timeout 04:00:00
> >> Last input 00:00:00, output 00:00:00, output hang never
> >> Last clearing of "show interface" counters 00:10:09
> >> Input queue: 0/4096/533/0 (size/max/drops/flushes); Total output
> >drops: 0
> >> Queueing strategy: fifo
> >> Output queue: 0/40 (size/max)
> >> 30 second input rate 189692000 bits/sec, 30246 packets/sec
> >> 30 second output rate 91448000 bits/sec, 27197 packets/sec
> >> 18432915 packets input, 1555851456 bytes, 0 no buffer
> >> Received 65 broadcasts, 0 runts, 0 giants, 0 throttles
> >> 1117 input errors, 0 CRC, 0 frame, 0 overrun, 1117 ignored
> >> 0 watchdog, 1034 multicast, 0 pause input
> >> 0 input packets with dribble condition detected
> >>
> >>
> >>
> >> At 02:16 PM 9/12/2008, Rodney Dunn wrote:
> >> >Can you bump up your input queue depth:
> >> >
> >> >hold-queue 4096 in
> >> >
> >> >and see if they stop.
> >> >
> >> >I don't suspect that is going to help because the ignores
> >> >are not increasing that would point to:
> >> >
> >> >CSCse05447
> >> >Externally found moderate defect: Resolved (R)
> >> >7200 ethernet interfaces should not throttle on input queue full drops
> >> >
> >> >Most likely you are seeing micro burst that are coming in faster
> >> >than the CPU can drain the rx ring.
> >> >
> >> >Rodney
> >> >
> >> >
> >> >
> >> >On Fri, Sep 12, 2008 at 12:50:29PM -0400, Clayton Zekelman wrote:
> >> >>
> >> >> I'm running a Cisco 7206/VXR with an NPE G2, Version 12.4(4)XD4
> >> >> acting as an LNS.
> >> >>
> >> >> I'm getting input errors consistently incrementing on the Gig
> >> >> interface (ignored errors)
> >> >>
> >> >> Any way to fix this? I saw some discussion a while back about this,
> >> >> and it seemed to have to do with buffers - but I can't find any
> >> >> definitive recommendations on what the settings should be.
> >> >>
> >> >>
> >> >>
> >> >> GigabitEthernet0/1 is up, line protocol is up
> >> >> Hardware is MV64460 Internal MAC, address is 001a.6d30.091b (bia
> >> >> 001a.6d30.091b)
> >> >> Description: to gig-fastiron Ethernet11
> >> >> MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
> >> >> reliability 255/255, txload 22/255, rxload 46/255
> >> >> Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
> >> >> Keepalive set (10 sec)
> >> >> Full-duplex, 1000Mb/s, media type is RJ45
> >> >> output flow-control is XON, input flow-control is XON
> >> >> ARP type: ARPA, ARP Timeout 04:00:00
> >> >> Last input 00:00:00, output 00:00:00, output hang never
> >> >> Last clearing of "show interface" counters 00:22:17
> >> >> Input queue: 0/75/1191/0 (size/max/drops/flushes); Total output
> >drops:
> >> >0
> >> >> Queueing strategy: fifo
> >> >> Output queue: 0/40 (size/max)
> >> >> 30 second input rate 181384000 bits/sec, 29001 packets/sec
> >> >> 30 second output rate 86319000 bits/sec, 26045 packets/sec
> >> >> 38605963 packets input, 4274358612 bytes, 1 no buffer
> >> >> Received 230 broadcasts, 0 runts, 0 giants, 0 throttles
> >> >> 2677 input errors, 0 CRC, 0 frame, 0 overrun, 2677 ignored
> >> >> 0 watchdog, 2196 multicast, 0 pause input
> >> >> 0 input packets with dribble condition detected
> >> >> 34556615 packets output, 1656923135 bytes, 0 underruns
> >> >> 0 output errors, 0 collisions, 0 interface resets
> >> >> 0 babbles, 0 late collision, 0 deferred
> >> >> 0 lost carrier, 0 no carrier, 0 pause output
> >> >> 0 output buffer failures, 0 output buffers swapped
> >> >> out
> >> >>
> >> >>
> >> >>
> >> >> ---
> >> >> Clayton Zekelman
> >> >> Managed Network Systems Inc. (MNSi)
> >> >> 344-300 Tecumseh Rd. E.
> >> >> Windsor, Ontario
> >> >> N8X 5E8
> >> >>
> >> >> tel. 519-985-8410
> >> >> fax. 519-985-8409
> >> >>
> >> >> _______________________________________________
> >> >> cisco-nsp mailing list cisco-nsp at puck.nether.net
> >> >> https://puck.nether.net/mailman/listinfo/cisco-nsp
> >> >> archive at http://puck.nether.net/pipermail/cisco-nsp/
> >>
> >> ---
> >> Clayton Zekelman
> >> Managed Network Systems Inc. (MNSi)
> >> 344-300 Tecumseh Rd. E.
> >> Windsor, Ontario
> >> N8X 5E8
> >>
> >> tel. 519-985-8410
> >> fax. 519-985-8409
> >_______________________________________________
> >cisco-nsp mailing list cisco-nsp at puck.nether.net
> >https://puck.nether.net/mailman/listinfo/cisco-nsp
> >archive at http://puck.nether.net/pipermail/cisco-nsp/
More information about the cisco-nsp
mailing list