[c-nsp] Oversubscription on 6509 blade

Wed Aug 18 20:53:19 EDT 2010

Overruns have nothing to do with oversubscription.  They are packets dropped
due to the input ring being full.  Basically the other end is filling the
queue faster than the 6509 can empty them.  What's on the other end?  Flow
control may help here if it's supported.

On Wed, Aug 18, 2010 at 7:28 PM, Richard Roller <rich.roller at gmail.com>wrote:

> We're seeing overruns on a 6148 module in a 6509-E switch. The overruns
> would be considered normal if the ASIC port range was oversubscribed,
> however, according to interface traffic levels, it doesn't reach the 1Gb
> peak. Output from the 'show int summ' command below shows that Rxbs =
> ~70Mbps while Txbs = 17Mbs. (if my math is right, and assuming 17-24 is one
> Gb ASIC)
>
>
>  Interface           IHQ   IQD  OHQ   OQD  RXBS RXPS  TXBS TXPS TRTL
> ---------------------------------------------------------------------
> * GigabitEthernet6/17    0     0    0     0     0    0     0    0    0
> * GigabitEthernet6/18    0 25082261    0 45001 18475000  4897 7468000
> 6161    0
> * GigabitEthernet6/19    0     0    0     0     0    0     0    0    0
> * GigabitEthernet6/20    0 24751654    0 44925 19430000  1719 1927000
> 2407    0
> * GigabitEthernet6/21    0     0    0     0     0    0     0    0    0
> * GigabitEthernet6/22    0 68270    0     0 15823000  1680 5358000  2661
> 0
> * GigabitEthernet6/23    0     0    0     0     0    0     0    0    0
> * GigabitEthernet6/24    0 23521824    0 44281 17227000  1616 2507000
> 2372    0
>
>
> GigabitEthernet6/20 is up, line protocol is up (connected)
>  Hardware is C6k 1000Mb 802.3, address is 0015.faca.ee7f (bia
> 0015.faca.ee7f)
>  MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
>     reliability 255/255, txload 1/255, rxload 5/255
>  Encapsulation ARPA, loopback not set
>  Full-duplex, 1000Mb/s
>  input flow-control is off, output flow-control is desired
>  Clock mode is auto
>  ARP type: ARPA, ARP Timeout 04:00:00
>  Last input never, output 00:00:54, output hang never
>  Last clearing of "show interface" counters never
>  Input queue: 0/2000/24753578/0 (size/max/drops/flushes); Total output
> drops: 44925
>  Queueing strategy: fifo
>  Output queue: 0/40 (size/max)
>  5 minute input rate 21955000 bits/sec, 1941 packets/sec
>  5 minute output rate 2132000 bits/sec, 2292 packets/sec
>     13954662333 packets input, 16851357461096 bytes, 0 no buffer
>     Received 40269073 broadcasts (409685 multicast)
>     0 runts, 0 giants, 0 throttles
>     0 input errors, 0 CRC, 0 frame, 24753578 overrun, 0 ignored
>     0 watchdog, 0 multicast, 0 pause input
>     0 input packets with dribble condition detected
>     24094021770 packets output, 7628772920146 bytes, 0 underruns
>     0 output errors, 0 collisions, 2 interface resets
>     0 babbles, 0 late collision, 0 deferred
>     0 lost carrier, 0 no carrier, 0 PAUSE output
>     0 output buffer failures, 0 output buffers swapped out
>
> GigabitEthernet6/22 is up, line protocol is up (connected)
>  Hardware is C6k 1000Mb 802.3, address is 0015.faca.ee81 (bia
> 0015.faca.ee81)
>  MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
>     reliability 255/255, txload 1/255, rxload 5/255
>  Encapsulation ARPA, loopback not set
>  Full-duplex, 1000Mb/s
>  input flow-control is off, output flow-control is desired
>  Clock mode is auto
>  ARP type: ARPA, ARP Timeout 04:00:00
>  Last input never, output 00:00:08, output hang never
>  Last clearing of "show interface" counters 07:30:26
>  Input queue: 0/2000/70255/0 (size/max/drops/flushes); Total output drops:
> 0
>  Queueing strategy: fifo
>  Output queue: 0/40 (size/max)
>  5 minute input rate 21401000 bits/sec, 2163 packets/sec
>  5 minute output rate 5655000 bits/sec, 2671 packets/sec
>     75174892 packets input, 71627016585 bytes, 0 no buffer
>     Received 26519 broadcasts (444 multicast)
>     0 runts, 0 giants, 0 throttles
>     0 input errors, 0 CRC, 0 frame, 70255 overrun, 0 ignored
>     0 watchdog, 0 multicast, 0 pause input
>     0 input packets with dribble condition detected
>     95130820 packets output, 46628566836 bytes, 0 underruns
>     0 output errors, 0 collisions, 0 interface resets
>     0 babbles, 0 late collision, 0 deferred
>     0 lost carrier, 0 no carrier, 0 PAUSE output
>     0 output buffer failures, 0 output buffers swapped out
>
> Note that I recently cleared the counters on gi6/22 while all the others
> have not been cleared. The overruns steadily increment throughout the day.
>
> Any idea what could be causing this? Even if I were to add up the traffic
> on
> all the other interfaces on slot 6, it still wouldn't reach 1Gb. Output
> from
> some other commands are listed below. Thanks.
>
> show catalyst6000
>  chassis MAC addresses: 1024 addresses from 0014.1b1d.5400 to
> 0014.1b1d.57ff
>  traffic meter =   1%  Never cleared
>           peak =  20%        reached at 02:43:18 EDT Mon Jun 14 2010
>  switching-clock: clock switchover and system reset is allowed
>
> show ver
> Cisco Internetwork Operating System Software
> IOS (tm) s72033_rp Software (s72033_rp-PK9SV-M), Version 12.2(18)SXD4,
> RELEASE SOFTWARE (fc1)
> Technical Support: http://www.cisco.com/techsupport
> Copyright (c) 1986-2005 by cisco Systems, Inc.
> Compiled Tue 22-Mar-05 15:33 by yiyan
> Image text-base: 0x4002100C, data-base: 0x42318000
>
> ROM: System Bootstrap, Version 12.2(17r)S2, RELEASE SOFTWARE (fc1)
> BOOTLDR: s72033_rp Software (s72033_rp-PK9SV-M), Version 12.2(18)SXD4,
> RELEASE SOFTWARE (fc1)
>
> uptime is 27 weeks, 6 days, 7 hours, 45 minutes
> Time since switched to active is 27 weeks, 6 days, 7 hours, 45 minutes
> System returned to ROM by unknown reload cause - suspect
> boot_data[BOOT_COUNT] 0x0, BOOT_COUNT 0, BOOTDATA 19 (SP by power-on)
> System restarted at 10:28:29 EDT Thu Feb 4 2010
> System image file is "sup-bootflash:s72033-pk9sv-mz.122-18.SXD4.bin"
>
>
> This product contains cryptographic features and is subject to United
> States and local country laws governing import, export, transfer and
> use. Delivery of Cisco cryptographic products does not imply
> third-party authority to import, export, distribute or use encryption.
> Importers, exporters, distributors and users are responsible for
> compliance with U.S. and local country laws. By using this product you
> agree to comply with applicable laws and regulations. If you are unable
> to comply with U.S. and local laws, return this product immediately.
>
> A summary of U.S. laws governing Cisco cryptographic products may be found
> at:
> http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
>
> If you require further assistance please contact us by sending email to
> export at cisco.com.
>
> cisco WS-C6509-E (R7000) processor (revision 1.1) with 458720K/65536K bytes
> of memory.
> Processor board ID SMG0917N3MZ
> SR71000 CPU at 600Mhz, Implementation 0x504, Rev 1.2, 512KB L2 Cache
> Last reset from power-on
> X.25 software, Version 3.0.0.
> Bridging software.
> 121 Virtual Ethernet/IEEE 802.3  interface(s)
> 214 Gigabit Ethernet/IEEE 802.3 interface(s)
> 1917K bytes of non-volatile configuration memory.
> 8192K bytes of packet buffer memory.
>
> 65536K bytes of Flash internal SIMM (Sector size 512K).
> Configuration register is 0x2102
>
>
> sho mod
> Mod Ports Card Type                              Model              Serial
> No.
> --- ----- -------------------------------------- ------------------
> -----------
>  1   48  SFM-capable 48 port 10/100/1000mb RJ45 WS-X6548-GE-TX
> SAL091594HK
>  2    4  SLB Application Processor Complex      WS-X6066-SLB-APC
> SAD093109YD
>  3   48  CEF720 48 port 10/100/1000mb Ethernet  WS-X6748-GE-TX
> SAL09211LA8
>  4   48  48 port 10/100/1000mb EtherModule      WS-X6148-GE-TX
> SAL11499266
>  5    2  Supervisor Engine 720 (Active)         WS-SUP720-3B
> SAD0915018N
>  6   48  48 port 10/100/1000mb EtherModule      WS-X6148-GE-TX
> SAL094865J7
>  7   16  16 port 1000mb GBIC ethernet           WS-X6416-GBIC
> SAD0530058M
>
> Mod MAC addresses                       Hw    Fw           Sw
> Status
> --- ---------------------------------- ------ ------------ ------------
> -------
>  1  0013.80f5.68a8 to 0013.80f5.68d7  10.1   7.2(1)       8.3(0.156)RO Ok
>  2  0014.a9bd.20f8 to 0014.a9bd.20ff   1.8                4.2(12)      Ok
>  3  0013.c473.0af8 to 0013.c473.0b27   2.2   12.2(14r)S5  12.2(18)SXD4 Ok
>  4  001e.4a45.4850 to 001e.4a45.487f   7.2   7.2(1)       8.3(0.156)RO Ok
>  5  0011.5cb4.afdc to 0011.5cb4.afdf   4.3   8.1(3)       12.2(18)SXD4 Ok
>  6  0015.faca.ee6c to 0015.faca.ee9b   1.1   7.2(1)       8.3(0.156)RO Ok
>  7  0003.32bd.1fc2 to 0003.32bd.1fd1   1.2   5.4(2)       8.3(0.156)RO Ok
>
> Mod Sub-Module                  Model              Serial        Hw
> Status
> --- --------------------------- ------------------ ------------ -------
> -------
>  3 Centralized Forwarding Card WS-F6700-CFC       SAL0917A6G6   2.0    Ok
>  5 Policy Feature Card 3       WS-F6K-PFC3B       SAD09120A3A   2.0    Ok
>  5 MSFC3 Daughterboard         WS-SUP720          SAD091204G5   2.3    Ok
>
> Mod Online Diag Status
> --- -------------------
>  1 Pass
>  2 Pass
>  3 Pass
>  4 Pass
>  5 Pass
>  6 Pass
>  7 Pass
> _______________________________________________
> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
>
>
>