[c-nsp] CEF drops and High processing on AS5400

Rodney Dunn rodunn at cisco.com
Wed Mar 1 13:29:01 EST 2006


I've seen the collisions drive it up just like you said.

Good catch and a good place to start.

On Wed, Mar 01, 2006 at 10:02:32AM -0600, Church, Chuck wrote:
> The one that's working well is doing 10/full on the Ethernet.  The high
> cpu one is doing 10/half, and has a fairly high rate of collisions.  The
> CPU is all because of interrupts, not sure if collisions and
> re-transmits use CPU or not.  Straightening that out should be an easy
> first step though. 
> 
> 
> Chuck Church
> Network Engineer
> CCIE #8776, MCNE, MCSE
> Netco Government Services
> Enterprise Network Engineering
> Home Office - 864-335-9473 
> Cell - 864-266-3978
> cchurch at netcogov.com
> 
> -----Original Message-----
> From: cisco-nsp-bounces at puck.nether.net
> [mailto:cisco-nsp-bounces at puck.nether.net] On Behalf Of Sami Joseph
> Sent: Wednesday, March 01, 2006 8:31 AM
> To: Cisco List 2 (E-mail)
> Subject: [c-nsp] CEF drops and High processing on AS5400
> 
> Hi,
> 
> I have alot of 5400 Access servers that has increased processing, Can
> anyone
> make anything out of these show outputs
> 
> The AS 5400 has a FastEther interface that is connected to the uplink of
> a
> DSLAM on both AS.
> 
> If anyone has experience here, i'd send you the configurations.
> 
> I have included the following commands on both AS:
> 
> sh run int Fast0/0 (uplink to dslam)
> sh adj
> sh cef drop
> sh cef not
> sh int fa0/0
> sh proc cpu sor
> sh proc mem sor
> 
> High_CPU-as01#sh run int FastEthernet0/0
> Building configuration...
> 
> Current configuration : 134 bytes
> !
> interface FastEthernet0/0
>  ip address 172.31.9.25 255.255.255.248
>  duplex auto
>  speed auto
>  no cdp enable
> end
> 
> 
> High_CPU-as01#sh cef int FastEthernet0/0
> FastEthernet0/0 is up (if_number 3)
>   Corresponding hwidb fast_if_number 3
>   Corresponding hwidb firstsw->if_number 3
>   Internet address is 172.31.9.25/29
>   ICMP redirects are always sent
>   Per packet load-sharing is disabled
>   IP unicast RPF check is disabled
>   Inbound access list is not set
>   Outbound access list is not set
>   IP policy routing is disabled
>   BGP based policy accounting is disabled
>   Hardware idb is FastEthernet0/0
>   Fast switching type 1, interface type 18
>   IP CEF switching enabled
>   IP CEF Feature Fast switching turbo vector
>   Input fast flags 0x0, Output fast flags 0x0
>   ifindex 401(401)
>   Slot 0 Slot unit 0 Unit 0 VC -1
>   Transmit limit accumulator 0x0 (0x0)
>   IP MTU 1500
> High_CPU-as01#sh int FastEthernet0/0
> FastEthernet0/0 is up, line protocol is up
>   Hardware is Fast Ethernet, address is 0006.5345.4d0e (bia
> 0006.5345.4d0e)
>   Internet address is 172.31.9.25/29
>   MTU 1500 bytes, BW 10000 Kbit, DLY 1000 usec,
>      reliability 255/255, txload 3/255, rxload 13/255
>   Encapsulation ARPA, loopback not set
>   Keepalive set (10 sec)
>   Half-duplex, 10Mb/s, 100BaseTX/FX
>   ARP type: ARPA, ARP Timeout 04:00:00
>   Last input 00:00:00, output 00:00:00, output hang never
>   Last clearing of "show interface" counters never
>   Input queue: 0/4096/0/382 (size/max/drops/flushes); Total output
> drops: 0
>   Queueing strategy: fifo
>   Output queue: 0/4096 (size/max)
>   5 minute input rate 517000 bits/sec, 110 packets/sec
>   5 minute output rate 139000 bits/sec, 134 packets/sec
>      106417259 packets input, 1052394063 bytes
>      Received 28 broadcasts, 0 runts, 0 giants, 0 throttles
>      0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
>      0 watchdog
>      0 input packets with dribble condition detected
>      130512782 packets output, 2166582892 bytes, 0 underruns
>      1 output errors, 3742659 collisions, 0 interface resets
>      0 babbles, 0 late collision, 3372613 deferred
>      0 lost carrier, 0 no carrier
>      0 output buffer failures, 0 output buffers swapped out
> High_CPU-as01#
> 
> 
> 
> 
> High_CPU-as01#sh proc cpu sorted
> CPU utilization for five seconds: 44%/41%; one minute: 56%; five
> minutes:
> 57%
>  PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
>   37    17551280 149388356        117  1.96%  1.79%  1.84%   0 CCP
> manager
>   63     7162392  16249592        440  0.49%  0.23%  0.23%   0 IP Input
>  120     1013604    126366       8021  0.16%  0.15%  0.16%   0 Compute
> load
> avg
>    4     2367068    166998      14174  0.16%  0.28%  0.30%   0 Check
> heaps
>   20        4416    631812          6  0.08%  0.00%  0.00%   0 GraphIt
>   49          36       165        218  0.08%  0.03%  0.00%   2 Virtual
> Exec
>  166       89820  20074120          4  0.08%  0.02%  0.01%   0 PPP
> Events
>  176       33184     97051        341  0.08%  0.02%  0.00%   0 RADIUS
>    8        8136     73942        110  0.00%  0.00%  0.00%   0 RM
> PROCESS
>    7       51604     20075       2570  0.00%  0.00%  0.00%   0 Serial
> Backgroun
>    6           0         2          0  0.00%  0.00%  0.00%   0 Timers
>    9       16728     56027        298  0.00%  0.00%  0.00%   0 RM
> PROCESS
>   10        3100     56027         55  0.00%  0.00%  0.00%   0 RM
> PROCESS
>   14           0        18          0  0.00%  0.00%  0.00%   0 AAA
> high-capacit
>    5           0         3          0  0.00%  0.00%  0.00%   0 Pool
> Manager
>    3          76      1579         48  0.00%  0.00%  0.00%   1 Exec
>   17         456     16033         28  0.00%  0.00%  0.00%   0 DDR
> Timers
> High_CPU-as01#sh proc mem sor
> Total: 231865696, Used: 53545284, Free: 178320412
>  PID TTY  Allocated      Freed    Holding    Getbufs    Retbufs Process
>    0   0     163808       1848   41046524          0          0 *Init*
>  122   0   18063184     376048    1979792          0          0 EST msg
> processi
>  166   0  622343912  577605428    1616096          0          0 PPP
> Events
>   76   0    2538876        188    1321380    1140784          0 ss7_mtp2
>  140   0    1096312        188    1102960          0          0 VTSP
>  131   0  391559656  457513584     685908          0          0 ISDN
>    0   0  402809996  313578432     660964   12346408     840000 *Dead*
>  142   0     674656          0     561640          0          0 Session
> Applicat
>  160   0     311504        188     336152          0          0
> CCSIP_SPI_CONTRO
>  158   0     303048        188     327696          0          0
> CCH323_CT
>  164   0     280880          0     305716          0          0 RTPSPI
>   71   0  156417488  155158528     291836          0          0 SSS
> Manager
>   52   0   18138336   30428796     214344          0          0 Call
> Progress No
>   66   0    3100972        376     187292          0          0 PPP
> Hooks
>   40   0    6848512    2751704     161656          0          0 Call
> Management
>   46   0     781532          0     155528          0          0 NP
> Download
> Proc
>  107   0     147556          0     154392          0          0
> QOS_MODULE_MAIN
>  176   0     115752   60459204     122400          0          0 RADIUS
>   73   0   24504152   19083772     121468          0          0 PPP IP
> Route
>   23   0  121655192  121567012     112972          0          0 Net
> Background
> 
> 
> 
> High_CPU-as01#sh adj
> Protocol Interface                 Address
> IP       FastEthernet0/1           10.10.10.10(5)
> IP       Async3/57                 point2point(5)
> IP       FastEthernet0/0           xx.xx.110.231(5)
> IP       FastEthernet0/0           172.31.10.25(5)
> IP       FastEthernet0/0           172.31.9.26(19)
> IP       FastEthernet0/0           172.31.10.3(5)
> IP       Virtual-Access2           point2point(19)
> IP       Async3/12                 point2point(5)
> High_CPU-as01#sh cef dro
> CEF Drop Statistics
> Slot  Encap_fail  Unresolved Unsupported    No_route      No_adj
> ChkSum_Err
> RP          3845           0        8670           0           0
> 8
> High_CPU-as01#sh cef no
> High_CPU-as01#sh cef not-cef-switched
> CEF Packets passed on to next switching layer
> Slot  No_adj No_encap Unsupp'ted Redirect  Receive  Options   Access
> Frag
> RP       455       0    95059845        0   678091        0        0
> 0
> High_CPU-as01#
> 
> 
> 
> Normal_CPU_01#sh proc cpu sor
> CPU utilization for five seconds: 5%/1%; one minute: 4%; five minutes:
> 4%
>  PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
>   58    63278040 130450725        485  3.51%  2.49%  2.47%   0 IP Input
>   37    12632748 144197495         87  0.15%  0.24%  0.24%   0 CCP
> manager
>  118     1052416    405109       2597  0.07%  0.04%  0.05%   0 Compute
> load
> avg
>    2         168    405108          0  0.00%  0.00%  0.00%   0 Load
> Meter
>    3           4       836          4  0.00%  0.00%  0.00%   0 VTEMPLATE
> Backgr
>    4           0         1          0  0.00%  0.00%  0.00%   0
> EDDRI_MAIN
>    7           0         2          0  0.00%  0.00%  0.00%   0 Timers
>    5     5630212    443293      12700  0.00%  0.25%  0.24%   0 Check
> heaps
> 
> 
> Normal_CPU_01#sh proc mem sort
> Total: 93973088, Used: 38613916, Free: 55359172
>  PID TTY  Allocated      Freed    Holding    Getbufs    Retbufs Process
>    0   0     292896      92024   29147248          0          0 *Init*
>   69   0    2561884        188    1344360    1140784          0 ss7_mtp2
>   94   0    1054864        188    1054676          0          0 SCTP
> Main
> Proces
>  168   0     888752      65812     796980          0          0 EST msg
> processi
>  134   0     746448          0     633336          0          0 Session
> Applicat
>    6   0    3930988    1961068     471344    1376452    1230240 Pool
> Manager
>  156   0     352836          0     377688          0          0 RTPSPI
>  165   0  398676936  371681144     359476          0          0 PPP
> Events
>  152   0     332496        188     357160          0          0
> CCSIP_SPI_CONTRO
>  150   0     325232        188     349896          0          0
> CCH323_CT
>   58   0 2292755928   48797100     289608          0          0 IP Input
>   64   0   79972116   79479860     276896          0          0 SSS
> Manager
>    0   0 2355452568 2254449804     187812   11593000     840000 *Dead*
>   61   0    2035152        376     187308          0          0 PPP
> Hooks
>  106   0     152600          0     159452          0          0
> QOS_MODULE_MAIN
>  132   0     134364        188     141028          0          0 VTSP
> 
> Normal_CPU_01#sh cef drop
> CEF Drop Statistics
> Slot  Encap_fail  Unresolved Unsupported    No_route      No_adj
> ChkSum_Err
> RP           678           0        1108     6644639           0
> 2
> Normal_CPU_01#sh adj
> Protocol Interface                 Address
> IP       FastEthernet0/0           172.31.19.38(19)
> Normal_CPU_01#sh cef n
> Normal_CPU_01#sh cef not-cef-switched
> CEF Packets passed on to next switching layer
> Slot  No_adj No_encap Unsupp'ted Redirect  Receive  Options   Access
> Frag
> RP       210       0    58993402       31  3001715        0        0
> 0
> Normal_CPU_01#
> 
> 
> 
> 
> 
> 
> Normal_CPU_01#sh ver
> Cisco Internetwork Operating System Software
> IOS (tm) 5350 Software (C5350-IS-M), Version 12.3(17a), RELEASE SOFTWARE
> (fc2)
> Technical Support: http://www.cisco.com/techsupport
> Copyright (c) 1986-2005 by cisco Systems, Inc.
> Compiled Mon 12-Dec-05 16:14 by evmiller
> Image text-base: 0x60008AFC, data-base: 0x61700000
> 
> Normal_CPU_01# sh run int FastEthernet0/0
> Building configuration...
> 
> Current configuration : 160 bytes
> !
> interface FastEthernet0/0
>  description ****Link to DSLAM********
>  ip address 172.31.19.37 255.255.255.252
>  duplex full
>  speed 10
>  no cdp enable
> end
> 
> 
> Normal_CPU_01#sh cef int FastEthernet0/0
> FastEthernet0/0 is up (if_number 3)
>   Corresponding hwidb fast_if_number 3
>   Corresponding hwidb firstsw->if_number 3
>   Internet address is 172.31.19.37/30
>   ICMP redirects are always sent
>   Per packet load-sharing is disabled
>   IP unicast RPF check is disabled
>   Inbound access list is not set
>   Outbound access list is not set
>   IP policy routing is disabled
>   BGP based policy accounting is disabled
>   Hardware idb is FastEthernet0/0
>   Fast switching type 1, interface type 18
>   IP CEF switching enabled
>   IP CEF Feature Fast switching turbo vector
>   Input fast flags 0x0, Output fast flags 0x0
>   ifindex 228(228)
>   Slot 0 Slot unit 0 Unit 0 VC -1
>   Transmit limit accumulator 0x0 (0x0)
>   IP MTU 1500
> Normal_CPU_01#sh int FastEthernet0/0
> FastEthernet0/0 is up, line protocol is up
>   Hardware is Fast Ethernet, address is 000b.5fda.09f2 (bia
> 000b.5fda.09f2)
>   Description: ****Link to ABBASEYA DSLAM********
>   Internet address is 172.31.19.37/30
>   MTU 1500 bytes, BW 10000 Kbit, DLY 1000 usec,
>      reliability 255/255, txload 1/255, rxload 4/255
>   Encapsulation ARPA, loopback not set
>   Keepalive set (10 sec)
>   Full-duplex, 10Mb/s, 100BaseTX/FX
>   ARP type: ARPA, ARP Timeout 04:00:00
>   Last input 00:00:00, output 00:00:00, output hang never
>   Last clearing of "show interface" counters never
>   Input queue: 0/4096/0/24 (size/max/drops/flushes); Total output drops:
> 0
>   Queueing strategy: fifo
>   Output queue: 0/4096 (size/max)
>   5 minute input rate 185000 bits/sec, 47 packets/sec
>   5 minute output rate 34000 bits/sec, 41 packets/sec
>      78546035 packets input, 290784531 bytes
>      Received 2 broadcasts, 0 runts, 0 giants, 0 throttles
>      508432 input errors, 508432 CRC, 247587 frame, 0 overrun, 0 ignored
>      0 watchdog
>      0 input packets with dribble condition detected
>      109674177 packets output, 2801240207 bytes, 0 underruns
>      0 output errors, 0 collisions, 2 interface resets
>      0 babbles, 0 late collision, 0 deferred
>      0 lost carrier, 0 no carrier
>      0 output buffer failures, 0 output buffers swapped out
> Normal_CPU_01#
> _______________________________________________
> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/
> 
> _______________________________________________
> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> https://puck.nether.net/mailman/listinfo/cisco-nsp
> archive at http://puck.nether.net/pipermail/cisco-nsp/


More information about the cisco-nsp mailing list