[c-nsp] Abnormal CPU usage on a G1 engine
Paul Stewart
paul at paulstewart.org
Tue Sep 29 10:49:42 EDT 2009
One thing I noticed is your T train release - there are MD (think that's the
new term) of software releases for the G1 engine. I'd suggest looking at a
new IOS to see if that helps.
Also, there could be several configuration items that are causing this....
can you post a sanitized config?
Paul
-----Original Message-----
From: cisco-nsp-bounces at puck.nether.net
[mailto:cisco-nsp-bounces at puck.nether.net] On Behalf Of Jimmy Hodges
Sent: September 29, 2009 10:33 AM
To: cisco-nsp at puck.nether.net
Cc: Tim Smith; dbertram at zcorum.com
Subject: [c-nsp] Abnormal CPU usage on a G1 engine
Team,
I have a G1 engine in a Cisco 7206VXR and another G1 engine in a
7246VXR that are both showing almost 50% CPU usage on a network that
only has 358 cable modems. I have other networks with over 3000 modems
that don't create more than 25% CPU usage on their G1 engines. Everytime
I check the "show proc cpu" output, it never shows any system processes
consuming more than 5% of the CPU. Is there a process that I could be
missing that is overworking both my G1 engines? Why is such a small
network that passes 15 Mbps of traffic causing the CPU to work so hard?
Any insight will be appreciated. Thanks again.
_*7206VXR GW:
*_Cisco IOS Software, 7200 Software (C7200-IPBASEK9-M), Version
12.4(22)T, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2008 by Cisco Systems, Inc.
Compiled Fri 10-Oct-08 10:10 by prod_rel_team
ROM: System Bootstrap, Version 12.3(4r)T1, RELEASE SOFTWARE (fc1)
BOOTLDR: 7200 Software (C7200-KBOOT-M), Version 12.3(15), RELEASE
SOFTWARE (fc3)
Demopolis_GW uptime is 5 weeks, 5 days, 22 hours, 30 minutes
System returned to ROM by reload at 15:26:06 UTC Wed Aug 19 2009
System restarted at 10:28:39 CST Wed Aug 19 2009
System image file is "disk2:c7200-ipbasek9-mz.124-22.T.bin"
Last reload reason: Reload Command
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be
found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export at cisco.com.
Cisco 7206VXR (NPE-G1) processor (revision B) with 983040K/65536K bytes
of memory.
Processor board ID 21302151
SB-1 CPU at 700MHz, Implementation 1025, Rev 0.2, 512KB L2 Cache
6 slot VXR midplane, Version 2.1
Last reset from power-on
PCI bus mb1 (Slots 1, 3 and 5) has a capacity of 600 bandwidth points.
Current configuration on bus mb1 has a total of 400 bandwidth points.
This configuration is within the PCI bus capacity and is supported.
PCI bus mb2 (Slots 2, 4 and 6) has a capacity of 600 bandwidth points.
Current configuration on bus mb2 has a total of 400 bandwidth points.
This configuration is within the PCI bus capacity and is supported.
Please refer to the following document "Cisco 7200 Series Port Adaptor
Hardware Configuration Guidelines" on Cisco.com <http://www.cisco.com>
for c7200 bandwidth points oversubscription and usage guidelines.
4 FastEthernet interfaces
3 Gigabit Ethernet interfaces
509K bytes of NVRAM.
500472K bytes of ATA PCMCIA card at slot 2 (Sector size 512 bytes).
16384K bytes of Flash internal SIMM (Sector size 256K).
Configuration register is 0x2102
--------------------------------------------------------------------------
08:59:05 AM Tuesday Sep 29 2009 CST
444444444433333333333333366666333333333333333333333333333333
100
90
80
70
60
50
40
30
20
10 *****
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)
3
633344333333335333334534333337343544333333333333433333333333
100
90
80
70
60
50
40 *
30 *
20 *
10 * # * * *
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
233333223333333322323333332333322333232323333333333332333333322332223323
663353984798075496685435438132378015517674758545776636566064498462545242
100
90
80
70
60
50
40 * * *** ** * * * * * **** ***** *** * * *
30 ***************************************************************** * ** *
20 ************************************************************************
10 ************************************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
----------------------------------------------------------------------------
-----------------------------
CPU utilization for five seconds: 3%/1%; one minute: 3%; five minutes: 3%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
43 42455232 3538016 11999 1.27% 1.27% 1.27% 0
Per-Second Jobs
115 8356 870720560 0 0.15% 0.16% 0.15% 0 HQF
Shaper Backg
39 4245312 2357917 1800 0.23% 0.13% 0.12% 0 Net
Background
5 1654420 361374 4578 0.00% 0.03% 0.04% 0 Check heaps
78 232 1375 168 0.00% 0.02% 0.00% 2 SSH Process
71 1790924 18693365 95 0.07% 0.02% 0.00% 0 IP Input
190 38280 385975 99 0.07% 0.00% 0.00% 0 SNMP ENGINE
187 1444 35363326 0 0.07% 0.01% 0.00% 0 CCPROXY_CT
----------------------------------------------------------------------------
---------
_*7246VXR:*_
08:54:14 AM Tuesday Sep 29 2009 CST
4444444433333333336666688888555552222222222222222222222222
100
90
80
70
60
50
40
30
20
10 *************** **
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
111 1 11131 11 21 11 1 1121 11 1 1 11111 11
9364596660654644504455155397744566464843465965966675846546
100
90
80
70
60
50
40
30 * *
20 * * * ***** * * * *** * * * ***** * *
10 #*# ***####*#* #* ***#*#*####*** *## **#***#####* **## *
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
3323223334434343333323333223233333233223333333333234332332223323334333
0061465230020003211497053991833071642982019012104600509275866274230535
100
90
80
70
60
50
40 * ** * * * * * * ** * * ** **
30 **** *******************************************************************
20 ************************************************************************
10 ************##*****************************##***************************
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
----------------------------------------------------------------------------
--------------------------
CPU utilization for five seconds: 3%/1%; one minute: 6%; five minutes: 5%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
160 19589648 17773192 1102 0.79% 2.50% 2.59% 0
polling_process
175 1716008 13449246 127 0.00% 0.96% 0.28% 0 SNMP ENGINE
89 1223000 22139911 55 0.07% 0.13% 0.12% 0 IP Input
29 450260 487422 923 0.15% 0.09% 0.10% 0 Net
Background
44 676280 19603848 34 0.00% 0.34% 0.09% 0 MCU BPE
IP Enque
130 702788 14891015 47 0.00% 0.08% 0.08% 0 SNMP
Proxy Forwa
32 9044 1049043 8 0.00% 0.06% 0.07% 0
Per-Second Jobs
5 890092 138381 6432 0.00% 0.07% 0.06% 0 Check heaps
174 459404 16156504 28 0.00% 0.05% 0.05% 0 PDU
DISPATCHER
173 307116 17539623 17 0.00% 0.04% 0.01% 0 IP SNMP
127 144 188 765 0.15% 0.01% 0.00% 2 SSH Process
178 264 1039788 0 0.00% 0.00% 0.00% 0 NTP
---------------------------------------------------------------------
Interface Cable
Modem Description
Total Reg Oper Unreg Offline Wideband initRC initD initIO
initO
C4/0/U0 78 75 75 3 2 0 0 0 0
0 C1******
C4/0/U1 47 46 46 1 1 0 0 0 0
0 H1*******
C4/0/U2 58 58 58 0 0 0 0 0 0
0 H2********
C4/0/U3 82 78 78 4 3 0 0 0 0
0 C2********
C4/0/U4 37 35 35 2 2 0 0 0 0
0 J*********
C4/0/U5 67 66 66 1 1 0 0 0 0
0 P*******
Total: 369 358 358 11 9 0 0 0 0 0
----------------------------------------------------------------------------
------
Cable Modem DOCSIS Version Summary
DOCSIS Registered US QoS US Phy Mode DS
Mode
------------------- --------- -------------------
-------
Interface Online v3.0 v2.0 v1.1 v1.0 v1.1 v1.0 WB scdm atdm tdma
WB NB
C4/0/U0 75 0 64 9 2 0 75 0 0 64 11
0 75
C4/0/U1 46 0 41 5 0 0 46 0 0 41 5
0 46
C4/0/U2 58 0 48 10 0 0 58 0 0 48 10
0 58
C4/0/U3 78 0 61 13 4 0 78 0 0 61 17
0 78
C4/0/U4 35 0 31 4 0 0 35 0 0 31 4
0 35
C4/0/U5 66 0 60 6 0 0 66 0 0 60 6
0 66
Total: 358 0 305 47 6 0 358 0 0 305 53
0 358
------------------------------------------------------------------------
Vendor OUI Cable Modem
Total Registered Unregistered Offline
00.14.E8 00.14.E8 17 17 0 0
00.15.2F 00.15.2F 12 12 0 0
00.15.9A 00.15.9A 7 7 0 0
00.16.B5 00.16.B5 3 3 0 0
00.17.EE 00.17.EE 77 75 2 2
00.18.C0 00.18.C0 78 74 4 4
00.19.5E 00.19.5E 11 10 1 1
00.1A.66 00.1A.66 2 2 0 0
00.1C.11 00.1C.11 4 4 0 0
00.23.74 00.23.74 17 17 0 0
Acterna 00.07.11 1 0 1 1
Belkin 00.30.54 46 46 0 0
Linksys 00.06.25 2 2 0 0
Linksys 00.13.10 1 0 1 1
Motorola 00.0E.5C 15 15 0 0
Motorola 00.0F.9F 3 3 0 0
Motorola 00.11.80 5 5 0 0
Motorola 00.11.AE 4 3 1 1
Motorola 00.12.25 6 6 0 0
Motorola 00.12.C9 21 21 0 0
Motorola 00.13.71 8 7 1 0
Motorola 00.14.04 27 27 0 0
SMC 00.04.E2 2 2 0 0
Total: 369 358 11 10
---------------------------------------------
Cisco Internetwork Operating System Software
IOS (tm) 7200 Software (UBR7200-IK9SU2-M), Version 12.3(23)BC8, RELEASE
SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2009 by cisco Systems, Inc.
Compiled Mon 06-Jul-09 12:05 by tinhuang
Image text-base: 0x60008EC4, data-base: 0x6189B8C0
ROM: System Bootstrap, Version 12.2(8r)B, RELEASE SOFTWARE (fc1)
BOOTLDR: 7200 Software (UBR7200-BOOT-M), Version 12.3(23)BC8, RELEASE
SOFTWARE (fc1)
Demopolis_CMTS uptime is 1 week, 4 days, 20 hours, 4 minutes
System returned to ROM by power-on
System restarted at 12:50:37 CST Thu Sep 17 2009
System image file is "disk2:ubr7200-ik9su2-mz.123-23.BC8.bin"
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be
found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
export at cisco.com.
cisco uBR7246VXR (UBR7200-NPE-G1) processor (revision A) with
983040K/65536K bytes of memory.
Processor board ID SCA070200DU
SB-1 CPU at 700MHz, Implementation 1, Rev 0.2, 512KB L2 Cache
6 slot VXR midplane, Version 2.0
Last reset from power-on
Bridging software.
X.25 software, Version 3.0.0.
PCI bus mb1 has 200 bandwidth points
PCI bus mb2 has 242 bandwidth points
2 FastEthernet/IEEE 802.3 interface(s)
3 Gigabit Ethernet/IEEE 802.3 interface(s)
1 Cable Modem network interface(s)
509K bytes of non-volatile configuration memory.
250880K bytes of ATA PCMCIA card at slot 2 (Sector size 512 bytes).
16384K bytes of Flash internal SIMM (Sector size 256K).
Configuration register is 0x2102
--
Jimmy Hodges
Network Design Engineer
ZCorum ISP Alliance
jihodges at zcorum.com
_______________________________________________
cisco-nsp mailing list cisco-nsp at puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/
More information about the cisco-nsp
mailing list