[nsp] IP CEF on AS5350

Oliver Boehmer (oboehmer) oboehmer at cisco.com
Sun Jun 15 04:39:19 EDT 2003


Hi,

I assume you are using TCP header compression, aren't you? You need 12.2
or later to use TCP header compression with CEF, so either upgrade to
12.2 mainline or 12.2(2)XB11 or disable header compression before
enabling CEF.
The high CPU is caused by the alignment corrections
(http://www.cisco.com/warp/public/63/highcpu.html).

	oli

----Original Message----
From: Security [mailto:security at cytanet.com.cy]
Sent: Sonntag, 15. Juni 2003 01:14
To: Oliver Boehmer (oboehmer)
Cc: cisco-nsp at puck.nether.net
Subject: RE: [nsp] IP CEF on AS5350

> Here is the output you requested. I enable IP CEF and proc cpu jumb
> from 10% without CEF to 82% with only 73 users connected to the
> AS5350 out of 212  users that the AS can handle.
> 
> Thanks
> 
> #sh proc cpu | exclude 0.00
> CPU utilization for five seconds: 82%/79%; one minute: 51%; five
> minutes: 33%
>  PID  Runtime(ms)  Invoked  uSecs    5Sec   1Min   5Min TTY Process
>   49    24219776  37354277    648   2.36%  2.38%  2.77%   0 IP Input
> 
>   88      819028     40491  20227   0.16%  0.15%  0.16%   0 Compute
> load avg
> 
> 
> Alignment data for:
> 5350 Software (C5350-IS-M), Version 12.1(5)XM8, EARLY DEPLOYMENT
> RELEASE SOFTWARE (fc1)
> TAC Support: http://www.cisco.com/tac
> Compiled Thu 21-Feb-02 12:51 by uma
> 
> Total Corrections 46369468, Recorded 47, Reads 46369468, Writes 0
> 
>  Initial         Initial
>  Address  Count  Access Type   Traceback
> 407EFCA2  56082  32bit read    0x6048A9C8 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x6017A564
> 0x60171EAC 0x601D29A8 407EFCBE  56082  32bit read    0x6048A9F8
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8 407EFCAA  59955  32bit
>                                read    0x6048AAC8 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8
>                                407EFCAA  45828  32bit read   
> 0x6048AB1C 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x6017A564
>                                0x60171EAC 0x601D29A8 407EFCBE  55978 
> 32bit read    0x6048AB84 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x6017A564 0x60171EAC 0x601D29A8
> 407B6F7E  23451  32bit read    0x6048AAD8 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x6017A564
> 0x60171EAC 0x601D29A8 407B6F82  23451  32bit read    0x6048AAEC
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8 407B6F8E   3977  32bit
>                                read    0x6048AC38 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8
>                                407B6F8E  60131  32bit read   
> 0x6048AD00 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x6017A564
>                                0x60171EAC 0x601D29A8 407B6F8E  45922 
> 32bit read    0x6048AD48 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x6017A564 0x60171EAC 0x601D29A8
> 407B6F8E  21905  32bit read    0x6048ADA0 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x6017A564
> 0x60171EAC 0x601D29A8 407B6F8A  19424  32bit read    0x6048AE80
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8 407B6F86  18712  32bit
>                                read    0x6048AF08 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8
>                                407B6F8E  20747  32bit read   
> 0x6048B0C0 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x6017A564
>                                0x60171EAC 0x601D29A8 407CE1EE  23992 
> 32bit read    0x6048AB38 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x6017A564 0x60171EAC 0x601D29A8
> 407CE1F2  23992  32bit read    0x6048AB4C 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x6017A564
> 0x60171EAC 0x601D29A8 41C226C3     38  16bit read    0x6048A9D8
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x6017A564 0x60171EAC 0x601D29A8 40896E22     14  32bit
>                                read    0x6048A9C8 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x601770A4 0x602F9038 0x602F92D0
>                                40896E3E     14  32bit read   
> 0x6048A9F8 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x601770A4
>                                0x602F9038 0x602F92D0 40896E2A     11 
> 32bit read    0x6048AAC8 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x601770A4 0x602F9038 0x602F92D0
> 40896E2A      9  32bit read    0x6048AB1C 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x601770A4
> 0x602F9038 0x602F92D0 40896E2E      6  32bit read    0x6048AB38
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x601770A4 0x602F9038 0x602F92D0 40896E32      6  32bit
>                                read    0x6048AB4C 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x601770A4 0x602F9038 0x602F92D0
>                                40896E3E      8  32bit read   
> 0x6048AC38 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x601770A4
>                                0x602F9038 0x602F92D0 40896E3E      8 
> 32bit read    0x6048AD00 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x601770A4 0x602F9038 0x602F92D0
> 40896E3E      8  32bit read    0x6048AD48 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x601770A4
> 0x602F9038 0x602F92D0 40896E3E      8  32bit read    0x6048ADA0
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x601770A4 0x602F9038 0x602F92D0 40896E3A      8  32bit
>                                read    0x6048AE80 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x601770A4 0x602F9038 0x602F92D0
>                                40896E36      8  32bit read   
> 0x6048AF08 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x601770A4
>                                0x602F9038 0x602F92D0 40896E3E      7 
> 32bit read    0x6048B0C0 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x601770A4 0x602F9038 0x602F92D0
> 408302FE      3  32bit read    0x6048AAD8 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x601770A4
> 0x602F9038 0x602F92D0 40830302      3  32bit read    0x6048AAEC
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x601770A4 0x602F9038 0x602F92D0 4081EEFE      3  32bit
>                                read    0x6048AB84 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x601770A4 0x602F9038 0x602F92D0
>                                407BD482      2  32bit read   
> 0x6048A9C8 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C
>                                0x602AABDC 0x6025C5C4 407BD49E      2 
> 32bit read    0x6048A9F8 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
>                                0x60178E6C 0x602AABDC 0x6025C5C4
> 407BD48A      2  32bit read    0x6048AAC8 0x6048B49C 0x6043CC98
>                                0x6037254C 0x6034E330 0x60178E6C
> 0x602AABDC 0x6025C5C4 407BD48A      2  32bit read    0x6048AB1C
>                                0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x60178E6C 0x602AABDC 0x6025C5C4 407BD48E      1  32bit
>                                read    0x6048AB38 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C 0x602AABDC 0x6025C5C4
>                                407BD492      1  32bit read   
> 0x6048AB4C 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C
>                                0x602AABDC 0x6025C5C4 407BD49E      1 
> 32bit read    0x6048AC38 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
> 0x60178E6C 0x602AABDC 0x6025C5C4 407BD49E      1  32bit read   
> 0x6048AD00 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C
> 0x602AABDC 0x6025C5C4 407BD49E      1  32bit read    0x6048AD48
> 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C 0x602AABDC
> 0x6025C5C4 407BD49E      1  32bit read    0x6048ADA0 0x6048B49C
> 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C 0x602AABDC 0x6025C5C4
> 407BD49A      1  32bit read    0x6048AE80 0x6048B49C 0x6043CC98
> 0x6037254C 0x6034E330 0x60178E6C 0x602AABDC 0x6025C5C4 407BD496     
> 1  32bit read    0x6048AF08 0x6048B49C 0x6043CC98 0x6037254C
> 0x6034E330 0x60178E6C 0x602AABDC 0x6025C5C4 407BD49E      1  32bit
> read    0x6048B0C0 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330
> 0x60178E6C 0x602AABDC 0x6025C5C4 4081976E      1  32bit read   
> 0x6048AB84 0x6048B49C 0x6043CC98 0x6037254C 0x6034E330 0x60178E6C
> 0x602AABDC 0x6025C5C4               
> 
> No spurious memory references have been recorded.
> 
> 
> 
> Cisco Internetwork Operating System Software
> IOS (tm) 5350 Software (C5350-IS-M), Version 12.1(5)XM8, EARLY
> DEPLOYMENT RELEASE SOFTWARE (fc1)
> TAC Support: http://www.cisco.com/tac
> Copyright (c) 1986-2002 by cisco Systems, Inc.
> Compiled Thu 21-Feb-02 12:51 by uma
> Image text-base: 0x60008968, data-base: 0x60E80000
> 
> ROM: System Bootstrap, Version 12.2(1r)1, RELEASE SOFTWARE (fc1)
> BOOTFLASH: 5350 Software (C5350-BOOT-M), Experimental Version
> 12.1(20000922:142008) [nag-flo_t_0110 101]
> 
> lyk-3 uptime is 2 days, 8 hours, 55 minutes
> System returned to ROM by reload at 14:07:42 eet Thu Jun 12 2003
> System restarted at 14:09:08 eet Thu Jun 12 2003
> System image file is "flash:c5350-is-mz.121-5.XM8.bin"
> 
> cisco AS5350 (R7K) processor (revision O) with 131072K/65536K bytes of
> memory.
> Processor board ID JAE064705YE
> R7000 CPU at 250Mhz, Implementation 39, Rev 1.0, 256KB L2, 2048KB L3
> Cache Last reset from IOS reload
> Channelized E1, Version 1.0.
> Bridging software.
> X.25 software, Version 3.0.0.
> Primary Rate ISDN software, Version 1.1.
> Manufacture Cookie Info:
>  EEPROM Type 0x0001, EEPROM Version 0x01, Board ID 0x32,
>  Board Hardware Version 3.33, Item Number 800-5171-02,
>  Board Revision B0, Serial Number JAE064705YE,
>  PLD/ISP Version 1.0,  Manufacture Date 25-Nov-2002.
> Processor 0x14, MAC Address 0x0B4682593C
> Backplane HW Revision 1.0, Flash Type 5V
> 2 FastEthernet/IEEE 802.3 interface(s)
> 250 Serial network interface(s)
> 216 terminal line(s)
> 8 Channelized E1/PRI port(s)
> 512K bytes of non-volatile configuration memory.
> 32768K bytes of processor board System flash (Read/Write)
> 8192K bytes of processor board Boot flash (Read/Write)
> 
> Configuration register is 0x2102
> 
> 
> 
> > > We are running a few AS5350 access-servers for our dial-up
> > > PSTN/ISDN customers. Enabling IP CEF on the AS5350 (it is enabled
> > > by default), saturates the CPU (99% proc cpu) when there are
> > > about 100 connectionw on the AS5350. Disabling IP CEF everythning
> > > is back to normal. The IOS that the Access servers are ryunning
> > > is is-mz.21-5.XM8 
> > > 
> > > CAn you please advice?
> > 
> > Which process is eating up the CPU? Can u post a "show proc cpu |
> > exclude 0.00" as well as an "show ver" and "show align" when the
> > problem happens? 
> > 
> 
> 
> 
> > It could be CSCds63384, not sure until I see "show ver" and "show
> > align".. 
> > 
> > You might also want to upgrade to a more recent IOS release, I'd
> > recommend 12.2(2)XB11, but make sure you do some lab-tests before
> > you upgrade as the PPP and AAA code is much differnt in 12.2T/12.2XB
> > compared to previous versions...
> > 
> > 	oli
> > 
> > 
> > 
> _____________________________
> CYTANET WebMail
> http://webmail.cytanet.com.cy



More information about the cisco-nsp mailing list