[c-nsp] high cpu on VIP in 7507
Troy Beisigl
troy at i2bnetworks.com
Tue Jul 6 16:10:00 EDT 2010
Not much to the config. I have included both sides of the connection.
the other end is a 6500
7507:
interface GigabitEthernet6/0/0
description feed to cat1.3/6
bandwidth 1000000
ip address X.X.X.X 255.255.255.240
load-interval 30
negotiation auto
end
6500:
interface GigabitEthernet3/6
load-interval 30
switchport
switchport access vlan 31
switchport mode access
end
Troy Beisigl
Director, Network Engineering
I2B Networks, Inc. / Camzone Networks
858-715-8500 x 1005
On Jul 6, 2010, at 12:17 PM, Michael K. Smith - Adhost wrote:
> Could you send a sanitized configuration of the port?
>
> Mike
>
> --
> Michael K. Smith - CISSP, GSEC, GISP
> Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
> w: +1 (206) 404-9500 f: +1 (206) 404-9050
> PGP: B49A DDF5 8611 27F3 08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)
>
>
>> -----Original Message-----
>> From: Troy Beisigl [mailto:troy at i2bnetworks.com]
>> Sent: Tuesday, July 06, 2010 11:51 AM
>> To: Michael K. Smith - Adhost
>> Cc: cisco-nsp at puck.nether.net
>> Subject: Re: [c-nsp] high cpu on VIP in 7507
>>
>> Yep. We saw this with another VIP2/50 in the chassis as well that had
>> a 100BaseTX card in it and upgraded it to a VIP4/80 and that problem
>> went away, but this one still has issues.
>>
>> -Troy
>>
>>
>>
>> On Jul 6, 2010, at 11:40 AM, Michael K. Smith - Adhost wrote:
>>
>>> Ahh, okay. Are you running DCEF globally and CEF switching on the
>>> interface?
>>>
>>> Mike
>>>
>>> --
>>> Michael K. Smith - CISSP, GSEC, GISP
>>> Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
>>> w: +1 (206) 404-9500 f: +1 (206) 404-9050
>>> PGP: B49A DDF5 8611 27F3 08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)
>>>
>>>
>>>> -----Original Message-----
>>>> From: Troy Beisigl [mailto:troy at i2bnetworks.com]
>>>> Sent: Tuesday, July 06, 2010 11:39 AM
>>>> To: Michael K. Smith - Adhost
>>>> Cc: cisco-nsp at puck.nether.net
>>>> Subject: Re: [c-nsp] high cpu on VIP in 7507
>>>>
>>>> Actually, we had a bad PA that I replaced, but did not clear the
>>>> counters. The errors are not incrementing. I just now cleared the
>>>> counters on this interface to make sure. We installed the VIP4/80
> to
>>>> replace the VIP2/50 that was in there with the same issue except
> that
>>>> it was at 99% CPU 40-60% of the time.
>>>>
>>>> -Troy
>>>>
>>>>
>>>>
>>>> On Jul 6, 2010, at 11:30 AM, Michael K. Smith - Adhost wrote:
>>>>
>>>>> It looks like you have a physical-layer problem, given the number
> of
>>>>> framing errors in the output you provided.
>>>>>
>>>>> Mike
>>>>>
>>>>> --
>>>>> Michael K. Smith - CISSP, GSEC, GISP
>>>>> Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
>>>>> w: +1 (206) 404-9500 f: +1 (206) 404-9050
>>>>> PGP: B49A DDF5 8611 27F3 08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)
>>>>>
>>>>>
>>>>>> -----Original Message-----
>>>>>> From: cisco-nsp-bounces at puck.nether.net [mailto:cisco-nsp-
>>>>>> bounces at puck.nether.net] On Behalf Of Troy Beisigl
>>>>>> Sent: Tuesday, July 06, 2010 10:59 AM
>>>>>> To: cisco-nsp at puck.nether.net
>>>>>> Subject: [c-nsp] high cpu on VIP in 7507
>>>>>>
>>>>>> Hi.
>>>>>>
>>>>>> We are seeing a problem with high cpu usage on a VIP4/80 card
> when
>>>>>> traffic hits above 10Mbps. Has anyone seen this type of behavior?
>>>>>> Details are below.
>>>>>>
>>>>>>
>>>>>> The IOS version is rsp-pv-mz.124-23.
>>>>>>
>>>>>> GigabitEthernet6/0/0 is up, line protocol is up
>>>>>> Hardware is cyBus GigabitEthernet Interface, address is
>>>>>> 0003.32fd.f0c0 (bia 0003.32fd.f0c0)
>>>>>> Description: feed to cat1.5/6
>>>>>> Internet address is X.X.X.X/28
>>>>>> MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
>>>>>> reliability 255/255, txload 5/255, rxload 6/255
>>>>>> Encapsulation ARPA, loopback not set
>>>>>> Keepalive set (10 sec)
>>>>>> Full-duplex, 1000Mb/s, link type is autonegotiation, media type
>>> is
>>>>> SX
>>>>>> output flow-control is XON, input flow-control is XON
>>>>>> ARP type: ARPA, ARP Timeout 04:00:00
>>>>>> Last input 00:00:00, output 00:00:00, output hang never
>>>>>> Last clearing of "show interface" counters 7w6d
>>>>>> Input queue: 0/75/38707/81008 (size/max/drops/flushes); Total
>>>>>> output drops: 10276
>>>>>> Queueing strategy: fifo
>>>>>> Output queue: 0/40 (size/max)
>>>>>> 30 second input rate 24360000 bits/sec, 4195 packets/sec
>>>>>> 30 second output rate 21260000 bits/sec, 4126 packets/sec
>>>>>> 9833124494 packets input, 4733684298220 bytes, 0 no buffer
>>>>>> Received 11921351 broadcasts, 0 runts, 0 giants, 1350
>>> throttles
>>>>>> 2683847777 input errors, 0 CRC, 2683489514 frame, 4395
>>> overrun,
>>>>>> 370684 ignored
>>>>>> 0 watchdog, 11568950 multicast, 0 pause input
>>>>>> 0 input packets with dribble condition detected
>>>>>> 10530489310 packets output, 7707156852297 bytes, 0 underruns
>>>>>> 0 output errors, 0 collisions, 4 interface resets
>>>>>> 6002 unknown protocol drops
>>>>>> 0 babbles, 0 late collision, 0 deferred
>>>>>> 8 lost carrier, 0 no carrier, 0 pause output
>>>>>> 0 output buffer failures, 0 output buffers swapped out
>>>>>>
>>>>>> VIP-Slot6 10:43:52 AM Tuesday Jul 6 2010 PDT
>>>>>>
>>>>>>
>>>>>> 111111111111111111111111111111111111111111111111111111111111
>>>>>> 222233333222221111100000333331111100000222223333322222222221
>>>>>> 100
>>>>>> 90
>>>>>> 80
>>>>>> 70
>>>>>> 60
>>>>>> 50
>>>>>> 40
>>>>>> 30
>>>>>> 20
>>>>>> 10
>>>>>>
>>>>
>> **********************************************************
>>>>>> **
>>>>>> 0....5....1....1....2....2....3....3....4....4....5....5....6
>>>>>> 0 5 0 5 0 5 0 5 0 5 0
>>>>>> CPU% per second (last 60 seconds)
>>>>>>
>>>>>>
>>>>>> 151111351111111511852381153122211111212111161211118331181111
>>>>>> 415869924534233096537174664310543638877434467042630685635444
>>>>>> 100
>>>>>> 90 * *
>>>>>> 80 * * * *
>>>>>> 70 * * * * *
>>>>>> 60 * * * * * *
>>>>>> 50 * * * ** * * * * *
>>>>>> 40 * ** * ** * * * *** *
>>>>>> 30 * ** * ***** ** * * * * *** #
>>>>>> 20 #****## * ***##**# *#* *** * **** #** * #****#*
>>>>>> 10
>>>>>>
>>>>
>> ##########################################################
>>>>>> ##
>>>>>> 0....5....1....1....2....2....3....3....4....4....5....5....6
>>>>>> 0 5 0 5 0 5 0 5 0 5 0
>>>>>> CPU% per minute (last 60 minutes)
>>>>>> * = maximum CPU% # = average CPU%
>>>>>>
>>>>>>
>>>>>> 996111 11 2111177379959211 1 1 1 211591 11 1
>>>>>> 259 28254
>>>>>>
>>>>>>
>>>>
>> 9900609912980001946199499209488679907788898952209380097990899998299
>>>>>> 34946
>>>>>> 100 ** ** *
>>>>>> * *
>>>>>> 90 ** ** * *
>>>>> *
>>>>>> 80 ** * ** * *
>>>>>> * *
>>>>>> 70 ** ** *** * *
>>>>>> * *
>>>>>> 60 *** ** *** * *
>>>>>> * *
>>>>>> 50 *** ** ***** **
>>>>>> ** * **
>>>>>> 40 *** ******** **
>>>>>> ** * **
>>>>>> 30 *** * ********* * **
>>>>>> *** ****
>>>>>> 20 *** * * ********* * * **
>>>>>> *** *****
>>>>>> 10
>>>>>>
>>>>
>> #############################*********#**#*#######*******#
>>>>>> *******#****#*
>>>>>>
>>>>>> 0
>>>>>>
>>>>> ....
>>>>>
> 5....1....1....2....2....3....3....4....4....5....5....6....6....7..
>>>>>> 0 5 0 5 0 5 0 5 0 5 0
>>>>>> 5 0
>>>>>> CPU% per hour (last 72 hours)
>>>>>> * = maximum CPU% # = average CPU%
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> -Troy
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> cisco-nsp mailing list cisco-nsp at puck.nether.net
>>>>>> https://puck.nether.net/mailman/listinfo/cisco-nsp
>>>>>> archive at http://puck.nether.net/pipermail/cisco-nsp/
>>>
>
More information about the cisco-nsp
mailing list