[c-nsp] high cpu on VIP in 7507

Michael K. Smith - Adhost mksmith at adhost.com
Tue Jul 6 15:17:47 EDT 2010


Could you send a sanitized configuration of the port?  

Mike

--
Michael K. Smith - CISSP, GSEC, GISP
Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
w: +1 (206) 404-9500 f: +1 (206) 404-9050
PGP: B49A DDF5 8611 27F3  08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)


> -----Original Message-----
> From: Troy Beisigl [mailto:troy at i2bnetworks.com]
> Sent: Tuesday, July 06, 2010 11:51 AM
> To: Michael K. Smith - Adhost
> Cc: cisco-nsp at puck.nether.net
> Subject: Re: [c-nsp] high cpu on VIP in 7507
> 
> Yep. We saw this with another VIP2/50 in the chassis as well that had
> a 100BaseTX card in it and upgraded it to a VIP4/80 and that problem
> went away, but this one still has issues.
> 
> -Troy
> 
> 
> 
> On Jul 6, 2010, at 11:40 AM, Michael K. Smith - Adhost wrote:
> 
> > Ahh, okay.  Are you running DCEF globally and CEF switching on the
> > interface?
> >
> > Mike
> >
> > --
> > Michael K. Smith - CISSP, GSEC, GISP
> > Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
> > w: +1 (206) 404-9500 f: +1 (206) 404-9050
> > PGP: B49A DDF5 8611 27F3  08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)
> >
> >
> >> -----Original Message-----
> >> From: Troy Beisigl [mailto:troy at i2bnetworks.com]
> >> Sent: Tuesday, July 06, 2010 11:39 AM
> >> To: Michael K. Smith - Adhost
> >> Cc: cisco-nsp at puck.nether.net
> >> Subject: Re: [c-nsp] high cpu on VIP in 7507
> >>
> >> Actually, we had a bad PA that I replaced, but did not clear the
> >> counters. The errors are not incrementing. I just now cleared the
> >> counters on this interface to make sure. We installed the VIP4/80
to
> >> replace the VIP2/50 that was in there with the same issue except
that
> >> it was at 99% CPU 40-60% of the time.
> >>
> >> -Troy
> >>
> >>
> >>
> >> On Jul 6, 2010, at 11:30 AM, Michael K. Smith - Adhost wrote:
> >>
> >>> It looks like you have a physical-layer problem, given the number
of
> >>> framing errors in the output you provided.
> >>>
> >>> Mike
> >>>
> >>> --
> >>> Michael K. Smith - CISSP, GSEC, GISP
> >>> Chief Technical Officer - Adhost Internet LLC mksmith at adhost.com
> >>> w: +1 (206) 404-9500 f: +1 (206) 404-9050
> >>> PGP: B49A DDF5 8611 27F3  08B9 84BB E61E 38C0 (Key ID: 0x9A96777D)
> >>>
> >>>
> >>>> -----Original Message-----
> >>>> From: cisco-nsp-bounces at puck.nether.net [mailto:cisco-nsp-
> >>>> bounces at puck.nether.net] On Behalf Of Troy Beisigl
> >>>> Sent: Tuesday, July 06, 2010 10:59 AM
> >>>> To: cisco-nsp at puck.nether.net
> >>>> Subject: [c-nsp] high cpu on VIP in 7507
> >>>>
> >>>> Hi.
> >>>>
> >>>> We are seeing a problem with high cpu usage on a VIP4/80 card
when
> >>>> traffic hits above 10Mbps. Has anyone seen this type of behavior?
> >>>> Details are below.
> >>>>
> >>>>
> >>>> The IOS version is rsp-pv-mz.124-23.
> >>>>
> >>>> GigabitEthernet6/0/0 is up, line protocol is up
> >>>>  Hardware is cyBus GigabitEthernet Interface, address is
> >>>> 0003.32fd.f0c0 (bia 0003.32fd.f0c0)
> >>>>  Description: feed to cat1.5/6
> >>>>  Internet address is X.X.X.X/28
> >>>>  MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
> >>>>     reliability 255/255, txload 5/255, rxload 6/255
> >>>>  Encapsulation ARPA, loopback not set
> >>>>  Keepalive set (10 sec)
> >>>>  Full-duplex, 1000Mb/s, link type is autonegotiation, media type
> > is
> >>> SX
> >>>>  output flow-control is XON, input flow-control is XON
> >>>>  ARP type: ARPA, ARP Timeout 04:00:00
> >>>>  Last input 00:00:00, output 00:00:00, output hang never
> >>>>  Last clearing of "show interface" counters 7w6d
> >>>>  Input queue: 0/75/38707/81008 (size/max/drops/flushes); Total
> >>>> output drops: 10276
> >>>>  Queueing strategy: fifo
> >>>>  Output queue: 0/40 (size/max)
> >>>>  30 second input rate 24360000 bits/sec, 4195 packets/sec
> >>>>  30 second output rate 21260000 bits/sec, 4126 packets/sec
> >>>>     9833124494 packets input, 4733684298220 bytes, 0 no buffer
> >>>>     Received 11921351 broadcasts, 0 runts, 0 giants, 1350
> > throttles
> >>>>     2683847777 input errors, 0 CRC, 2683489514 frame, 4395
> > overrun,
> >>>> 370684 ignored
> >>>>     0 watchdog, 11568950 multicast, 0 pause input
> >>>>     0 input packets with dribble condition detected
> >>>>     10530489310 packets output, 7707156852297 bytes, 0 underruns
> >>>>     0 output errors, 0 collisions, 4 interface resets
> >>>>     6002 unknown protocol drops
> >>>>     0 babbles, 0 late collision, 0 deferred
> >>>>     8 lost carrier, 0 no carrier, 0 pause output
> >>>>     0 output buffer failures, 0 output buffers swapped out
> >>>>
> >>>> VIP-Slot6   10:43:52 AM Tuesday Jul 6 2010 PDT
> >>>>
> >>>>
> >>>>    111111111111111111111111111111111111111111111111111111111111
> >>>>    222233333222221111100000333331111100000222223333322222222221
> >>>> 100
> >>>> 90
> >>>> 80
> >>>> 70
> >>>> 60
> >>>> 50
> >>>> 40
> >>>> 30
> >>>> 20
> >>>> 10
> >>>>
> >>
> **********************************************************
> >>>> **
> >>>>   0....5....1....1....2....2....3....3....4....4....5....5....6
> >>>>             0    5    0    5    0    5    0    5    0    5    0
> >>>>               CPU% per second (last 60 seconds)
> >>>>
> >>>>
> >>>>    151111351111111511852381153122211111212111161211118331181111
> >>>>    415869924534233096537174664310543638877434467042630685635444
> >>>> 100
> >>>> 90                   *   *
> >>>> 80                   *   *                           *    *
> >>>> 70                   *   *                    *      *    *
> >>>> 60                   *   *  *                 *      *    *
> >>>> 50  *     *       *  **  *  *                 *      *    *
> >>>> 40  *    **       *  **  *  *                 *      ***  *
> >>>> 30  *    **       *  *****  **   *     * *    *      ***  #
> >>>> 20  #****## *     ***##**# *#* ***  * ****    #**  * #****#*
> >>>> 10
> >>>>
> >>
> ##########################################################
> >>>> ##
> >>>>   0....5....1....1....2....2....3....3....4....4....5....5....6
> >>>>             0    5    0    5    0    5    0    5    0    5    0
> >>>>               CPU% per minute (last 60 minutes)
> >>>>              * = maximum CPU%   # = average CPU%
> >>>>
> >>>>
> >>>>    996111  11 2111177379959211 1      1  1     211591 11    1
> >>>> 259 28254
> >>>>
> >>>>
> >>
> 9900609912980001946199499209488679907788898952209380097990899998299
> >>>> 34946
> >>>> 100 **                  ** *
> >>>> *                *
> >>>> 90 **                  ** *                        *
> >>> *
> >>>> 80 **              *   ** *                        *
> >>>> *  *
> >>>> 70 **              ** *** *                        *
> >>>> *  *
> >>>> 60 ***             ** *** *                        *
> >>>> *  *
> >>>> 50 ***             ** *****                       **
> >>>> **  * **
> >>>> 40 ***             ********                       **
> >>>> **  * **
> >>>> 30 ***        *    *********                   *  **
> >>>> ***  ****
> >>>> 20 *** *      *    *********             *     *  **
> >>>> *** *****
> >>>> 10
> >>>>
> >>
> #############################*********#**#*#######*******#
> >>>> *******#****#*
> >>>>
> >>>> 0
> >>>>
> >>> ....
> >>>
5....1....1....2....2....3....3....4....4....5....5....6....6....7..
> >>>>             0    5    0    5    0    5    0    5    0    5    0
> >>>> 5    0
> >>>>                   CPU% per hour (last 72 hours)
> >>>>                  * = maximum CPU%   # = average CPU%
> >>>>
> >>>>
> >>>>
> >>>> Thanks,
> >>>>
> >>>> -Troy
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> _______________________________________________
> >>>> cisco-nsp mailing list  cisco-nsp at puck.nether.net
> >>>> https://puck.nether.net/mailman/listinfo/cisco-nsp
> >>>> archive at http://puck.nether.net/pipermail/cisco-nsp/
> >




More information about the cisco-nsp mailing list