[c-nsp] Strange 7600 behavior
Evgeny Zhuravlev
zz at dsi.ru
Thu Apr 28 22:49:15 EDT 2011
Hello, Raphael Costa!
It looks like we have the same problem at the our C7600.
There are configured only one eBGP session and one iBGP session, static
and connected routes to BGP nexthops.
While router loading bgp full table from the eBGP neighbor at the
first time, and starts forwarding traffic, RP CPU usage increases to
90-100%.
'sh ibc brief' command at this moment shows about 1Gbit traffic punted
to the RP.
After the command 'clear cef linecard" RP cpu usage normalizes, and 'sh
ibc brief' shows about 30kbit traffic to RP.
R1#sh platform hardware pfc mode
PFC operating mode : PFC3CXL
We are using only CFC cards in this box.
Do you find problem o resole it?
On Wed, 16 Mar 2011 17:26:01 -0300
Raphael Costa <raphaelbscosta at gmail.com> wrote:
> After a router reload:
>
> Router#ps
> CPU utilization for five seconds: 18%/17%; one minute: 19%; five
> minutes: 14%
> PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY
> Process 2 12 85 141 0.00% 0.01% 0.00% 0
> Load Meter 8 3848 213 18065 0.00% 0.86%
> 0.64% 0 Check heaps 160 88 8 11000 0.00%
> 0.01% 0.00% 0 Per-minute Jobs
> 164 928 993 934 0.00% 0.11% 0.13% 1
> Virtual Exec
> 186 0 12514 0 0.00% 0.02% 0.00% 0 ACE
> Tunnel Task
> 222 0 12514 0 0.07% 0.01% 0.00% 0 IP
> ARP Retry Age
> 223 328 2253 145 0.00% 0.01% 0.03% 0 IP
> Input 259 0 47032 0 0.07% 0.08% 0.07% 0
> Ethernet Msec Ti
> 263 8 12514 0 0.07% 0.01% 0.00% 0 IPAM
> Manager
> 304 3152 355 8878 0.00% 0.02% 0.30% 0 XDR
> mcast 312 12216 225 54293 0.00% 0.08% 1.31% 0
> IP RIB Update
> 388 212 213 995 0.15% 0.06% 0.04% 0
> HIDDEN VLAN Proc
> 470 20600 1416 14548 0.07% 0.20% 2.11% 0 BGP
> Router 493 56 567 98 0.07% 0.01% 0.00%
> 0 Port manager per
> 499 596 1027 580 0.00% 0.00% 0.04% 0 BGP
> I/O 552 2132 163 13079 0.00% 0.01% 0.22% 0
> BGP Task 553 4060 22 184545 0.00% 0.77%
> 0.69% 0 BGP Scanner
>
> Router#sho
> Router#show ib
> Router#show ibc | i rate
> 5 minute rx rate 4547000 bits/sec, 8434 packets/sec
> 5 minute tx rate 11063000 bits/sec, 16861 packets/sec
>
>
> 2011/3/16 Raphael Costa <raphaelbscosta at gmail.com>
>
> > Guys,
> >
> > Definitely there is something really wrong. :-)
> >
> > The router stoped consuming cpu due interrupts.
> >
> > The only thing that I've changed was, changed uplink interface from
> > 5/2 to 4/48 on the fly. After that the router began responding well.
> >
> > So, to check again, I came the cable back to 5/2. And the router is
> > working well.
> >
> > How could this be possible?
> >
> >
> > Router#show platform hardware capacity forwarding
> > L2 Forwarding Resources
> > MAC Table usage: Module Collisions Total Used
> > %Used
> > 5 0 98304 7
> > 1%
> >
> > VPN CAM usage: Total Used
> > %Used
> > 512 0
> > 0%
> > L3 Forwarding Resources
> > Module FIB TCAM usage: Total
> > Used %Used
> > 5 72 bits (IPv4, MPLS, EoM) 524288
> > 349774 67%
> >
> > 144 bits (IP mcast, IPv6) 262144
> > 9 1%
> >
> > detail: Protocol Used
> > %Used
> > IPv4 347726
> > 66%
> >
> > MPLS 2048
> > 1%
> > EoM 0
> > 0%
> >
> > IPv6 2
> > 1%
> > IPv4 mcast 4
> > 1%
> > IPv6 mcast 3
> > 1%
> >
> > Adjacency usage: Total Used
> > %Used
> > 1048576 169
> > 1%
> >
> > Forwarding engine load:
> > Module pps peak-pps
> > peak-time
> > 5 41127 86367 12:34:28 UTC Wed
> > Mar 16 2011
> >
> > Router#show platform hardware capacity forwarding
> > Router#sh int g5/2
> > GigabitEthernet5/2 is up, line protocol is up (connected)
> > Hardware is C7600 1Gb 802.3, address is c471.fe02.b200 (bia
> > c471.fe02.b200)
> > Internet address is 201.20.8.70/28
> > MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
> > reliability 255/255, txload 1/255, rxload 93/255
> > Encapsulation ARPA, loopback not set
> > Keepalive set (10 sec)
> > Full-duplex, 1000Mb/s
> > Media-type configured as RJ45 connector
> > input flow-control is off, output flow-control is off
> > Clock mode is auto
> > ARP type: ARPA, ARP Timeout 04:00:00
> > Last input 00:00:00, output 00:00:00, output hang never
> > Last clearing of "show interface" counters never
> > Input queue: 1/75/0/0 (size/max/drops/flushes); Total output
> > drops: 0 Queueing strategy: fifo
> > Output queue: 0/40 (size/max)
> > 30 second input rate 365332000 bits/sec, 30134 packets/sec
> > 30 second output rate 6942000 bits/sec, 12383 packets/sec
> > L2 Switched: ucast: 10748 pkt, 12090146 bytes - mcast: 1321 pkt,
> > 88190 bytes
> > L3 in Switched: ucast: 30867012 pkt, 46691056901 bytes - mcast: 0
> > pkt, 0 bytes mcast
> > L3 out Switched: ucast: 6010443 pkt, 424545288 bytes mcast: 0
> > pkt, 0 bytes
> > 31267578 packets input, 47289495550 bytes, 0 no buffer
> > Received 1428 broadcasts (0 IP multicasts)
> > 0 runts, 0 giants, 0 throttles
> > 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
> > 0 watchdog, 0 multicast, 0 pause input
> > 0 input packets with dribble condition detected
> > 13511869 packets output, 949740713 bytes, 0 underruns
> > 0 output errors, 0 collisions, 5 interface resets
> > 0 unknown protocol drops
> > 0 babbles, 0 late collision, 0 deferred
> > 0 lost carrier, 0 no carrier, 0 pause output
> > 0 output buffer failures, 0 output buffers swapped out
> > Router#sho
> > Router#ps
> > CPU utilization for five seconds: 0%/0%; one minute: 2%; five
> > minutes: 5%
> >
> > PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY
> > Process 2 28 490 57 0.00% 0.01% 0.00%
> > 0 Load Meter 4 1668 1610 1036 0.00% 0.10%
> > 0.05% 1 Virtual Exec
> > 8 20572 1154 17826 0.00% 0.74% 0.94% 0
> > Check heaps
> > 27 8 2374 3 0.07% 0.00% 0.00% 0 IPC
> > Periodic Tim
> > 160 500 42 11904 0.23% 0.02% 0.00% 0
> > Per-minute Jobs
> > 161 28 2462 11 0.00% 0.01% 0.00% 0
> > Per-Second Jobs
> > 186 8 70590 0 0.07% 0.01% 0.00% 0
> > ACE Tunnel Task
> > 213 21932 188 116659 0.00% 0.00% 0.28% 0
> > Collection proce
> > 223 816 7275 112 0.00% 0.01% 0.00% 0 IP
> > Input 259 28 276966 0 0.07% 0.07% 0.07%
> > 0 Ethernet Msec Ti
> > 263 28 70590 0 0.00% 0.01% 0.00% 0
> > IPAM Manager
> > 304 24428 1691 14445 0.00% 0.01% 0.28% 0
> > XDR mcast 312 57304 1387 41315 0.00% 0.02%
> > 0.71% 0 IP RIB Update
> > 329 24 4608 5 0.07% 0.01% 0.00% 0
> > TCP Timer 388 1068 1224 872 0.00% 0.05%
> > 0.05% 0 HIDDEN VLAN Proc
> > 470 71460 6273 11391 0.00% 0.05% 0.69% 0
> > BGP Router 552 8724 1251 6973 0.07% 0.00%
> > 0.09% 0 BGP Task 553 24192 142 170366 0.00%
> > 1.51% 1.19% 0 BGP Scanner
> > 555 9192 49 187591 0.00% 0.00% 0.10% 0
> > BGP Event
> >
> >
> >
> > Router#show ibc | i rate
> > 5 minute rx rate 1000 bits/sec, 8 packets/sec
> > 5 minute tx rate 22000 bits/sec, 50 packets/sec
> >
> >
> >
> > 2011/3/16 Raphael Costa <raphaelbscosta at gmail.com>
> >
> >>
> >> Router#show ibc | i rate
> >> 5 minute rx rate 2031000 bits/sec, 3633 packets/sec
> >> 5 minute tx rate 4765000 bits/sec, 7262 packets/sec
> >>
> >>
> >> 2011/3/16 Sigurbjörn B. Lárusson <sigurbjornl at vodafone.is>
> >>
> >> show ibc | i rate is also useful here
> >>>
> >>> Kind regards,
> >>> Sibbi
> >>>
> >>>
> >>> On 16.3.2011 16:26, "Dobbins, Roland" <rdobbins at arbor.net> wrote:
> >>>
> >>> >
> >>> > On Mar 16, 2011, at 11:18 PM, Raphael Costa wrote:
> >>> >
> >>> >> Thanks for your quickly response.
> >>> >
> >>> > TCAM isn't overflowed, doesn't look like traffic's being punted.
> >>> >
> >>> > Maybe someone's packeting your box. You have iACLs and/or CoPP
> >>> > in
> >>> place?
> >>> >
> >>> > -----------------------------------------------------------------------
> >>> > Roland Dobbins <rdobbins at arbor.net> //
> >>> > <http://www.arbornetworks.com>
> >>> >
> >>> > The basis of optimism is sheer terror.
> >>> >
> >>> > -- Oscar Wilde
> >>> >
> >>> >
> >>> > _______________________________________________
> >>> > cisco-nsp mailing list cisco-nsp at puck.nether.net
> >>> > https://puck.nether.net/mailman/listinfo/cisco-nsp
> >>> > archive at http://puck.nether.net/pipermail/cisco-nsp/
> >>>
> >>> _______________________________________________
> >>> cisco-nsp mailing list cisco-nsp at puck.nether.net
> >>> https://puck.nether.net/mailman/listinfo/cisco-nsp
> >>> archive at http://puck.nether.net/pipermail/cisco-nsp/
> >>>
> >>
> >>
> >>
> >> --
> >> Raphael Bittencourt S. Costa
> >> raphaelbscosta at yahoo.com.br
> >> raphaelbscosta at gmail.com
> >>
> >
> >
> >
> > --
> > Raphael Bittencourt S. Costa
> > raphaelbscosta at yahoo.com.br
> > raphaelbscosta at gmail.com
> >
>
>
>
--
Zhuravlev Evgeny
DSI
More information about the cisco-nsp
mailing list