[f-nsp] FCX High CPU Diagnostics

[Derek Maxwell]

So, something doesn't add up here:

During a high CPU event, this is the output of show processes cpu:

show processes cpu
Process Name   5Sec(%)   1Min(%)   5Min(%)   15Min(%)   Runtime(ms)
ARP              0.00      0.00      0.00      0.00           1989
BGP              0.00      0.00      0.00      0.00           2809
DOT1X            0.00      0.00      0.00      0.00              0
GVRP             0.00      0.00      0.00      0.00              0
ICMP             0.00      0.00      0.00      0.00           1690
IP               1.10      1.37      1.21      0.58         128381
OSPF             0.00      0.00      0.00      0.00              0
RIP              0.00      0.00      0.00      0.00             20
STP              0.00      0.00      0.00      0.00              0
VRRP             0.00      0.00      0.00      0.00              0
Process Name   5Sec(%)   1Min(%)   5Min(%)   15Min(%)   Runtime(ms)
IPv6             0.00      0.00      0.00      0.01          33559
ICMP6            0.00      0.01      0.01      0.01          31180
ND6              0.00      0.00      0.00      0.00           1461
RIPng            0.00      0.00      0.00      0.00             41
OSPFv3           0.00      0.00      0.00      0.00              0
IPV6_RX          0.00      0.00      0.00      0.00            181

IP is the only high CPU process, but it's only at 1.1-1.37%.


This is the output of show cpu:
show cpu           
99 percent busy, from 289 sec ago
1   sec avg: 99 percent busy
5   sec avg: 99 percent busy
60  sec avg: 99 percent busy
300 sec avg: 99 percent busy

It's 99% busy and the control plane is barely responding.

Any thoughts on a hidden process that may be monopolizing the system?


On 4/3/19, 11:36 AM, "foundry-nsp on behalf of Derek Maxwell" <foundry-nsp-bounces at puck.nether.net on behalf of derek.maxwell at chosentechgroup.com> wrote:

    Yes and that's exactly what I was looking for. Thanks!
    
    Will continue to debug from here when it pops up again and see what I find. 
    
    -----Original Message-----
    From: Jörg Kost <jk at ip-clear.de> 
    Sent: Wednesday, April 3, 2019 11:26 AM
    To: Derek Maxwell <derek.maxwell at chosentechgroup.com>; foundry-nsp <foundry-nsp at puck.nether.net>
    Subject: Re: [f-nsp] FCX High CPU Diagnostics
    
    Does
    show processes cpu
    work on the FCX?
    
    On 3 Apr 2019, at 19:51, Derek Maxwell wrote:
    
    > Anyone have any thoughts on how to diagnose intermittent 99% CPU 
    > utilization on a FCX624? We're running Layer 3 code and high CPU usage 
    > seems to be causing BGP sessions to drop.
    >
    _______________________________________________
    foundry-nsp mailing list
    foundry-nsp at puck.nether.net
    http://puck.nether.net/mailman/listinfo/foundry-nsp