[f-nsp] L4 CAM exhaustion

[Fabio Mendes]

Hello Guys,

We are facing a strange situation on a customer.

During random periods, BigIron syslogs this kind of message:

May 20 15:24:13:I:System: CPU protection action2 deactivated at 000b7e00
May 20 15:23:48:I:System: CPU protection action2 activated at 000b7d00
May 20 15:23:22:I:System: CPU protection action2 deactivated at 000b7c00
May 20 15:22:57:I:System: CPU protection action2 activated at 000b7b00
May 20 15:22:31:I:System: CPU protection action2 deactivated at 000b7a00
May 20 15:22:05:I:System: CPU protection action2 activated at 000b7900
May 20 15:21:40:I:System: CPU protection action2 deactivated at 000b7800
May 20 15:21:14:I:System: CPU protection action2 activated at 000b7700

The box do have the "cpupro-action hardware-flooding enable" command
enabled, with the default thresholds.

When the box goes this state we issue the "sh l2-cpu all" command, which
shows:

SSH at BigIron#sh l2-cpu all

Condition Configuration:
01: 00000001 Atomic cpu dwm: 90, cwm: 60
02: 00000002 Atomic cam dwm: 90, cwm: 60
03: 00000003 Composite or(1,2)

System Condition Monitoring: *Exhausted*.
CPU Condition: Normal.
    DWM:90 CWM:60 CUR:14 CNT:0
Layer 2 CAM Condition: Normal.
    DWM:90 CWM:60 CUR:4 CNT:0
Layer 3 CAM Condition: Normal.
    DWM:90 CWM:60 CUR:7 CNT:0
Layer 4 CAM Condition: *Exhausted*.
  **DWM:90 CWM:60 CUR:91 CNT:4**

Action Configuration:
1: action(03) q-aging(Dis) Deactivated
     History: activated 0 times, deactivated 0 times
2: action(03) hw-flood(Ena) Deactivated
     History: activated 33 times, deactivated 33 times

When this kind of thing happens, some servers/clients experinece connection
losses (this is the box trying to go back to its "normal" state I suppose).

Unfortunately "show cam-partition detail" command does not show enough
information for debbuging purposes.

Have anyone someone faced something similar ? What could this be ?


-- 

CCNA - Cisco Certified Network Associate
CCNP - Cisco Certified Network Professional

"A bird that you set free may be caught again, but a word that escapes your
lips will not return." Jewish Proverb
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/foundry-nsp/attachments/20100520/f2b8ef21/attachment.html>