[j-nsp] Juniper M20 memory problem

[Nicolaj Kamensek]

Hello list,

today I found the following messages in my /var/log/messages:

Jun  9 19:59:53  re0 /kernel: Nexthop index allocation failed: regular 
index space exhausted

That messages occures several times. The hardware is a Juniper M20 with 
SSB-E and standard FPC. ge-0/0/0 and ge-1/0/0 are members of an 
aggregated ethernet interface.
The problem is, that the router cannot learn new ARP entries anymore. 
Here is some output from JunOS:

nico at re0> show chassis ssb
SSB status:
Slot 0 information:
   State                                 Backup
Slot 1 information:
   State                                 Master
   Temperature                        31 degrees C / 87 degrees F
   CPU utilization                    18 percent
   Interrupt utilization               2 percent
   Heap utilization                   76 percent
   Buffer utilization                 63 percent
   Total CPU DRAM                     64 MB
   Internet Processor II                 Version 1, Foundry IBM, Part 
number 9
   Start time:                           2007-04-18 02:34:09 CEST
   Uptime:                              52 days, 17 hours, 35 minutes, 
18 secons


nico at re0> show route forwarding-table summary
Routing table: inet
Internet:
          user:         216958 routes
          perm:          4 routes
          intf:         246 routes
          dest:         7568 routes
          ifdn:          1 routes
          iddn:          3 routes

(inet6 etc.. is empty, IPv4 only)

nico at re0> start shell pfe network ssb


SSB platform (200/266Mhz PPC 603e processor, 64MB memory, 256KB flash)

SSB1(re0 vty)# show nhdb zones
Chip  Start   Size   Rsvd   Used/Hi Water/Total  Size  Name
----  -----  -----  -----  --------------------  ----  ----
    0  20000  01000  00000               0/0/512     8  Multicast RTP
    0  21000  02400  00000              0/0/9216     1  Multicast Lists
    0  23400  04400  00006       7202/8106/17408     1  Next-Hop Entries
    0  27800  18800  0004b     28928/32532/50176     2  L2 Descriptors
    0  40400  001ff  00000                3/3/63     8  L2 Programs
    1  20000  01000  00000               0/0/512     8  Multicast RTP
    1  21000  02400  00000              0/0/9216     1  Multicast Lists
    1  23400  04400  00006          0/8106/17408     1  Next-Hop Entries
    1  27800  18800  0004b       120/32532/50176     2  L2 Descriptors
    1  40400  001ff  00000                2/3/63     8  L2 Programs


nico at re0> start shell pfe network fpc0


FPC platform (PPC 603e processor, 8MB memory, 256KB flash)

FPC0(vty)# show memory
ID      Base   Total(b)    Free(b)    Used(b)   %   Name
--  --------  ---------  ---------  ---------  ---  -----------
  0    39fa08    2491896    2118084     373812   15  Kernel
  1  90600000    2097152    1773480     323672   15  Uncached

nico at re0> start shell pfe network fpc1


FPC platform (PPC 603e processor, 8MB memory, 256KB flash)

FPC1(vty)# show memory
ID      Base   Total(b)    Free(b)    Used(b)   %   Name
--  --------  ---------  ---------  ---------  ---  -----------
  0    39fa08    2491896    2119520     372376   14  Kernel
  1  90600000    2097152    1783180     313972   14  Uncached

nico at re0> show arp no-resolve | count
Count: 7205 lines


I really *can't* see any memory problems here, not at the SSB-E and not 
at the FPCs. Any hints?

Thanks in advance!

Regards,
Nicolaj Kamensek


-- 
Accelerated IT Services GmbH
Schubertstrasse 10                        D-67251 Freinsheim
nk at accelerated.de                         http://www.accelerated.de/
Telefon: +49 6232 - 672568                Telefax: +49 6353 - 989039
HRB: 60665 - Amtsgericht Ludwigshafen     UstID: DE253684415
Geschäftsführende Gesellschafter:         Nicolaj Kamensek & Ole Krieger