[j-nsp] M7i/M10i memory allocated on pfe for Next-Hop Entry

Sat Oct 11 11:37:45 EDT 2008

Hi List,

Please need your help. Does anybody know on how the work of memory allocated
in the pfe (cfeb) next-hop entries database?

I've a problem with the memory for next-hop entry on M7i & M10i running with
JunOS 8.4R4.2 and made isis adjacencies DOWN and can't established, even
though the link already established again . The problem only occurred on LS
(LS-4/LS-32) & AS2 PIC's for bundling E1 interfaces in the backbone with
JunOS 8.4R4.2. The logs shown :

Oct  7 18:47:28  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJUP: IS-IS new L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4

Oct  7 18:53:39  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJDOWN: IS-IS lost L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4, reason: Aged Out

Oct  7 18:54:01  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJUP: IS-IS new L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4

Oct  7 18:57:54  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJDOWN: IS-IS lost L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4, reason: Aged Out

Oct  7 19:06:30  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJUP: IS-IS new L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4

Oct  7 19:08:59  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJDOWN: IS-IS lost L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4, reason: Aged Out

Oct  7 19:09:07  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJUP: IS-IS new L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4

Oct  7 19:09:07  SOME-PE-ROUTERS rpd[3565]: RPD_ISIS_ADJDOWN: IS-IS lost L2
adjacency to NEIGHBOR-PE-ROUTERS on ls-0/1/0.4, reason: 3-Way Handshake
Failed

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH details: idx 5895 type
2 ifl 76

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 25 (ADD
AGGREGATE NEXTHOP) failed, err 5 (Invalid)

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 7 (ADD UNILIST
NEXTHOP) failed, err 5 (Invalid)

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 29 (CHANGE
INDIRECT NEXTHOP) failed, err 5 (Invalid)

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 2 (CHANGE
NEXTHOP) failed, err 6 (No Memory)

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 1 (ADD NEXTHOP)
failed, err 6 (No Memory)

Oct  7 19:02:18  SOME-PE-ROUTERS /kernel: RT_PFE: NH details: idx 5898 type
2 ifl 69

Oct  7 19:02:20  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 11 (DELETE
NEXTHOP) failed, err 7 (Doesn't Exist)

Oct  7 19:02:23  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 30 (GET NH BULK
STATS) failed, err 5 (Invalid)

Oct  7 19:02:34  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 30 (GET NH BULK
STATS) failed, err 5 (Invalid)

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 2 (CHANGE
NEXTHOP) failed, err 6 (No Memory)

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 1 (ADD NEXTHOP)
failed, err 6 (No Memory)

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH details: idx 7106 type
2 ifl 68

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 1 (ADD NEXTHOP)
failed, err 6 (No Memory)

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH details: idx 7169 type
2 ifl 76

Oct  7 19:02:41  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 25 (ADD
AGGREGATE NEXTHOP) failed, err 5 (Invalid)

Oct  7 19:02:43  SOME-PE-ROUTERS /kernel: RT_PFE: NH IPC op 1 (ADD NEXTHOP)
failed, err 6 (No Memory)

As a workaround, JTAC request to check the information bellow  and If you
take a look into the Chip 0 for Next-Hop Entries the used already reached of
total allocated. Restarting the CFEB active is the workaround to solve the
problem to flush the used of the memory. But I've other PE running with
JunOS 8.0R3.4 and this case does not occur on the M7i/M10i with LS/AS2
PIC's.

users at SOME-PE-ROUTERS> start shell pfe network cfeb0    

CSBR platform (266Mhz PPC 603e processor, 128MB memory, 512KB flash)

CSBR0(SOME-PE-ROUTERS vty)# sh nhdb zones     

Chip  Start   Size   Rsvd   Used/Hi Water/Total  Size  Name

----  -----  -----  -----  --------------------  ----  ----

   0  30000  10000  00000              0/0/8192     8  Multicast RTP

   0  40000  10000  00000             0/0/65536     1  Multicast Lists

   0  50000  0f000  00006     61439/11080/61440     1  Next-Hop Entries

   0  5f000  a1000  0004b    36722/38046/329728     2  L2 Descriptors

   0  40400  001ff  00000              33/36/63     8  L2 Programs

   1  30000  10000  00000              0/0/8192     8  Multicast RTP

   1  40000  10000  00000             0/0/65536     1  Multicast Lists

   1  50000  0f000  00006       7369/7909/61440     1  Next-Hop Entries

   1  5f000  a1000  0004b    24431/26527/329728     2  L2 Descriptors

   1  40400  001ff  00000              11/13/63     8  L2 Programs

CSBR0(SOME-PE-ROUTERS vty)#

Kind Regards,

Beny D Setyawan