[c-nsp] 12.2(18)S8 VIP2-50 memory problem

[Oleksandr Pantus]

Hello !

After upgrading 7513 (RSP4, 2xVIP2-50) from 12.2(18)S6 to 12.2(18)S8,
found that dCEF could not be started due to "no memory" state. RSP4
has 256M of RAM, both of VIP2-50 are of top configuration (128M RAM).

Here is log messages:

Apr 17 21:16:50.615: %FIB-3-FIBDISABLE: Fatal error, slot/cpu 2/0: no memory
Apr 17 21:16:50.631: %FIB-3-FIBDISABLE: Fatal error, slot/cpu 9/0: no memory

Apr 17 21:16:54.471: %IPC-5-SLAVELOG: VIP-SLOT2:
 00:03:43: %SYS-2-MALLOCFAIL: Memory allocation of 4264 bytes failed from 0x600B0834, alignment 32
 Pool: Processor  Free: 43808  Cause: Memory fragmentation
 Alternate Pool: None  Free: 0  Cause: No Alternate pool

 -Process= "CEF LC IPC Background", ipl= 0, pid= 32
 -Traceback= 60104660 60106170 600B083C 600B0BE4 600B11D0 6036DC00 60369170 603A3738 603A44C0 603A466C 603A51C4

Apr 17 21:16:55.167: %IPC-5-SLAVELOG: VIP-SLOT9:
 00:03:43: %SYS-2-MALLOCFAIL: Memory allocation of 4264 bytes failed from 0x600B0834, alignment 32
 Pool: Processor  Free: 60992  Cause: Memory fragmentation
  Alternate Pool: None  Free: 0  Cause: No Alternate pool

  -Process= "CEF LC IPC Background", ipl= 0, pid= 32
  -Traceback= 60104660 60106170 600B083C 600B0BE4 600B11D0 6036DC00 60369170 603A3738 603A44C0 603A466C 603A51C4

Router#show cef linecard

Slot/CPU  MsgSent    XDRSent  Window   LowQ   MedQ  HighQ Flags
 2            2977     162954 LC wait      0      0      0 disabled
 9            2985     162994 LC wait      0      0      0 disabled

VRF Default, version 318059, 158653 routes
   Slot/CPU Version    CEF-XDR    I/Fs State    Flags
   2         317301     158597       8 Active   table-disabled
   9         317307     158600      13 Active   table-disabled

VRF CUST1, version 24, 15 routes
   Slot/CPU Version    CEF-XDR    I/Fs State    Flags
   2             22          9       1 Inactive table-disabled
   9             22          9       1 Inactive table-disabled

Here is an output from one of VIP2-50 at this router.

VIP-Slot9#sh mem
           Head      Total(b)     Used(b)     Free(b)   Lowest(b)  Largest(b)
Processor  60C2FCE0  121439008    77664472    43774536  58176      9384168
PCI        30000000    8388608     8388304         304    304          280

It looks like there is enough memory. On 12.2(18)S6 everything is Ok, and
dCEF works well with the same configuration.

Router#sh cef linecard
Slot/CPU  MsgSent    XDRSent  Window   LowQ   MedQ  HighQ Flags
 B
 2           18548     196670     221      0      0      0 up
 9           18551     196700     221      0      0      0 up

VRF Default, version 342147, 158888 routes
 Slot/CPU Version    CEF-XDR    I/Fs State    Flags
 2         342147     183255       8 Active   sync, table-up
 9         342147     183255      13 Active   sync, table-up

VRF CUST1, version 24, 15 routes
 Slot/CPU Version    CEF-XDR    I/Fs State    Flags
 2             24         10       1 Active   sync, table-up
 9             24         10       1 Active   sync, table-up

VIP-Slot9#sh mem
            Head      Total(b)    Used(b)   Free(b)   Lowest(b)  Largest(b)
Processor   60C2FE40  121438656   65569976  55868680   55797744    55769656
      PCI   30000000    8388624    8388304       320        320         280

Any ideas would be greatly appreciated.

-- 
S/Y,
Oleksandr Pantus, MD		nic-hdl: AJP-RIPE

----- End forwarded message -----

-- 
S/Y,
Alexander, MD, 			nic-hdl: AJP1-UANIC