[j-nsp] jtree0 Memory full on MX480?
Jeff Meyers
Jeff.Meyers at gmx.net
Tue Jul 21 19:23:49 EDT 2015
Hi Phil,
sure:
{master}
jeff at cr0> show configuration | display set | match rpf-check
{master}
nico at FRA4.cr0> show version
Hostname: cr0
Model: mx480
JUNOS Base OS boot [11.4R9.4]
JUNOS Base OS Software Suite [11.4R9.4]
JUNOS Kernel Software Suite [11.4R9.4]
JUNOS Crypto Software Suite [11.4R9.4]
JUNOS Packet Forwarding Engine Support (M/T Common) [11.4R9.4]
JUNOS Packet Forwarding Engine Support (MX Common) [11.4R9.4]
JUNOS Online Documentation [11.4R9.4]
JUNOS Voice Services Container package [11.4R9.4]
JUNOS Border Gateway Function package [11.4R9.4]
JUNOS Services AACL Container package [11.4R9.4]
JUNOS Services LL-PDF Container package [11.4R9.4]
JUNOS Services PTSP Container package [11.4R9.4]
JUNOS Services Stateful Firewall [11.4R9.4]
JUNOS Services NAT [11.4R9.4]
JUNOS Services Application Level Gateways [11.4R9.4]
JUNOS Services Captive Portal and Content Delivery Container package
[11.4R9.4]
JUNOS Services RPM [11.4R9.4]
JUNOS Services HTTP Content Management package [11.4R9.4]
JUNOS AppId Services [11.4R9.4]
JUNOS IDP Services [11.4R9.4]
JUNOS Services Crypto [11.4R9.4]
JUNOS Services SSL [11.4R9.4]
JUNOS Services IPSec [11.4R9.4]
JUNOS Runtime Software Suite [11.4R9.4]
JUNOS Routing Software Suite [11.4R9.4]
{master}
nico at FRA4.cr0> show route summary
Autonomous system number: XXXXX
Router ID: A.B.C.D
inet.0: 546231 destinations, 1747898 routes (545029 active, 11 holddown,
2994 hidden)
Direct: 1143 routes, 1140 active
Local: 1144 routes, 1144 active
OSPF: 81 routes, 18 active
BGP: 1745429 routes, 542631 active
Static: 100 routes, 95 active
IGMP: 1 routes, 1 active
Basic-Table.inet.0: 212783 destinations, 215070 routes (212778 active, 5
holddown, 0 hidden)
Direct: 2283 routes, 1140 active
Local: 2288 routes, 1144 active
OSPF: 17 routes, 17 active
BGP: 210387 routes, 210382 active
Static: 95 routes, 95 active
inet6.0: 23331 destinations, 39242 routes (23330 active, 1 holddown, 113
hidden)
Direct: 451 routes, 368 active
Local: 373 routes, 373 active
OSPF3: 9 routes, 9 active
BGP: 38399 routes, 22571 active
Static: 10 routes, 9 active
Basic-Table.inet6.0: 12295 destinations, 12295 routes (12292 active, 3
holddown, 0 hidden)
Direct: 366 routes, 366 active
Local: 373 routes, 373 active
OSPF3: 8 routes, 8 active
BGP: 11539 routes, 11536 active
Static: 9 routes, 9 active
{master}
I actually thought this "Basic-Table" was inactive. It is not so I'm
going to deactive it now. Since it was holding > 200k routes, this is
for sure a lot. Doing that made the syslog message disappear but it
didn't actually free up as much as I was hoping for:
GOT: Jtree memory segment 0 (Context: 0x44976cc8)
GOT: -------------------------------------------
GOT: Memory Statistics:
GOT: 16777216 bytes total
GOT: 14613176 bytes used
GOT: 2145824 bytes available (865792 bytes from free pages)
GOT: 3024 bytes wasted
GOT: 15192 bytes unusable
GOT: 32768 pages total
GOT: 6338 pages used (2568 pages used in page alloc)
GOT: 24739 pages partially used
GOT: 1691 pages free (max contiguous = 380)
Still doesn't look to glorious, right?
Best,
Jeff
Am 22.07.2015 um 01:06 schrieb Phil Rosenthal:
> Can you paste the output of these commands:
> show conf | display set | match rpf-check
> show ver
> show route sum
>
> DPC should have enough memory for ~1M FIB. This can get divided in half if you are using RPF. If you have multiple routing instances, this also can contribute to the problem.
>
> Best Regards,
> -Phil Rosenthal
>> On Jul 21, 2015, at 6:56 PM, Jeff Meyers <Jeff.Meyers at gmx.net> wrote:
>>
>> Hello list,
>>
>> we seem to be running into limits with a MX480 with RE-2000 and 2x DPCE-4XGE-R since we are seeing these new messages in the syslog:
>>
>>
>> Jul 22 00:50:36 cr0 fpc0 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-dwords Available:83072 is less than LWM limit:104857, rsmon_syslog_limit()
>> Jul 22 00:50:36 cr0 fpc0 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-pages Available:1326 is less than LWM limit:1638, rsmon_syslog_limit()
>> Jul 22 00:50:36 cr0 fpc1 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-pages Available:1316 is less than LWM limit:1638, rsmon_syslog_limit()
>> Jul 22 00:50:37 cr0 fpc1 RSMON: Resource Category:jtree Instance:jtree0-seg0 Type:free-dwords Available:84224 is less than LWM limit:104857, rsmon_syslog_limit()
>> Jul 22 00:50:37 cr0 fpc0 RSMON: Resource Category:jtree Instance:jtree1-seg0 Type:free-dwords Available:84864 is less than LWM limit:104857, rsmon_syslog_limit()
>>
>>
>> Here is some more output from the FPC:
>>
>>
>> jeff at cr0> request pfe execute target fpc0 command "show rsmon"
>> SENT: Ukern command: show rsmon
>> GOT:
>> GOT: category instance type total lwm_limit hwm_limit free
>> GOT: -------- ----------- ------------ -------- --------- --------- --------
>> GOT: jtree jtree0-seg0 free-pages 32768 1638 4915 1245
>> GOT: jtree jtree0-seg0 free-dwords 2097152 104857 314572 79680
>> GOT: jtree jtree0-seg1 free-pages 32768 1638 4915 22675
>> GOT: jtree jtree0-seg1 free-dwords 2097152 104857 314572 1451200
>> GOT: jtree jtree1-seg0 free-pages 32768 1638 4915 1267
>> GOT: jtree jtree1-seg0 free-dwords 2097152 104857 314572 81088
>> GOT: jtree jtree1-seg1 free-pages 32768 1638 4915 23743
>> GOT: jtree jtree1-seg1 free-dwords 2097152 104857 314572 1519552
>> GOT: jtree jtree2-seg0 free-pages 32768 1638 4915 1266
>> GOT: jtree jtree2-seg0 free-dwords 2097152 104857 314572 81024
>> GOT: jtree jtree2-seg1 free-pages 32768 1638 4915 23732
>> GOT: jtree jtree2-seg1 free-dwords 2097152 104857 314572 1518848
>> GOT: jtree jtree3-seg0 free-pages 32768 1638 4915 1232
>> GOT: jtree jtree3-seg0 free-dwords 2097152 104857 314572 78848
>> GOT: jtree jtree3-seg1 free-pages 32768 1638 4915 23731
>> GOT: jtree jtree3-seg1 free-dwords 2097152 104857 314572 1518784
>> LOCAL: End of file
>>
>> {master}
>> jeff at cr0> request pfe execute target fpc0 command "show jtree 0 memory extensive"
>> SENT: Ukern command: show jtree 0 memory extensive
>> GOT:
>> GOT: Jtree memory segment 0 (Context: 0x44976cc8)
>> GOT: -------------------------------------------
>> GOT: Memory Statistics:
>> GOT: 16777216 bytes total
>> GOT: 15299920 bytes used
>> GOT: 1459080 bytes available (660480 bytes from free pages)
>> GOT: 3024 bytes wasted
>> GOT: 15192 bytes unusable
>> GOT: 32768 pages total
>> GOT: 26528 pages used (2568 pages used in page alloc)
>> GOT: 4950 pages partially used
>> GOT: 1290 pages free (max contiguous = 373)
>> GOT:
>> GOT: Partially Filled Pages (In bytes):-
>> GOT: Unit Avail Overhead
>> GOT: 8 674344 0
>> GOT: 16 107840 0
>> GOT: 24 13296 4792
>> GOT: 32 288 0
>> GOT: 48 2832 10400
>> GOT:
>> GOT: Free Page Lists(Pg Size = 512 bytes):-
>> GOT: Page Bucket Avail(Bytes)
>> GOT: 1-1 140288
>> GOT: 2-2 112640
>> GOT: 3-3 76800
>> GOT: 4-4 49152
>> GOT: 5-5 7680
>> GOT: 6-6 15360
>> GOT: 7-7 25088
>> GOT: 8-8 8192
>> GOT: 9-11 5632
>> GOT: 12-17 6656
>> GOT: 18-26 22016
>> GOT: 27-32768 190976
>> GOT:
>> GOT: Fragmentation Index = 0.869, (largest free = 190976)
>> GOT: Counters:
>> GOT: 465261655 allocs (0 failed)
>> GOT: 0 releases(partial 0)
>> GOT: 463785484 frees
>> GOT: 0 holds
>> GOT: 9 pending frees(pending bytes 88)
>> GOT: 0 pending forced
>> GOT: 0 times free blocked
>> GOT: 0 sync writes
>> GOT: Error Counters:-
>> GOT: 0 bad params
>> GOT: 0 failed frees
>> GOT: 0 bad cookie
>> GOT:
>> GOT: Jtree memory segment 1 (Context: 0x449f87e8)
>> GOT: -------------------------------------------
>> GOT: Memory Statistics:
>> GOT: 16777216 bytes total
>> GOT: 5123760 bytes used
>> GOT: 11650408 bytes available (11609600 bytes from free pages)
>> GOT: 2704 bytes wasted
>> GOT: 344 bytes unusable
>> GOT: 32768 pages total
>> GOT: 9912 pages used (8976 pages used in page alloc)
>> GOT: 181 pages partially used
>> GOT: 22675 pages free (max contiguous = 22672)
>> GOT:
>> GOT: Partially Filled Pages (In bytes):-
>> GOT: Unit Avail Overhead
>> GOT: 8 25352 0
>> GOT: 16 11072 0
>> GOT: 32 384 0
>> GOT: 40 440 32
>> GOT: 48 1056 256
>> GOT: 56 448 8
>> GOT: 64 448 0
>> GOT: 72 360 8
>> GOT: 80 400 32
>> GOT: 168 336 16
>> GOT: 256 512 32
>> GOT:
>> GOT: Free Page Lists(Pg Size = 512 bytes):-
>> GOT: Page Bucket Avail(Bytes)
>> GOT: 3-3 1536
>> GOT: 27-32768 11608064
>> GOT:
>> GOT: Fragmentation Index = 0.004, (largest free = 11608064)
>> GOT: Counters:
>> GOT: 29941803 allocs (0 failed)
>> GOT: 0 releases(partial 0)
>> GOT: 29888786 frees
>> GOT: 0 holds
>> GOT: 1 pending frees(pending bytes 8)
>> GOT: 0 pending forced
>> GOT: 0 times free blocked
>> GOT: 0 sync writes
>> GOT: Error Counters:-
>> GOT: 0 bad params
>> GOT: 0 failed frees
>> GOT: 0 bad cookie
>> GOT:
>> GOT:
>> GOT: Context: 0x4296cc58
>> LOCAL: End of file
>>
>>
>> I furthermore found this article on Juniper KB:
>>
>>
>> http://kb.juniper.net/InfoCenter/index?page=content&id=KB19015&actp=search&viewlocale=en_US&searchid=1236602855555
>>
>>
>> Is it really possible the MX480 cannot handle more than roughly 500k routes in the FPC? What are my options here? Do I have to upgrade the SCB + get some new interfaces modules in order to keep this box running?
>>
>> What are my options to get some time? Where is the right knob to aggregate routes (if that's a good idea) to - let's say - /23?
>>
>>
>> Thanks in advance!
>>
>>
>>
>> Jeff
>> _______________________________________________
>> juniper-nsp mailing list juniper-nsp at puck.nether.net
>> https://puck.nether.net/mailman/listinfo/juniper-nsp
>
More information about the juniper-nsp
mailing list