Hello,<br><br>Hmmm, nice find w/the 'Maximum Peer Index Number' under the variables output. I checked some of our Brocade routers and it appears this number is dynamic and not static, but it's set ABOVE what our peer count is currently at(1 router w/less peers was showing 40 above...a router with a lot more peers had this at over 200 above current neighbor count). Being that you have maxed this out, I'm guessing either the platform variably alters that number UP TO a max of 253 or it has hit some sort of memory maximum from somewhere else which is not allowing it to move beyond 253. I can't tell you what is happening, but it's quite strange.<br>
<br>Let us know if you figure anything more out with this.<br><br>Sincerely.<br><br><div class="gmail_quote">On Wed, Mar 9, 2011 at 1:15 PM, Pieter Taks <span dir="ltr"><<a href="mailto:p.taks@nforce.nl">p.taks@nforce.nl</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div style="word-wrap: break-word; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri,sans-serif;">
<div>
<div>
<div>Hi,</div>
<div><br>
</div>
<div>Thanks for reading with me and thinking what it could be. Even with all the soft-reconfigurations disabled I still got the same issue. Please see the debug outputs below, perhaps anyone else knows why this is limited to 252 BGP peers on an RX4?</div>
<div><br>
</div>
<div>In the sh ip bgp debug variables output it shows Maximum Peer Index Number:253. Is there a way to change this?</div>
<div>
<div>sh ip bgp debug variables </div>
<div>safi:0, &bgp:08fe0aac, enabled:1, operational:1, &dbg_mem=08fe1c4c, curr_afi:0</div>
<div>io_process_running:0, io_process_next_peer_number=0</div>
<div>in_long_loops 0, clear_all 0, timer 00000000, count 0</div>
<div>timer_enabled:1, timer_next_peer_number:1, 1s timer 1, short timer 1</div>
<div>scheduler id:5:2, ip:77.247.181.xxx/28, time=92219</div>
<div>bgp_tcb:08fe0b74 (0xf0090001, 0), tick_cnt=12, seconds=6717786</div>
<div>bgp_tcb6:f00a0001 (0x00000000, 0x00000019)</div>
<div>*peer:08fe0bb0, *peer_group:08fe1b5c, RIB_in_root_node:24a35960</div>
<div>Maximum Peer Index Number:253, check_nexthops:0 0</div>
<div>router_id:85.159.239.xx, configured:0, cluster_id:0.0.0.13, configured:1</div>
<div>route_is_router_reflector:0, client_to_client_reflection:1</div>
<div>networks:x08fe401c, aggregate:x08feb0b8</div>
<div>default_metric:4294967294, local_preference:100, keep_alive:60, hold_time:180</div>
<div>originate_default:0, originated:0</div>
<div>distance:20 200 200, fast_external_fallover=0</div>
<div>nexthop recur0, en_def:0, readvertise:1, auto_sum:0, synch:0</div>
<div>always_compare_med:1, compare_med_with_empty_aspath: 0, redistribute_ibgp:150911764, local_network_check_time_count:6</div>
<div>nexthop_cache_hit_count:159342982, nexthop_cache_miss_count:5142</div>
<div>system memory:536870912, total_allocated:104422684, bgp_defined_quota:2147483648</div>
</div>
<div><br>
</div>
<div>
<div>sh ip bgp debug</div>
<div>BGP Debug Information</div>
<div>Pid Size Address Total Used Free NoMem Errors #_pools p_unit</div>
<div>0 8 08fe3d38 43688 31090 12598 0 0 5 2000 </div>
<div>1 16 08fe3d64 52426 37260 15166 0 0 5 2000 </div>
<div>2 24 08fe3d90 224692 131923 92769 0 0 10 2000 </div>
<div>3 32 08fe3dbc 116502 77986 38516 0 0 12 800 </div>
<div>4 48 08fe3de8 20163 12144 8019 0 0 7 400 </div>
<div>5 64 08fe3e14 3851 981 2870 0 0 5 200 </div>
<div>6 96 08fe3e40 2617 397 2220 0 0 6 80 </div>
<div>7 128 08fe3e6c 2480 1081 1399 0 0 8 40 </div>
<div>8 256 08fe3e98 755 478 277 0 0 6 20 </div>
<div>9 512 08fe3ec4 0 0 0 0 0 0 10 </div>
<div>10 4096 08fe3ef0 0 0 0 0 0 0 10 </div>
<div>11 48 08fe3f1c 362952 349541 13411 0 0 20 4000 </div>
<div>12 36 08fe3f48 183498 160937 22561 0 0 8 8000 </div>
<div>13 56 08fe3f74 699040 674509 24531 0 0 42 4000 </div>
<div>14 84 08fe3fa0 250214 169516 80698 0 0 22 4000 </div>
<div>15 96 08fe3fcc 0 0 0 0 0 0 4000 </div>
<div> Total Memory Use for Route and Attributes Tables : 104328584</div>
<div> Memory Block Not Available Count : 0</div>
<div> Bad Memory Pool ID Count : 0</div>
<div> TCP buffers : 4096 0 0 0</div>
<div> BGP Tx Parameters : 5 30 3</div>
<div> BGP route update count : 5 (4) last:17h54m45s </div>
<div> event : (5:2) 77.247.181.xxx/28</div>
<div> BGP io semaphore take 54915185, yield 20300844, 14291686</div>
<div> Max timer process: l-5131 s-80740 (463), io: 88163 7431 us</div>
<div> io_rx_yield_time 0x08fe0acc, 1</div>
<div> 1 sec timer value: 53364030, 21197655 TB</div>
<div> MP active: 1, standby up 0</div>
<div> Graceful_restart: enable 1, restart time 15, stale-routee 360, purge 600</div>
<div> Restarted 0, fwd 0, restart_up_time_count[0] 0</div>
</div>
<div><br>
</div>
<div>
<div>sh ip bgp debug memory </div>
<div>BGP_CLASS: 198964, BGP_PEER_CLASS: 120071, BGP_CONFIGURATION_CLASS: 3534</div>
<div>BGP_AS_PATH_ENTRY: 84, BGP_IPV6_AS_PATH_ENTRY: 96, BGP_AS_PATH_SEGMENTS: 14</div>
<div>BGP_NLRI_ENTRY: 56, BGP_PATRICIA_KEY_ADDRESS: 16, BGP_PATRICIA_NODE: 48</div>
<div>BGP_RIB_OUT_NLRI_ENTRY: 36, BGP_RIB_OUT_HOLDER: 28, BGP_WITHDRAWN_ROUTE_ENTRY: 34</div>
<div>BGP_NEXTHOP_ADDRESS: 16, BGP_NEXTHOP_ENTRY: 180, BGP_DAMPING_NLRI_ENTRY: 36</div>
<div>BGP_ROUTE_DAMPING_REUSE_LIST: 2052, BGP_ROUTE_DAMPING_BLOCK: 3522, BGP_DAMPENING: 37374</div>
<div>CU_BGP_ROUTE_MAP_SET_T: 234, CU_BGP_ROUTE_MAP_MATCH_T: 1222</div>
<div>BGP_MATCH_TAG: 65, BGP_SET_AS_PATH: 40, BGP_SET_COMMUNITY: 138</div>
<div>BGP_MATCH_UNION: 207, BGP_SET_UNION: 138</div>
<div>ROUTE_FILTER_MEMORY_ENTRY: 220, BGP_MATCH_CRITERIA: 216, BGP_SET_COMMAND: 147</div>
</div>
<div>
<div>
<div><br>
</div>
<div>
<div>sh ip bgp debug route-table </div>
<div>There are 674476 NLRIs in BGP Route Table, time 323 ms</div>
</div>
<div><br>
</div>
<div>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman',serif;">
<span style="font-size: 10.5pt; font-family: Consolas; color: rgb(31, 73, 125);">Best regards,</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman',serif;">
<span style="font-size: 10.5pt; font-family: Consolas; color: rgb(31, 73, 125);"> </span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman',serif;">
<span style="font-size: 10.5pt; font-family: Consolas; color: rgb(31, 73, 125);">Pieter Taks</span></p>
<p class="MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman',serif;">
<span style="font-size: 10.5pt; font-family: Consolas; color: rgb(31, 73, 125);"><br>
</span></p>
</div>
</div>
</div>
</div>
</div>
<span>
<div style="font-family: Calibri; font-size: 11pt; text-align: left; color: black; border-width: 1pt medium medium; border-style: solid none none; border-color: rgb(181, 196, 223) -moz-use-text-color -moz-use-text-color; padding: 3pt 0in 0in;">
<span style="font-weight: bold;">Datum: </span>Fri, 4 Mar 2011 17:03:03 -0600<div class="im"><br>
<span style="font-weight: bold;">Onderwerp: </span>Re: [f-nsp] Max BGP peers BigIron RX4<br>
</div></div><div><div></div><div class="h5">
<div><br>
</div>
Hi,<br>
<br>
That's interesting.<br>
<br>
Does the RX series support the 'show ip bgp debug' cmd list? It's hidden up to the point of 'debug'. If you can get that far, take a look around in there, especially 'show ip bgp debug memory' & just the plain 'show ip bgp debug'. Maybe something will stick
out.<br>
<br>
I want to say the router dynamically allocates memory for certain fields up to a certain dynamic max related to other parts of BGP like # of routes. Do you have soft-reconfig turned on? Maybe try turning that off and see if it frees up any more BGP peers. Brocade
software can be a little dodgy at times and not well documented.<br>
<br>
Also, I wouldn't be surprised if it was just some sort of bug. We've had stranger things happen when it comes to a bug on the Brocades.<br>
<br>
Sincerely.<br>
<br>
<div class="gmail_quote">On Tue, Feb 22, 2011 at 8:23 AM, Pieter Taks <span dir="ltr">
<<a href="mailto:p.taks@nforce.nl" target="_blank">p.taks@nforce.nl</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div link="blue" vlink="purple" lang="NL">
<div>
<p class="MsoNormal">Hi all,</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">While configuring a new peer on an BigIron RX4 we got the following error:</p>
<p class="MsoNormal" style="margin-left: 35.4pt;"><i>Error! BGP4 cannot allocate memory for peer 253</i></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">A PDF claims the following (<a href="http://www.terabitsystems.com/foundry-docs/Foundry-BigIron-RX-Series-Datasheet.pdf" target="_blank">http://www.terabitsystems.com/foundry-docs/Foundry-BigIron-RX-Series-Datasheet.pdf</a>):</p>
<p class="MsoNormal" style="margin-left: 35.4pt;"><i><span style="color: black;">BGPv4:
</span></i><i><span style="font-size: 9pt; color: black;">Scalable to 4 million routes, 500 peers and 14,000 attributes with MR2 management module</span></i></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Is there any reason why it wouldn’t want to configure more peering sessions?</p>
<p><span>-<span style="font: 7pt "Times New Roman";"> </span></span>I do not see any system-max setting for this</p>
<p><span>-<span style="font: 7pt "Times New Roman";"> </span></span>As well as I do not see any full memory yet</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Hope someone knows how to resolve this or what is causing this error.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">sh memory </p>
<p class="MsoNormal">====================================================================</p>
<p class="MsoNormal">BigIron RX active MP slot 33: </p>
<p class="MsoNormal">Total SDRAM: 2147483648 bytes</p>
<p class="MsoNormal">Available Memory: 1646874624 bytes</p>
<p class="MsoNormal">Free Physical Pages: 401374 pages</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Malloc statistics: total 500462813</p>
<p class="MsoNormal">os_malloc count: 24059060, fail: 3; os_free count: 24046183, fail 0, diff: 12877</p>
<p class="MsoNormal">====================================================================</p>
<p class="MsoNormal">BigIron RX LP SL 1: </p>
<p class="MsoNormal">Total SDRAM: 536870912 bytes</p>
<p class="MsoNormal">Available Memory: 53039104 bytes</p>
<p class="MsoNormal">====================================================================</p>
<p class="MsoNormal">BigIron RX LP SL 3: </p>
<p class="MsoNormal">Total SDRAM: 536870912 bytes</p>
<p class="MsoNormal">Available Memory: 72671232 bytes</p>
<p class="MsoNormal">====================================================================</p>
<p class="MsoNormal">BigIron RX LP SL 4: </p>
<p class="MsoNormal">Total SDRAM: 536870912 bytes</p>
<p class="MsoNormal">Available Memory: 72654848 bytes</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Any help is appreciated, thanks!</p>
<p class="MsoNormal"><span style="font-size: 10.5pt; font-family: Consolas;"> </span></p>
<font color="#888888">
<p class="MsoNormal"><span style="font-size: 10.5pt; font-family: Consolas;">Pieter Taks</span></p>
</font></div>
</div>
<br>
_______________________________________________<br>
foundry-nsp mailing list<br>
<a href="mailto:foundry-nsp@puck.nether.net" target="_blank">foundry-nsp@puck.nether.net</a><br>
<a href="http://puck.nether.net/mailman/listinfo/foundry-nsp" target="_blank">http://puck.nether.net/mailman/listinfo/foundry-nsp</a><br>
</blockquote>
</div>
<br>
</div></div></span>
</div>
</blockquote></div><br>