<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Wilbur,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Do you have a recommended configuration for the FLS648 buffers? The </span><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>“buffer-sharing-full” does help on some of the switches, but it does not help on others. I tried enabling flow-control but it did not help. I’m not sure how to get acceptable performance.</span><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We are running a single 10 Gbps uplink to each FLS648, and then have 40 servers connected by 1 Gbps ports. The average aggregate bandwidth for the whole switch is typically well under 1 Gbps, but we do burst above that occasionally which is why we have a 10 Gbps uplink.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We are only using the FLS648 switches for layer 2 with VLANs. All layer 3 is handled by the upstream device (MLX).<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We are running software version 7.2.02 on the FLS648 switches.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>If you need any other information, please let me know.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thanks.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Wilbur Smith [mailto:wsmith@brocade.com] <br><b>Sent:</b> Friday, February 20, 2015 10:09 PM<br><b>To:</b> nethub@gmail.com; Brad Fleming<br><b>Cc:</b> 'Jeroen Wunnink | Hibernia Networks'; foundry-nsp@puck.nether.net<br><b>Subject:</b> Re: [f-nsp] MLX throughput issues<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Hello All,<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Sorry to reply late, but it seems like you were hitting the buffer limit for a port domain (group of ports). I don’t have an FLS in front of me (flying ATM) so I can’t confirm, but I think we’re breaking up the buffer space into reserved segments for each port group. The reasoning behind this is that Is keeps “slow drain” devices on a single interface from using up all available buffer space for the switch. The down side is that if a port exhausts its allotted buffers, it can cause slow downs.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Over the years we’ve gone back in forth over whether its better to ship with shared buffers enabled; I think it would generate the same amount of TAC requests no matter what we do. Although the FLS isn’t as beefy as the FCX or ICX, it should still have some nobs you can turn to increase performance. This should be in the config guide. <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>I’d try to narrow down what device or devices is causing buffer pressure on the switch and consider enabling ethernet pause-frames (flow control) on the switch and neighboring devices. There’s also different QOS setting that can switch from stick queues to weighted round-robin (and other types) to help make better use of the buffers on the uplink ports. <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Sorry you’re running into this. The FLS is a very good campus access switch platform (good latency and minimal oversubscription, for a good cost), but my view is that it’s not the best switch to front-end server connections or heavy I/O. Others may disagree with me on this though. <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Wilbur<o:p></o:p></span></p></div></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-family:"Calibri","sans-serif";color:black'>From: </span></b><span style='font-family:"Calibri","sans-serif";color:black'>"<a href="mailto:nethub@gmail.com">nethub@gmail.com</a>"<br><b>Date: </b>Friday, February 13, 2015 at 4:13 PM<br><b>To: </b>Brad Fleming<br><b>Cc: </b>'Jeroen Wunnink | Hibernia Networks', "<a href="mailto:foundry-nsp@puck.nether.net">foundry-nsp@puck.nether.net</a>"<br><b>Subject: </b>Re: [f-nsp] MLX throughput issues<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We already tried a full system reboot last night and it didn’t seem to help. I’ll definitely keep your switch fabric reboot procedure in mind in case we run into that in the future.</span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I think we may have figured out at least a short-term solution. On the FLS648, we ran the command “buffer-sharing-full” and immediately we were able to get better speeds. It seems as though the FLS648’s buffers may have been causing the issue. We’ll continue to monitor over the next few days and see if this actually solves the issue.</span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thanks everyone for your feedback thus far.</span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'> Brad Fleming [<a href="mailto:bdflemin@gmail.com">mailto:bdflemin@gmail.com</a>] <br><b>Sent:</b> Friday, February 13, 2015 4:24 PM<br><b>To:</b> <a href="mailto:nethub@gmail.com">nethub@gmail.com</a><br><b>Cc:</b> Jeroen Wunnink | Hibernia Networks; <a href="mailto:foundry-nsp@puck.nether.net">foundry-nsp@puck.nether.net</a><br><b>Subject:</b> Re: [f-nsp] MLX throughput issues</span><span style='color:black'><o:p></o:p></span></p></div></div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p><p class=MsoNormal><span style='color:black'>Over the years we’ve seen odd issues where one of the switch-fabric-links will “wigout” and some of the data moving between cards will get corrupted. When this happens we power cycle each switch fab one at a time using this process:<o:p></o:p></span></p><div><p class=MsoNormal><span style='color:black'>1) Shutdown SFM #3<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>2) Wait 1 minute<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>3) Power SFM #3 on again<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>4) Verify all SFM links are up to SFM#3<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>5) Wait 1 minute<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>6) Perform steps 1-5 for SFM #2<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>7) Perform steps 1-5 for SFM #3<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>Not sure you’re seeing the same issue that we see but the “SFM Dance” (as we call it) is a once-every-four-months thing somewhere across our 16 XMR4000 boxes. It can be done with little to no impact if you are patient verify status before moving to the next SFM.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p><div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div><p class=MsoNormal><span style='color:black'>On Feb 13, 2015, at 11:41 AM, <a href="mailto:nethub@gmail.com">nethub@gmail.com</a> wrote:<o:p></o:p></span></p></div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p><div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We have three switch fabrics installed, all are under 1% utilized.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p></div><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><div><p class=MsoNormal style='background:white'><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'>From:</span></b><span class=apple-converted-space><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'> </span></span><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'>Jeroen Wunnink | Hibernia Networks [<a href="mailto:jeroen.wunnink@atrato.com"><span style='color:purple'>mailto:jeroen.wunnink@atrato.com</span></a>]<span class=apple-converted-space> </span><br><b>Sent:</b><span class=apple-converted-space> </span>Friday, February 13, 2015 12:27 PM<br><b>To:</b><span class=apple-converted-space> </span><a href="mailto:nethub@gmail.com"><span style='color:purple'>nethub@gmail.com</span></a>; 'Jeroen Wunnink | Hibernia Networks'<br><b>Subject:</b><span class=apple-converted-space> </span>Re: [f-nsp] MLX throughput issues</span><span style='color:black'><o:p></o:p></span></p></div></div></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>How many switchfabrics do you have in that MLX and how high is the utilization on them<br><br>On 13/02/15 18:12,<span class=apple-converted-space> </span><a href="mailto:nethub@gmail.com"><span style='color:purple'>nethub@gmail.com</span></a><span class=apple-converted-space> </span>wrote:</span><span style='color:black'><o:p></o:p></span></p></div></div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We also tested with a spare Quanta LB4M we have and are seeing about the same speeds as we are seeing with the FLS648 (around 20MB/s or 160Mbps).</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I also reduced the number of routes we are accepting down to about 189K and that did not make a difference.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><span style='color:black'><o:p></o:p></span></p></div><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><div><p class=MsoNormal style='background:white'><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'>From:</span></b><span class=apple-converted-space><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'> </span></span><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:black'>foundry-nsp [<a href="mailto:foundry-nsp-bounces@puck.nether.net"><span style='color:purple'>mailto:foundry-nsp-bounces@puck.nether.net</span></a>]<span class=apple-converted-space> </span><b>On Behalf Of<span class=apple-converted-space> </span></b>Jeroen Wunnink | Hibernia Networks<br><b>Sent:</b><span class=apple-converted-space> </span>Friday, February 13, 2015 3:35 AM<br><b>To:</b><span class=apple-converted-space> </span><a href="mailto:foundry-nsp@puck.nether.net"><span style='color:purple'>foundry-nsp@puck.nether.net</span></a><br><b>Subject:</b><span class=apple-converted-space> </span>Re: [f-nsp] MLX throughput issues</span><span style='color:black'><o:p></o:p></span></p></div></div></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>The FLS switches do something weird with packets. I've noticed they somehow interfere with changing the MSS window size dynamically, resulting in destinations further away having very poor speed results compared to destinations close by.<span class=apple-converted-space> </span><br><br>We got rid of those a while ago.<br><br><br>On 12/02/15 17:37,<span class=apple-converted-space> </span><a href="mailto:nethub@gmail.com"><span style='color:purple'>nethub@gmail.com</span></a><span class=apple-converted-space> </span>wrote:</span><span style='color:black'><o:p></o:p></span></p></div></div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>We are having a strange issue on our MLX running code 5.6.00c. We are encountering some throughput issues that seem to be randomly impacting specific networks.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>We use the MLX to handle both external BGP and internal VLAN routing. Each FLS648 is used for Layer 2 VLANs only.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>From a server connected by 1 Gbps uplink to a Foundry FLS648 switch, which is then connected to the MLX on a 10 Gbps port, running a speed test to an external network is getting 20MB/s.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>Connecting the same server directly to the MLX is getting 70MB/s.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>Connecting the same server to one of my customer's Juniper EX3200 (which BGP peers with the MLX) also gets 70MB/s.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>Testing to another external network, all three scenarios get 110MB/s.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>The path to both test network locations goes through the same IP transit provider.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>We are running NI-MLX-MR with 2GB RAM, NI-MLX-10Gx4 connect to the Foundry FLS648 by XFP-10G-LR, NI-MLX-1Gx20-GC was used for directly connecting the server. A separate NI-MLX-10Gx4 connects to our upstream BGP providers. Customer’s Juniper EX3200 connects to the same NI-MLX-10Gx4 as the FLS648. We take default routes plus full tables from three providers by BGP, but filter out most of the routes.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>The fiber and optics on everything look fine. CPU usage is less than 10% on the MLX and all line cards and CPU usage at 1% on the FLS648. ARP table on the MLX is about 12K, and BGP table is about 308K routes.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'> </span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:black'>Any assistance would be appreciated. I suspect there is a setting that we’re missing on the MLX that is causing this issue.</span><span style='color:black'><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><br><br><br><br><br><br><o:p></o:p></span></p></div><pre style='background:white'><span style='color:black'>_______________________________________________<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>foundry-nsp mailing list<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="mailto:foundry-nsp@puck.nether.net"><span style='color:purple'>foundry-nsp@puck.nether.net</span></a><o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="http://puck.nether.net/mailman/listinfo/foundry-nsp"><span style='color:purple'>http://puck.nether.net/mailman/listinfo/foundry-nsp</span></a><o:p></o:p></span></pre></blockquote><div><p class=MsoNormal style='background:white'><span style='color:black'><br><br><br><br><br><br><o:p></o:p></span></p></div><pre style='background:white'><span style='color:black'>-- <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'> <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Jeroen Wunnink<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>IP NOC Manager - Hibernia Networks<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Main numbers (Ext: 1011): USA +1.908.516.4200 | UK +44.1704.322.300 <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Netherlands +31.208.200.622 | 24/7 IP NOC Phone: +31.20.82.00.623<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="mailto:jeroen.wunnink@hibernianetworks.com"><span style='color:purple'>jeroen.wunnink@hibernianetworks.com</span></a><o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="http://www.hibernianetworks.com/"><span style='color:purple'>www.hibernianetworks.com</span></a><o:p></o:p></span></pre></blockquote><div><p class=MsoNormal style='background:white'><span style='color:black'><br><br><br><br><br><o:p></o:p></span></p></div><pre style='background:white'><span style='color:black'>-- <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'> <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Jeroen Wunnink<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>IP NOC Manager - Hibernia Networks<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Main numbers (Ext: 1011): USA +1.908.516.4200 | UK +44.1704.322.300 <o:p></o:p></span></pre><pre style='background:white'><span style='color:black'>Netherlands +31.208.200.622 | 24/7 IP NOC Phone: +31.20.82.00.623<o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="mailto:jeroen.wunnink@hibernianetworks.com"><span style='color:purple'>jeroen.wunnink@hibernianetworks.com</span></a><o:p></o:p></span></pre><pre style='background:white'><span style='color:black'><a href="http://www.hibernianetworks.com/"><span style='color:purple'>www.hibernianetworks.com</span></a><o:p></o:p></span></pre><p class=MsoNormal><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black;background:white'>_______________________________________________</span><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black'><br><span style='background:white'>foundry-nsp mailing list</span><br></span><span style='color:black'><a href="mailto:foundry-nsp@puck.nether.net"><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:purple;background:white'>foundry-nsp@puck.nether.net</span></a></span><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black'><br></span><span style='color:black'><a href="http://puck.nether.net/mailman/listinfo/foundry-nsp"><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:purple;background:white'>http://puck.nether.net/mailman/listinfo/foundry-nsp</span></a><o:p></o:p></span></p></div></blockquote></div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p></div></div></div></div></body></html>