<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"><base href="x-msg://592/"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Also in LA here.<div><br></div><div><div>traceroute to <a href="http://arin.net">arin.net</a> (192.149.252.76), 30 hops max, 60 byte packets</div><div> 1 10.201.69.1 (10.201.69.1) 0.227 ms 0.233 ms 0.232 ms</div><div> 2 * * *</div><div> 3 xe-7-2-0.mpr1.<a href="http://lax112.us.above.net">lax112.us.above.net</a> (64.125.170.97) 1.424 ms 1.396 ms 1.366 ms</div><div> 4 above-cox-1.<a href="http://lax12.us.above.net">lax12.us.above.net</a> (64.125.13.10) 1.331 ms above-cox-2.<a href="http://lax12.us.above.net">lax12.us.above.net</a> (64.125.13.14) 1.411 ms above-cox-1.<a href="http://lax12.us.above.net">lax12.us.above.net</a> (64.125.13.10) 1.386 ms</div><div> 5 mrfddsrj02-ae0.0.<a href="http://rd.dc.cox.net">rd.dc.cox.net</a> (68.1.1.7) 67.585 ms mrfddsrj01-ae0.0.<a href="http://rd.dc.cox.net">rd.dc.cox.net</a> (68.1.1.5) 67.667 ms 67.783 ms</div><div> 6 * * *</div><div> 7 * * *</div><div> 8 wsip-98-172-152-14.<a href="http://dc.dc.cox.net">dc.dc.cox.net</a> (98.172.152.14) 79.017 ms 69.115 ms 69.117 ms</div><div> 9 * * *</div><div>10 * * *</div><div>11 * * *</div><div><br></div><div><br></div><div><br></div><div><div>On Dec 19, 2012, at 3:50 PM, Jake Mertel <<a href="mailto:jake@nobistech.net">jake@nobistech.net</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div lang="EN-US" link="blue" vlink="purple" style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div class="WordSection1" style="page: WordSection1; "><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">Something else that just clicked, I have been having a number of issues reaching<span class="Apple-converted-space"> </span><a href="http://arin.net" style="color: purple; text-decoration: underline; ">arin.net</a><span class="Apple-converted-space"> </span>today from one of my servers in Los Angeles that uses nLayer as its upstream. Request response times are between 20 and 40 seconds as opposed to 2 to 4 seconds on our office connection. Looking at my trace from LA, we are going LA<->Cox<->ARIN.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">C:\Users\jake>tracert<span class="Apple-converted-space"> </span><a href="http://arin.net" style="color: purple; text-decoration: underline; ">arin.net</a><o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">Tracing route to<span class="Apple-converted-space"> </span><a href="http://arin.net" style="color: purple; text-decoration: underline; ">arin.net</a><span class="Apple-converted-space"> </span>[192.149.252.76]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">over a maximum of 30 hops:<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 1 <1 ms 1 ms <1 ms v403.er01.lax.ubiquity.io [72.37.224.129]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 2 1 ms 5 ms 1 ms xe-1-0-3.ar1.<a href="http://lax2.us.nlayer.net" style="color: purple; text-decoration: underline; ">lax2.us.nlayer.net</a><span class="Apple-converted-space"> </span>[69.31.127.45]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 3 <1 ms <1 ms <1 ms ae1-80g.cr1.<a href="http://lax1.us.nlayer.net" style="color: purple; text-decoration: underline; ">lax1.us.nlayer.net</a><span class="Apple-converted-space"> </span>[69.31.127.129]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 4 2 ms 5 ms 2 ms ae2-50g.ar1.<a href="http://lax1.us.nlayer.net" style="color: purple; text-decoration: underline; ">lax1.us.nlayer.net</a><span class="Apple-converted-space"> </span>[69.31.127.142]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 5 <1 ms <1 ms <1 ms as22773.ae12.ar1.<a href="http://lax1.us.nlayer.net" style="color: purple; text-decoration: underline; ">lax1.us.nlayer.net</a><span class="Apple-converted-space"> </span>[69.31.127.230]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 6 70 ms 111 ms 70 ms mrfddsrj01-ae0.0.<a href="http://rd.dc.cox.net" style="color: purple; text-decoration: underline; ">rd.dc.cox.net</a><span class="Apple-converted-space"> </span>[68.1.1.5]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 7 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 8 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> 9 72 ms 73 ms 82 ms wsip-98-172-152-14.<a href="http://dc.dc.cox.net" style="color: purple; text-decoration: underline; ">dc.dc.cox.net</a><span class="Apple-converted-space"> </span>[98.172.152.14]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">10 72 ms 72 ms 82 ms <span class="Apple-converted-space"> </span><a href="http://host-252-131.arin.net" style="color: purple; text-decoration: underline; ">host-252-131.arin.net</a><span class="Apple-converted-space"> </span>[192.149.252.131]<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">11 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">12 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">13 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">14 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">15 * * * Request timed out.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(181, 196, 223); padding: 3pt 0in 0in; "><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><b><span style="font-size: 10pt; font-family: Tahoma, sans-serif; ">From:</span></b><span style="font-size: 10pt; font-family: Tahoma, sans-serif; "><span class="Apple-converted-space"> </span><a href="mailto:outages-bounces@outages.org">outages-bounces@outages.org</a> [mailto:outages-<a href="mailto:bounces@outages.org">bounces@outages.org</a>]<span class="Apple-converted-space"> </span><b>On Behalf Of<span class="Apple-converted-space"> </span></b>Jake Mertel<br><b>Sent:</b><span class="Apple-converted-space"> </span>Wednesday, December 19, 2012 4:45 PM<br><b>To:</b><span class="Apple-converted-space"> </span>'Brandon Whaley'; '<a href="mailto:outages@outages.org">outages@outages.org</a>'<br><b>Subject:</b><span class="Apple-converted-space"> </span>Re: [outages] Cox -> nLayer connectivity issues<o:p></o:p></span></div></div></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); ">We have received a report of similar issues today. The client has servers with us in several locations where we use nLayer and/or PacketExchagne and his monitoring system is on a network that uses Cox as its preferred upstream. He shutdown his Cox upstream and didn’t have any issues reaching the servers over his backup provider. The issues were sporadic and did not affect all protocols – ICMP pings worked, snmpwalk was fine, but UDP traces were dying somewhere on the reverse path. Seems to be very similar to what you are seeing.<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><b><span style="font-size: 10pt; font-family: Tahoma, sans-serif; ">From:</span></b><span style="font-size: 10pt; font-family: Tahoma, sans-serif; "><span class="Apple-converted-space"> </span><a href="mailto:outages-bounces@outages.org" style="color: purple; text-decoration: underline; ">outages-bounces@outages.org</a><span class="Apple-converted-space"> </span>[<a href="mailto:outages-bounces@outages.org" style="color: purple; text-decoration: underline; ">mailto:outages-bounces@outages.org</a>]<span class="Apple-converted-space"> </span><b>On Behalf Of<span class="Apple-converted-space"> </span></b>Brandon Whaley<br><b>Sent:</b><span class="Apple-converted-space"> </span>Wednesday, December 19, 2012 4:25 PM<br><b>To:</b><span class="Apple-converted-space"> </span><a href="mailto:outages@outages.org" style="color: purple; text-decoration: underline; ">outages@outages.org</a><br><b>Subject:</b><span class="Apple-converted-space"> </span>[outages] Cox -> nLayer connectivity issues<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div><div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">We've been seeing intermittent TCP/UDP connectivity issues from Cox Communications in Virginia to any location that routes over nLayer. UDP traceroutes are fine, but DNS lookups time out for minutes at a time, then work again for ~5 minutes before repeating the problem. ICMP is never affected during the outages.<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div></div><div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">traceroute to 198.46.80.1 (198.46.80.1), 30 hops max, 60 byte packets<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 1 router36f24c.local (192.168.14.1) 0.560 ms 0.531 ms 0.753 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 2 <a href="http://wsip-174-77-92-169.hr.hr.cox.net" style="color: purple; text-decoration: underline; ">wsip-174-77-92-169.hr.hr.cox.net</a><span class="Apple-converted-space"> </span>(174.77.92.169) 2.532 ms 2.581 ms 3.009 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 3 172.21.224.153 (172.21.224.153) 3.995 ms 4.067 ms 4.111 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 4 172.21.249.101 (172.21.249.101) 4.185 ms 4.396 ms 4.561 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 5 172.21.249.73 (172.21.249.73) 4.916 ms 4.900 ms 5.128 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 6 172.21.249.18 (172.21.249.18) 5.517 ms 5.124 ms 5.043 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 7 <a href="http://ip-216-54-33-22.coxfiber.net" style="color: purple; text-decoration: underline; ">ip-216-54-33-22.coxfiber.net</a><span class="Apple-converted-space"> </span>(216.54.33.22) 210.486 ms 210.477 ms 210.466 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 8 68.1.4.139 (68.1.4.139) 221.950 ms 222.460 ms 232.268 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "> 9 *<span class="Apple-converted-space"> </span><a href="http://xe-5-0-7.ar1.iad1.us.nlayer.net" style="color: purple; text-decoration: underline; ">xe-5-0-7.ar1.iad1.us.nlayer.net</a><span class="Apple-converted-space"> </span>(69.31.10.81) 226.332 ms 226.866 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">10 <a href="http://as54641.xe-9-0-1.ar1.iad1.us.nlayer.net" style="color: purple; text-decoration: underline; ">as54641.xe-9-0-1.ar1.iad1.us.nlayer.net</a><span class="Apple-converted-space"> </span>(69.31.31.42) 223.718 ms 225.083 ms 225.744 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">11 198.46.80.1 (198.46.80.1) 225.706 ms 226.670 ms 226.698 ms<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">Is anyone with Cox on the list that can investigate/contact me?<o:p></o:p></div></div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">--<span class="Apple-converted-space"> </span><br>Best Regards,<span class="Apple-converted-space"> </span><br>Brandon W.<o:p></o:p></div></div></div></div>_______________________________________________<br>Outages mailing list<br><a href="mailto:Outages@outages.org">Outages@outages.org</a><br>https://puck.nether.net/mailman/listinfo/outages</div></blockquote></div><br></div></body></html>