<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"><base href="x-msg://7430/"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">I got a Level3 confirmation that there was an issue but fixed now. Still waiting on details but I don't see an issue now.<div><br></div><div>Zaid</div><div><br><div><div>On Dec 16, 2013, at 6:23 AM, Frank Bulk <<a href="mailto:frnkblk@iname.com">frnkblk@iname.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div lang="EN-US" link="blue" vlink="purple" style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div class="WordSection1" style="page: WordSection1; "><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); ">Zaid:<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); ">Thanks. I tried traceroutes points before and after the Level3 routers and am not seeing that packet loss. Is it possible the issue is only between your network and Level3? But I also checked from several Calfornia locations on Level3’s lookingglass to 199.101.162.229 and saw no packet loss – if it’s a LAG connection, it could be my testing is hitting the wrong LAG member?<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); "> </span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); ">Frank<o:p></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><span style="font-size: 10pt; font-family: Tahoma, sans-serif; color: rgb(68, 84, 106); "> </span></div><div><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0in 0in; "><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><b><span style="font-size: 11pt; font-family: Calibri, sans-serif; ">From:</span></b><span style="font-size: 11pt; font-family: Calibri, sans-serif; "><span class="Apple-converted-space"> </span>Zaid Ali Kahn [mailto:zaid@<a href="http://zaidali.com">zaidali.com</a>]<span class="Apple-converted-space"> </span><br><b>Sent:</b><span class="Apple-converted-space"> </span>Monday, December 16, 2013 7:48 AM<br><b>To:</b><span class="Apple-converted-space"> </span>Frank Bulk<br><b>Cc:</b><span class="Apple-converted-space"> </span><a href="mailto:outages@outages.org">outages@outages.org</a><br><b>Subject:</b><span class="Apple-converted-space"> </span>Re: [outages] Issues on Level3 network?<o:p></o:p></span></div></div></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 2. 199.101.162.229 0.0% 10 1.6 0.8 0.6 1.6 0.3<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 3. 108.174.15.6 0.0% 10 0.9 0.7 0.6 0.9 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 4. 108.174.14.8 0.0% 10 25.2 21.9 2.8 49.5 13.4<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 5. xe-7-2-2.edge2.LosAngeles9.L 50.0% 10 0.7 0.7 0.7 0.8 0.0<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 6. vlan60.csw1.LosAngeles1.Leve 60.0% 10 138.0 137.7 137.6 138.0 0.2<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 7. ae-62-62.ebr2.LosAngeles1.Le 50.0% 10 137.8 137.8 137.7 138.0 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 8. ae-3-3.ebr3.Dallas1.Level3.n 70.0% 10 137.5 137.4 137.4 137.5 0.0<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 9. ae-7-7.ebr3.Atlanta2.Level3. 40.0% 10 137.9 138.0 137.9 138.1 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 10. ae-63-63.ebr1.Atlanta2.Level 50.0% 10 137.8 138.0 137.8 138.8 0.4<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 11. ae-6-6.ebr1.Washington12.Lev 60.0% 10 137.9 137.9 137.8 137.9 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 12. ae-1-100.ebr2.Washington12.L 30.0% 10 137.9 137.8 137.7 137.9 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 13. 4.69.201.61 70.0% 10 138.1 138.2 138.1 138.3 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 14. ae-42-42.ebr2.London1.Level3 70.0% 10 140.4 139.7 138.0 140.7 1.5<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 15. ae-57-222.csw2.London1.Level 50.0% 10 138.3 138.6 138.0 140.5 1.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 16. ae-225-3601.edge3.London1.Le 33.3% 9 137.9 147.9 137.9 187.3 19.7<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 17. REDBUS-INTE.edge3.London1.Le 44.4% 9 138.2 138.2 138.1 138.3 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 18. 85.90.238.66 37.5% 8 138.5 138.5 138.5 138.7 0.1<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 19. ipt-emc-as27822.lon2.telecit 50.0% 8 138.3 138.4 138.3 138.8 0.3<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 20. 85.90.224.174 62.5% 8 138.8 139.0 138.8 139.1 0.2<o:p></o:p></pre><pre style="margin: 0in 0in 0.0001pt; font-size: 10pt; font-family: 'Courier New'; "> 21. mx.bt.lon5.<a href="http://cpcloud.co.uk" style="color: purple; text-decoration: underline; ">cpcloud.co.uk</a> 50.0% 8 138.0 138.2 138.0 138.4 0.2<o:p></o:p></pre><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><o:p> </o:p></div></div><div><div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">On Dec 16, 2013, at 5:31 AM, Frank Bulk <<a href="mailto:frnkblk@iname.com" style="color: purple; text-decoration: underline; ">frnkblk@iname.com</a>> wrote:<o:p></o:p></div></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "><br><br><o:p></o:p></div><blockquote style="margin-top: 5pt; margin-bottom: 5pt; "><p class="MsoNormal" style="margin: 0in 0in 12pt; font-size: 12pt; font-family: 'Times New Roman', serif; ">In addition to your traceroute, could you provide an mtr report or something<br>similar?<br><br>Frank<br><br>-----Original Message-----<br>From: Outages [mailto:outages-<a href="mailto:bounces@outages.org" style="color: purple; text-decoration: underline; ">bounces@outages.org</a>] On Behalf Of Zaid Ali<br>Kahn<br>Sent: Monday, December 16, 2013 7:24 AM<br>To:<span class="Apple-converted-space"> </span><a href="mailto:outages@outages.org" style="color: purple; text-decoration: underline; ">outages@outages.org</a><br>Subject: [outages] Issues on Level3 network?<br><br>We are seeing quite a lot of packet loss.<br><br>2 199.101.162.229 (199.101.162.229) 0.682 ms 0.825 ms 1.099 ms<br>3 108.174.15.6 (108.174.15.6) 0.656 ms 0.649 ms 108.174.15.2<br>(108.174.15.2) 0.618 ms<br>4 108.174.14.0 (108.174.14.0) 0.554 ms 0.560 ms 108.174.14.8<br>(108.174.14.8) 1.023 ms<br>5 xe-4-3-0.<a href="http://edge6.LosAngeles1.Level3.net" style="color: purple; text-decoration: underline; ">edge6.LosAngeles1.Level3.net</a><span class="Apple-converted-space"> </span>(4.31.58.141) 0.616 ms 0.616 ms<br>0.609 ms<br>6 * * *<br>7 * * *<br>8 * * *<br>9 * * *<br>10 * * *<br>11 ae-6-6.<a href="http://ebr1.Washington12.Level3.net" style="color: purple; text-decoration: underline; ">ebr1.Washington12.Level3.net</a><span class="Apple-converted-space"> </span>(4.69.148.106) 137.853 ms * *<br>12 ae-1-100.<a href="http://ebr2.Washington12.Level3.net" style="color: purple; text-decoration: underline; ">ebr2.Washington12.Level3.net</a><span class="Apple-converted-space"> </span>(4.69.143.214) 137.443 ms *<br>137.574 ms<br>13 * * *<br>14 ae-42-42.<a href="http://ebr2.London1.Level3.net" style="color: purple; text-decoration: underline; ">ebr2.London1.Level3.net</a><span class="Apple-converted-space"> </span>(4.69.137.69) 137.650 ms * *<br>15 * * *<br>16 * ae-228-3604.<a href="http://edge3.London1.Level3.net" style="color: purple; text-decoration: underline; ">edge3.London1.Level3.net</a><span class="Apple-converted-space"> </span>(4.69.166.158) 137.293 ms *<br><br><br>Zaid<br><br><br>_______________________________________________<br>Outages mailing list<br><a href="mailto:Outages@outages.org" style="color: purple; text-decoration: underline; ">Outages@outages.org</a><br><a href="https://puck.nether.net/mailman/listinfo/outages" style="color: purple; text-decoration: underline; ">https://puck.nether.net/mailman/listinfo/outages</a><br><br><o:p></o:p></p></blockquote></div><p class="MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; "></p></div></div></blockquote></div><br></div></body></html>