I suspect this was due to a large bgp event today. <a href="http://www.bgpmon.net/large-hijack-affects-reachability-of-high-traffic-destinations/">http://www.bgpmon.net/large-hijack-affects-reachability-of-high-traffic-destinations/</a><br><br>On Friday, April 22, 2016, Charles Sprickman via Outages <<a href="mailto:outages@outages.org">outages@outages.org</a>> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">I can reach east-1 from HE in NYC and VZ in NNJ.<div><br></div><div>I’m relatively new to FiOS, is this path normal?</div><div><br></div><div><div>frankentosh:~ spork$ traceroute !$</div><div>traceroute <a href="http://monitor.xxxs.com" target="_blank">monitor.xxxs.com</a></div><div>traceroute to <a href="http://monitor.xxxs.com" target="_blank">monitor.xxxs.com</a> (54.85.105.220), 64 hops max, 52 byte packets</div><div> 1 <a href="http://lo0-100.nwrknj-vfttp-312.verizon-gni.net" target="_blank">lo0-100.nwrknj-vfttp-312.verizon-gni.net</a> (108.53.194.1) 1.406 ms 1.233 ms 1.904 ms</div><div> 2 <a href="http://t1-8-0-6.nwrknj-lcr-22.verizon-gni.net" target="_blank">t1-8-0-6.nwrknj-lcr-22.verizon-gni.net</a> (100.41.220.233) 5.804 ms</div><div> <a href="http://t1-6-0-0.nwrknj-lcr-22.verizon-gni.net" target="_blank">t1-6-0-0.nwrknj-lcr-22.verizon-gni.net</a> (100.41.220.228) 3.732 ms</div><div> <a href="http://t1-8-0-6.nwrknj-lcr-21.verizon-gni.net" target="_blank">t1-8-0-6.nwrknj-lcr-21.verizon-gni.net</a> (100.41.220.235) 6.286 ms</div><div> 3 * * *</div><div> 4 0.<a href="http://ae6.br1.nyc1.alter.net" target="_blank">ae6.br1.nyc1.alter.net</a> (140.222.228.131) 4.642 ms</div><div> 0.<a href="http://ae5.br1.nyc1.alter.net" target="_blank">ae5.br1.nyc1.alter.net</a> (140.222.228.107) 4.304 ms</div><div> 0.<a href="http://ae6.br1.nyc1.alter.net" target="_blank">ae6.br1.nyc1.alter.net</a> (140.222.228.131) 4.582 ms</div><div> 5 <a href="http://pax-brdr-01.inet.qwest.net" target="_blank">pax-brdr-01.inet.qwest.net</a> (63.235.40.53) 4.864 ms 2.956 ms 13.092 ms</div><div> 6 <a href="http://dca2-edge-01.inet.qwest.net" target="_blank">dca2-edge-01.inet.qwest.net</a> (67.14.36.10) 9.539 ms 10.112 ms 11.018 ms</div><div> 7 72.165.86.74 (72.165.86.74) 9.879 ms</div><div> 65.120.78.82 (65.120.78.82) 9.580 ms</div><div> 67.133.224.206 (67.133.224.206) 8.967 ms</div><div> 8 * * *</div><div> 9 * * *</div><div>10 54.239.110.245 (54.239.110.245) 32.092 ms</div><div> 54.239.110.235 (54.239.110.235) 11.426 ms</div><div> 54.239.110.233 (54.239.110.233) 40.425 ms</div><div><br></div><div>I would have assumed AS701 would peer directly with AWS, that has to represent at least a quarter of FiOS traffic.</div><div><br></div><div>Charles</div><div><br></div><div>
-- <br>Charles Sprickman<br>NetEng/SysAdmin<br><a href="http://bway.net" target="_blank">Bway.net</a> - New York's Best Internet <a href="http://www.bway.net" target="_blank">www.bway.net</a><br><a href="javascript:_e(%7B%7D,'cvml','spork@bway.net');" target="_blank">spork@bway.net</a> - 212.982.9800<br><br><br>
</div>
<br><div><blockquote type="cite"><div>On Apr 22, 2016, at 1:48 PM, Ben Burns via Outages <<a href="javascript:_e(%7B%7D,'cvml','outages@outages.org');" target="_blank">outages@outages.org</a>> wrote:</div><br><div>
<div text="#000000" bgcolor="#FFFFFF">
Can confirm inbound connectivity still down for us-east-1.<br>
<br>
<div>On 16-04-22 11:42 AM, Sebastian J.
Orsini II via Outages wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">That correlates with the timing of some really
weird DNS issues for us. (ISP=Hargray)
<div><br>
</div>
<div>Ie some webpages would load some wouldn't. we lost 1/3 of
our vpns and about half our public ips were not pingable from
some different isps.</div>
<div><br>
</div>
<div>Then it just magically cleared up. Felt like about 4
,months ago when level3 had DNS issues?</div>
<div><br>
</div>
<div>I dunno. Its all okay now......<br>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Apr 22, 2016 at 1:29 PM, John
Kinsella via Outages <span dir="ltr"><<a href="javascript:_e(%7B%7D,'cvml','outages@outages.org');" target="_blank"></a><a href="javascript:_e(%7B%7D,'cvml','outages@outages.org');" target="_blank">outages@outages.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Back to normal as others
have said. Lasted 10ish minutes? Normal trace below. Not
sure if HE issue or Amazon dropped an announcement
maybe...
<div><br>
</div>
<div><span>
<div>
Packets Pings</div>
<div> Host
Loss% Snt Last Avg Best Wrst StDev</div>
</span>
<div> 1. 10.0.1.1
0.0% 1 1.1 1.1 1.1 1.1 0.0</div>
<div> 2. 10.0.1.49
0.0% 1 2.2 2.2 2.2 2.2 0.0</div>
<div> 3. 173.247.205.38
0.0% 1 3.7 3.7 3.7 3.7 0.0</div>
<div> 4. x.<a href="http://196.247.173.web-pass.com/" target="_blank">196.247.173.web-pass.com</a>
0.0% 1 4.9 4.9 4.9 4.9 0.0</div>
<div> 5. x.<a href="http://196.247.173.web-pass.com/" target="_blank">196.247.173.web-pass.com</a>
0.0% 1 3.7 3.7 3.7 3.7 0.0</div>
<div> 6. <a href="http://equinix01-sfo5.amazon.com/" target="_blank">equinix01-sfo5.amazon.com</a>
0.0% 1 5.6 5.6 5.6 5.6 0.0</div>
<div> 7. 54.240.242.112
0.0% 1 37.3 37.3 37.3 37.3 0.0</div>
<div> 8. 54.240.242.115
0.0% 1 28.6 28.6 28.6 28.6 0.0</div>
<div> 9. 205.251.229.189
0.0% 1 42.8 42.8 42.8 42.8 0.0</div>
<div>10. 54.239.42.6
0.0% 1 25.2 25.2 25.2 25.2 0.0</div>
<div>11. 205.251.232.130
0.0% 1 25.1 25.1 25.1 25.1 0.0</div>
<div>12. 205.251.232.143
0.0% 1 25.0 25.0 25.0 25.0 0.0</div>
<div>13. 54.239.48.179
0.0% 1 26.8 26.8 26.8 26.8 0.0</div>
<div>14. ???</div>
<div>
<div>
<div><br>
</div>
<div><br>
</div>
<div>
<blockquote type="cite">
<div>On Apr 22, 2016, at 10:22 AM, Hal Ponton
<<a href="javascript:_e(%7B%7D,'cvml','hal@buzcom.net');" target="_blank">hal@buzcom.net</a>>
wrote:</div>
<br>
<div>
<div bgcolor="#FFFFFF" text="#000000">I've
also been seeing some issues to youtube,
twitter, amazon and reddit from the UK but
they just seem to have been kicked back into
life.<br>
<div>-- <br>
--<br>
Regards,<br>
<br>
Hal Ponton<br>
Senior Network Engineer<br>
<br>
Buzcom / FibreWiFi<br>
<br>
<br>
</div>
<br>
<span>
</span><br>
<blockquote style="border:0px none" type="cite">
<div style="margin:30px 25px 10px 25px">
<div style="width:100%;border-top:1px solid #edeef0;padding-top:5px">
<div style="display:inline-block;white-space:nowrap;vertical-align:middle;width:49%">
<a href="javascript:_e(%7B%7D,'cvml','outages@outages.org');" style="color:#737f92!important;padding-right:6px;font-weight:bold;text-decoration:none!important" target="_blank">John Kinsella via
Outages</a></div>
<div style="display:inline-block;white-space:nowrap;vertical-align:middle;width:48%;text-align:right">
<font color="#9FA2A5"><span style="padding-left:6px">22
April 2016 at 18:19</span></font></div>
</div>
</div>
<div style="color:#888888;margin-left:24px;margin-right:24px">
<div>Currently able to connect to
multiple services hosted by AWS
(Slack, iTunes, and my own EC2
instances). <a href="http://status.aws.amazon.com/" target="_blank">http://status.aws.amazon.com/</a>
claims situation normal, so far,
although I can’t get into my AWS
dashboard.<br>
<br>
Might be wider than AWS, but I seem to
have connectivity out to other major
services...<br>
<br>
Packets Pings<br>
Host Loss% Snt Last Avg Best Wrst
StDev<br>
1. 10.0.1.1 0.0% 29 1.0 10.7 0.9 123.2
26.2<br>
2. 10.0.1.49 0.0% 29 1.7 12.1 1.5
101.1 26.7<br>
3. 173.247.205.38 0.0% 29 3.7 24.3 3.5
120.4 36.8<br>
4. x.<a href="http://196.247.173.web-pass.com/" target="_blank">196.247.173.web-pass.com</a>
0.0% 29 3.3 20.3 3.2 127.4 36.9<br>
5. x.<a href="http://196.247.173.web-pass.com/" target="_blank">196.247.173.web-pass.com</a>
0.0% 29 3.9 21.0 3.6 106.7 31.3<br>
6. <a href="http://v505.core1.sfo1.he.net/" target="_blank">v505.core1.sfo1.he.net</a>
0.0% 29 3.9 19.7 3.8 123.5 30.3<br>
7. <a href="http://10ge11-2.core1.sjc2.he.net/" target="_blank">10ge11-2.core1.sjc2.he.net</a>
0.0% 29 14.8 27.7 4.9 165.2 39.3<br>
8. <a href="http://100ge1-2.core1.nyc4.he.net/" target="_blank">100ge1-2.core1.nyc4.he.net</a>
6.9% 29 74.4 112.9 66.5 285.1 71.3<br>
9. <a href="http://100ge11-1.core1.par2.he.net/" target="_blank">100ge11-1.core1.par2.he.net</a>
21.4% 29 296.4 171.1 137.0 296.4 57.3<br>
10. <a href="http://10ge3-2.core1.zrh1.he.net/" target="_blank">10ge3-2.core1.zrh1.he.net</a>
0.0% 28 175.8 173.3 150.4 280.4 34.0<br>
11. ???<br>
12. ???<br>
13. ???<br>
14. ???<br>
15. <a href="http://te2-2.er01.zrh01.ip-max.net/" target="_blank">te2-2.er01.zrh01.ip-max.net</a>
92.6% 28 391.1 318.5 246.0 391.1 102.6<br>
16. <a href="http://xe0-0-3.cr02.gva253.ip-max.net/" target="_blank">xe0-0-3.cr02.gva253.ip-max.net</a>
96.3% 28 331.7 331.7 331.7 331.7 0.0<br>
17. <a href="http://xe0-0-1.cr02.gva252.ip-max.net/" target="_blank">xe0-0-1.cr02.gva252.ip-max.net</a>
96.2% 27 321.6 321.6 321.6 321.6 0.0<br>
18. ???<br>
<br>
<br>
_______________________________________________<br>
Outages mailing list<br>
<a href="javascript:_e(%7B%7D,'cvml','Outages@outages.org');" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</div>
</div>
</blockquote>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Outages mailing list<br>
<a href="javascript:_e(%7B%7D,'cvml','Outages@outages.org');" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Outages mailing list
<a href="javascript:_e(%7B%7D,'cvml','Outages@outages.org');" target="_blank">Outages@outages.org</a>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>
</pre>
</blockquote>
<br>
</div>
_______________________________________________<br>Outages mailing list<br><a href="javascript:_e(%7B%7D,'cvml','Outages@outages.org');" target="_blank">Outages@outages.org</a><br><a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br></div></blockquote></div><br></div></div></blockquote><br><br>-- <br>---<br>Nick Buraglio<br>Energy Sciences Network; AS293<br>Lawrence Berkeley National Laboratory<br><a href="mailto:buraglio@es.net" target="_blank">buraglio@es.net</a><br>+1 (510) 995-6068<br>