<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">See traffic on Twelve99 re-routed via LAX now. Seems to be stable, for the moment:<div><br></div><div><div> My traceroute [v0.95]</div><div>VONMVPCVXYVFD (172.20.0.219) -> 216.147.3.209 (216.147.3.209) 2024-08-15T11:29:35+0100</div><div>Keys: Help Display mode Restart statistics Order of fields quit</div><div> Packets Pings</div><div> Host Loss% Snt Last Avg Best Wrst StDev</div><div> 1. 172.20.0.1 0.0% 68 0.7 1.0 0.7 1.9 0.2</div><div> 2. lo0-0.bng2.ixn-lon.zen.net.uk 0.0% 67 12.3 8.4 5.1 43.1 6.1</div><div> 3. lag-5.p2.ixn-lon.zen.net.uk 0.0% 67 5.6 5.9 5.4 7.8 0.4</div><div> 4. ldn-b13-link.ip.twelve99.net 45.5% 67 5.6 5.5 4.9 6.1 0.3</div><div> 5. ldn-bb2-link.ip.twelve99.net 0.0% 67 6.1 6.3 5.4 8.9 0.6</div><div> 6. nyk-bb1-link.ip.twelve99.net 0.0% 67 74.7 75.0 74.1 77.0 0.5</div><div> 7. rest-bb1-link.ip.twelve99.net 1.5% 67 81.5 81.5 80.8 83.9 0.5</div><div> 8. lax-b22-link.ip.twelve99.net 0.0% 67 137.5 138.4 136.7 175.7 5.4</div><div> 9. (waiting for reply)</div><div>10. (waiting for reply)</div><div>11. 15.230.16.155 0.0% 67 141.6 143.9 140.3 167.9 5.4</div><div>12. (waiting for reply)</div><div>13. 52.93.14.118 0.0% 67 216.6 178.8 165.8 267.3 20.9</div><div>14. 52.93.14.105 0.0% 67 171.5 171.4 170.2 175.7 1.0</div><div>15. 52.93.15.28 0.0% 67 169.2 179.0 169.0 238.9 15.5</div><div>16. 52.93.246.191 0.0% 67 166.1 167.8 165.3 194.0 4.4</div><div>17. 52.93.246.81 0.0% 67 172.3 172.4 171.3 179.7 1.4</div><div>18. (waiting for reply)</div><div>19. (waiting for reply)</div><div>20. (waiting for reply)</div><div>21. (waiting for reply)</div><div>22. (waiting for reply)</div><div>23. (waiting for reply)</div><div>24. 216.147.3.209 0.0% 67 166.4 167.1 166.0 169.1 0.6</div><div><br></div><div><br><blockquote type="cite"><div>On 15 Aug 2024, at 11:09, Phil Lavin <phil.lavin@vonage.com> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">Fwiw, still ongoing<div><br></div><div>I raised an AWS ticket and they’re looking into it. If there’s any friendly AWS Net Engineers on list, your help removing Twelve99 from route would be appreciated. Cross-posting to Nanog for wider reach.</div><div><br id="lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On 15 Aug 2024, at 09:44, Matt Almgren <malmgren@backblaze.com> wrote:</div><br class="Apple-interchange-newline"><div><div dir="auto">There's a planned SJC maintenance happening now. Expected end time is 2am PST. </div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Aug 15, 2024, 1:38 AM Phil Lavin via Outages <<a href="mailto:outages@outages.org">outages@outages.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">It’s a good week for the Internet. Third outages list post this week :(<br>
<br>
Seeing major loss on Twelve99 around SJO:<br>
<br>
UK to AWS USW2:<br>
<br>
My traceroute [v0.95]<br>
VONMVPCVXYVFD (172.20.0.14) -> 216.147.3.209 (216.147.3.209) 2024-08-15T09:29:13+0100<br>
Keys: Help Display mode Restart statistics Order of fields quit<br>
Packets Pings<br>
Host Loss% Snt Last Avg Best Wrst StDev<br>
1. 172.20.0.1 0.0% 9 1.1 1.2 1.0 1.7 0.2<br>
2. <a href="http://lo0-0.bng2.ixn-lon.zen.net.uk/" rel="noreferrer noreferrer" target="_blank">lo0-0.bng2.ixn-lon.zen.net.uk</a> 0.0% 9 5.5 6.8 5.4 11.2 1.9<br>
3. <a href="http://lag-5.p2.ixn-lon.zen.net.uk/" rel="noreferrer noreferrer" target="_blank">lag-5.p2.ixn-lon.zen.net.uk</a> 0.0% 8 5.5 6.0 5.2 6.5 0.5<br>
4. <a href="http://ldn-b13-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">ldn-b13-link.ip.twelve99.net</a> 25.0% 8 5.8 5.5 5.0 6.0 0.4<br>
5. <a href="http://ldn-bb2-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">ldn-bb2-link.ip.twelve99.net</a> 0.0% 8 6.6 6.8 5.9 7.5 0.7<br>
6. <a href="http://nyk-bb1-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">nyk-bb1-link.ip.twelve99.net</a> 0.0% 8 75.2 75.2 74.5 75.9 0.5<br>
7. <a href="http://sjo-b23-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">sjo-b23-link.ip.twelve99.net</a> 57.1% 8 296.2 312.5 296.2 343.7 27.0<br>
8. (waiting for reply)<br>
9. 15.230.28.67 62.5% 8 294.4 295.7 294.4 296.8 1.2<br>
10. 54.240.242.119 25.0% 8 337.1 305.7 294.6 337.1 16.2<br>
11. (waiting for reply)<br>
12. 52.93.15.36 57.1% 8 398.2 400.8 395.4 408.8 7.1<br>
13. 52.93.15.31 42.9% 8 388.7 395.5 388.7 403.3 6.2<br>
14. 52.93.14.34 28.6% 8 431.8 432.2 393.2 488.2 35.8<br>
15. 52.93.246.177 42.9% 8 397.7 399.3 397.7 401.1 1.4<br>
16. 52.93.246.81 25.0% 8 393.4 396.9 393.2 400.6 3.0<br>
17. (waiting for reply)<br>
18. (waiting for reply)19. (waiting for re 28.6% 8 394.3 397.5 394.3 400.2 3.0<br>
<br>
AWS USW2 to UK:<br>
<br>
Host Loss% Snt Last Avg Best Wrst StDev<br>
1. ip-10-96-50-153.us-west-2.compute.internal 0.0% 87 0.2 0.1 0.1 0.2 0.0<br>
2. <a href="http://ec2-44-233-118-55.us-west-2.compute.amazonaws.com/" rel="noreferrer noreferrer" target="_blank">ec2-44-233-118-55.us-west-2.compute.amazonaws.com</a> 0.0% 87 7.3 11.9 1.0 66.9 16.4<br>
<a href="http://ec2-34-221-151-47.us-west-2.compute.amazonaws.com/" rel="noreferrer noreferrer" target="_blank">ec2-34-221-151-47.us-west-2.compute.amazonaws.com</a><br>
<a href="http://ec2-44-233-117-187.us-west-2.compute.amazonaws.com/" rel="noreferrer noreferrer" target="_blank">ec2-44-233-117-187.us-west-2.compute.amazonaws.com</a><br>
3. 240.0.212.4 0.0% 87 0.5 0.4 0.3 1.7 0.2<br>
240.0.72.7<br>
4. 242.2.110.95 0.0% 87 0.8 1.8 0.4 20.6 3.4<br>
5. 240.2.144.13 0.0% 87 5.8 5.8 5.7 5.9 0.1<br>
6. <a href="http://amazon-ic-375418.ip.twelve99-cust.net/" rel="noreferrer noreferrer" target="_blank">amazon-ic-375418.ip.twelve99-cust.net</a> 0.0% 87 5.7 5.6 5.6 6.1 0.1<br>
7. <a href="http://port-b4-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">port-b4-link.ip.twelve99.net</a> 0.0% 87 6.2 6.1 5.9 6.5 0.1<br>
8. <a href="http://port-b3-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">port-b3-link.ip.twelve99.net</a> 0.0% 86 5.6 6.3 5.6 18.5 1.8<br>
9. <a href="http://palo-b24-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">palo-b24-link.ip.twelve99.net</a> 0.0% 86 21.4 21.3 21.1 21.6 0.1<br>
10. <a href="http://nyk-bb2-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">nyk-bb2-link.ip.twelve99.net</a> 19.8% 86 165.3 172.2 165.3 206.1 4.7<br>
11. <a href="http://ldn-bb1-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">ldn-bb1-link.ip.twelve99.net</a> 68.2% 86 391.5 401.2 387.3 411.8 6.3<br>
12. <a href="http://ldn-b3-link.ip.twelve99.net/" rel="noreferrer noreferrer" target="_blank">ldn-b3-link.ip.twelve99.net</a> 57.0% 86 397.1 401.4 395.5 409.0 2.7<br>
13. <a href="http://zeninternet-ic-363994.ip.twelve99-cust.net/" rel="noreferrer noreferrer" target="_blank">zeninternet-ic-363994.ip.twelve99-cust.net</a> 40.7% 86 397.0 412.3 397.0 473.3 18.0<br>
14. <a href="http://lag-1.bng2.ixn-lon.zen.net.uk/" rel="noreferrer noreferrer" target="_blank">lag-1.bng2.ixn-lon.zen.net.uk</a> 63.5% 86 387.2 402.5 382.5 422.8 9.0<br>
15. <a href="http://62-3-100-30.dsl.in-addr.zen.co.uk/" rel="noreferrer noreferrer" target="_blank">62-3-100-30.dsl.in-addr.zen.co.uk</a> 55.8% 86 391.6 404.5 391.6 412.5 6.1<br>
16. (waiting for reply)<br>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank" rel="noreferrer">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</blockquote></div>
<br>
<span style="white-space:pre-wrap"><font size="2" color="#808080">This email, including its contents and any attachment(s), may contain confidential and/or proprietary information and is solely for the review and use of the intended recipient(s). If you have received this email in error, please notify the sender and permanently delete this email, its content, and any attachment(s). Any disclosure, copying, or taking of any action in reliance on an email received in error is strictly prohibited.</font></span><br></div></blockquote></div><br></div></div></div></blockquote></div><br></div></body></html>