[outages] Major loss/latency on Twelve99 around NY/SJO

[Phil Lavin]

It’s a good week for the Internet. Third outages list post this week :(

Seeing major loss on Twelve99 around SJO:

UK to AWS USW2:

                                My traceroute  [v0.95]
VONMVPCVXYVFD (172.20.0.14) -> 216.147.3.209 (216.147.3.209) 2024-08-15T09:29:13+0100
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                             Packets               Pings
 Host                                      Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. 172.20.0.1                              0.0%     9    1.1   1.2   1.0   1.7   0.2
 2. lo0-0.bng2.ixn-lon.zen.net.uk           0.0%     9    5.5   6.8   5.4  11.2   1.9
 3. lag-5.p2.ixn-lon.zen.net.uk             0.0%     8    5.5   6.0   5.2   6.5   0.5
 4. ldn-b13-link.ip.twelve99.net           25.0%     8    5.8   5.5   5.0   6.0   0.4
 5. ldn-bb2-link.ip.twelve99.net            0.0%     8    6.6   6.8   5.9   7.5   0.7
 6. nyk-bb1-link.ip.twelve99.net            0.0%     8   75.2  75.2  74.5  75.9   0.5
 7. sjo-b23-link.ip.twelve99.net           57.1%     8  296.2 312.5 296.2 343.7  27.0
 8. (waiting for reply)
 9. 15.230.28.67                           62.5%     8  294.4 295.7 294.4 296.8   1.2
10. 54.240.242.119                         25.0%     8  337.1 305.7 294.6 337.1  16.2
11. (waiting for reply)
12. 52.93.15.36                            57.1%     8  398.2 400.8 395.4 408.8   7.1
13. 52.93.15.31                            42.9%     8  388.7 395.5 388.7 403.3   6.2
14. 52.93.14.34                            28.6%     8  431.8 432.2 393.2 488.2  35.8
15. 52.93.246.177                          42.9%     8  397.7 399.3 397.7 401.1   1.4
16. 52.93.246.81                           25.0%     8  393.4 396.9 393.2 400.6   3.0
17. (waiting for reply)
18. (waiting for reply)19. (waiting for re 28.6%     8  394.3 397.5 394.3 400.2   3.0

AWS USW2 to UK:

 Host                                                       Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. ip-10-96-50-153.us-west-2.compute.internal               0.0%    87    0.2   0.1   0.1   0.2   0.0
 2. ec2-44-233-118-55.us-west-2.compute.amazonaws.com        0.0%    87    7.3  11.9   1.0  66.9  16.4
    ec2-34-221-151-47.us-west-2.compute.amazonaws.com
    ec2-44-233-117-187.us-west-2.compute.amazonaws.com
 3. 240.0.212.4                                              0.0%    87    0.5   0.4   0.3   1.7   0.2
    240.0.72.7
 4. 242.2.110.95                                             0.0%    87    0.8   1.8   0.4  20.6   3.4
 5. 240.2.144.13                                             0.0%    87    5.8   5.8   5.7   5.9   0.1
 6. amazon-ic-375418.ip.twelve99-cust.net                    0.0%    87    5.7   5.6   5.6   6.1   0.1
 7. port-b4-link.ip.twelve99.net                             0.0%    87    6.2   6.1   5.9   6.5   0.1
 8. port-b3-link.ip.twelve99.net                             0.0%    86    5.6   6.3   5.6  18.5   1.8
 9. palo-b24-link.ip.twelve99.net                            0.0%    86   21.4  21.3  21.1  21.6   0.1
10. nyk-bb2-link.ip.twelve99.net                            19.8%    86  165.3 172.2 165.3 206.1   4.7
11. ldn-bb1-link.ip.twelve99.net                            68.2%    86  391.5 401.2 387.3 411.8   6.3
12. ldn-b3-link.ip.twelve99.net                             57.0%    86  397.1 401.4 395.5 409.0   2.7
13. zeninternet-ic-363994.ip.twelve99-cust.net              40.7%    86  397.0 412.3 397.0 473.3  18.0
14. lag-1.bng2.ixn-lon.zen.net.uk                           63.5%    86  387.2 402.5 382.5 422.8   9.0
15. 62-3-100-30.dsl.in-addr.zen.co.uk                       55.8%    86  391.6 404.5 391.6 412.5   6.1
16. (waiting for reply)