[outages] DC Region Verizon FiOS Outage Event 29-April 18:30

[Cary Wiedemann]

There was just a massive DC region Verizon FiOS backbone routing failure
starting at 6:27pm EST and running for ~11 minutes.  All paths were
impacted but some were more loss prone than others.

Here's a loss/latency graph to Google's local anycasted 8.8.8.8 resolver:

[image: image.png]

vs a graph to Cogent:
[image: image.png]

vs one to Azure:
[image: image.png]

MTR graphs show major loss down every path that touches one of Verizon's "
ALTER.NET" named routers.

Really just sending this one in because the footprint was massive.  I'm
used to smaller DC-region path failures, but this impacted nearly every
path for nearly every FiOS user in DC and the close-in Virginia and
Maryland suburbs. This was far worse than their usual routing hiccups.

- Cary
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20220429/0dbf5029/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 43461 bytes
Desc: not available
URL: <https://puck.nether.net/pipermail/outages/attachments/20220429/0dbf5029/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 42918 bytes
Desc: not available
URL: <https://puck.nether.net/pipermail/outages/attachments/20220429/0dbf5029/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 45312 bytes
Desc: not available
URL: <https://puck.nether.net/pipermail/outages/attachments/20220429/0dbf5029/attachment-0005.png>