<!DOCTYPE html><html><head><title></title><style type="text/css">p.MsoNormal,p.MsoNoSpacing{margin:0}</style></head><body><div>Dunno about the US, but in Europe it's pretty easy to get basic POTS, or some type of DSL in your cabinet.<br></div><div><br></div><div>Never had an issue with it, no matter if it was Equinix, Digital Realty or one of the smaller datacentre companies in Europe.<br></div><div><br></div><div>Kind regards,<br></div><div><br></div><div>Tom</div><div><br></div><div>On Tue, 5 Oct 2021, at 22:08, Bryan Holloway wrote:<br></div><blockquote type="cite" id="qt" style=""><div>These days it's next to impossible to get a POTS line run to a cabinet <br></div><div>in a major datacenter.<br></div><div><br></div><div>On the other hand, FB runs their own, so I suppose anything's possible <br></div><div>when you have more money than god.<br></div><div><br></div><div><br></div><div>On 10/5/21 9:38 PM, Anthony Hoppe wrote:<br></div><div>> If that's the case, it's a bit of an oversight. If you're depending on DNS for OOB access, you'd want OOB DNS servers available too, heh...<br></div><div>> <br></div><div>> Maybe they can go back to the golden days of sticking a modem & POTS line on the console port of their routers/switches. Or get super fancy and deploy terminal servers at each datacenter to conserve on phone lines :-D.<br></div><div>> <br></div><div>> <br></div><div>> <br></div><div>> ----- Original Message -----<br></div><div>> From: "George Metz" <<a href="mailto:george.metz@gmail.com">george.metz@gmail.com</a>><br></div><div>> To: "Ross Tajvar" <<a href="mailto:ross@tajvar.io">ross@tajvar.io</a>><br></div><div>> Cc: "Outages List" <<a href="mailto:outages-discussion@outages.org">outages-discussion@outages.org</a>><br></div><div>> Sent: Tuesday, October 5, 2021 12:12:23 PM<br></div><div>> Subject: Re: [Outages-discussion] FB Outage AAR I - Engineering Posts Pabulum<br></div><div>> <br></div><div>> If I had to guess (because I was wondering about that too), it was<br></div><div>> because they didn't have the IPs of their out-of-band stuff available<br></div><div>> and were expecting their DNS to be able to answer... and the DNS<br></div><div>> servers functionally shut themselves off.<br></div><div>> <br></div><div>> On Tue, Oct 5, 2021 at 2:14 PM Ross Tajvar <<a href="mailto:ross@tajvar.io">ross@tajvar.io</a>> wrote:<br></div><div>>><br></div><div>>> "Our primary and out-of-band network access was down"<br></div><div>>><br></div><div>>> Sounds like someone doesn't know what "out-of-band" means.<br></div><div>>><br></div><div>>> On Tue, Oct 5, 2021, 2:04 PM Jay R. Ashworth <<a href="mailto:jra@baylink.com">jra@baylink.com</a>> wrote:<br></div><div>>>><br></div><div>>>> This doesn't say anything we don't already know, except where it conflicts<br></div><div>>>> with things we already know. But it's fun to watch, ain't it? ;-)<br></div><div>>>><br></div><div>>>> <a href="https://engineering.fb.com/2021/10/05/networking-traffic/outage-details/">https://engineering.fb.com/2021/10/05/networking-traffic/outage-details/</a><br></div><div>>>><br></div><div>>>> Cheers,<br></div><div>>>> -- jra<br></div><div>>>><br></div><div>>>> --<br></div><div>>>> Jay R. Ashworth Baylink <a href="mailto:jra@baylink.com">jra@baylink.com</a><br></div><div>>>> Designer The Things I Think RFC 2100<br></div><div>>>> Ashworth & Associates <a href="http://www.bcp38.info">http://www.bcp38.info</a> 2000 Land Rover DII<br></div><div>>>> St Petersburg FL USA BCP38: Ask For It By Name! +1 727 647 1274<br></div><div>>>> _______________________________________________<br></div><div>>>> Outages-discussion mailing list<br></div><div>>>> <a href="mailto:Outages-discussion@outages.org">Outages-discussion@outages.org</a><br></div><div>>>> <a href="https://puck.nether.net/mailman/listinfo/outages-discussion">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br></div><div>>><br></div><div>>> _______________________________________________<br></div><div>>> Outages-discussion mailing list<br></div><div>>> <a href="mailto:Outages-discussion@outages.org">Outages-discussion@outages.org</a><br></div><div>>> <a href="https://puck.nether.net/mailman/listinfo/outages-discussion">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br></div><div>> _______________________________________________<br></div><div>> Outages-discussion mailing list<br></div><div>> <a href="mailto:Outages-discussion@outages.org">Outages-discussion@outages.org</a><br></div><div>> <a href="https://puck.nether.net/mailman/listinfo/outages-discussion">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br></div><div>> _______________________________________________<br></div><div>> Outages-discussion mailing list<br></div><div>> <a href="mailto:Outages-discussion@outages.org">Outages-discussion@outages.org</a><br></div><div>> <a href="https://puck.nether.net/mailman/listinfo/outages-discussion">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br></div><div>> <br></div><div>_______________________________________________<br></div><div>Outages-discussion mailing list<br></div><div><a href="mailto:Outages-discussion@outages.org">Outages-discussion@outages.org</a><br></div><div><a href="https://puck.nether.net/mailman/listinfo/outages-discussion">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br></div><div><br></div></blockquote><div><br></div></body></html>