<html><head>
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="blue" vlink="purple"><div></div><div><div>Thanks, John; we appreciate the transparency.</div></div><div><br></div><div>/vrode</div><div><br></div><div>On Sun, 2023-03-26 at 04:38 +0000, Blue, John W (FAA) wrote:</div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div class="WordSection1"><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Initial looks from the firewall team point to an automatic failover event and the secondary failed.<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">John W Blue<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Infrastructure Services - AIF-330<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">d: 405-954-4177<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">c: 405-443-8445<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a href="mailto:john.w.blue@faa.gov"><span style="color:#0563C1">john.w.blue@faa.gov</span></a><o:p></o:p></span></p></div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p><div><div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> virendra rode <virendra.rode@outages.org><br><b>Sent:</b> Saturday, March 25, 2023 11:05 PM<br><b>To:</b> Chapman, Brad (NBCUniversal) <Brad.Chapman@nbcuni.com>; Michael B. Williams <Michael.Williams@glexia.com><br><b>Cc:</b> outages <outages@outages.org>; Blue, John W (FAA) <john.w.blue@faa.gov><br><b>Subject:</b> Re: [outages] [EXTERNAL] Re: FAA.gov nameserver outage<o:p></o:p></span></p></div></div><p class="MsoNormal"><o:p> </o:p></p><div><p class="MsoNormal">+I'm adding John Blue (cc'd) to see if he has any insight into this matter.<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">/vrode<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">On Sun, 2023-03-26 at 03:41 +0000, Chapman, Brad (NBCUniversal) wrote:<o:p></o:p></p></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">This screenshot of the FAA status page says otherwise.<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><img border="0" width="800" height="815" style="width:8.3333in;height:8.4895in" id="_x0000_i1025" src="cid:image001.jpg@01D95F72.F20D03F0" alt="image0.jpeg"><o:p></o:p></p><div><div><p class="MsoNormal"><o:p> </o:p></p><div><p class="MsoNormal">—Sent from my iPhone<o:p></o:p></p></div><div><p class="MsoNormal"><br><br><o:p></o:p></p><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">On Mar 25, 2023, at 8:29 PM, Michael B. Williams <<a href="mailto:Michael.Williams@glexia.com">Michael.Williams@glexia.com</a>> wrote:<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div></blockquote></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal"><span style="font-family:"Tahoma",sans-serif"></span><o:p></o:p></p><div><p class="MsoNormal">All -<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">I finally got a hold of someone at FAA and they said they aren’t seeing any issues.<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">I tried to explain but didn’t get anywhere.<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">Michael <o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p><div><div><p class="MsoNormal">On Sun, Mar 26, 2023 at 14:21 virendra rode <<a href="mailto:virendra.rode@outages.org">virendra.rode@outages.org</a>> wrote:<o:p></o:p></p></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal"><o:p> </o:p></p></div><div><div><p class="MsoNormal">On Sat, 2023-03-25 at 20:06 -0700, virendra rode via Outages wrote:<o:p></o:p></p></div></div><div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">On Sun, 2023-03-26 at 02:00 +0000, Chapman, Brad (NBCUniversal) via Outages wrote:<o:p></o:p></p></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">I don't know how one would contact them, but the list of the senior IT officers are on their memorandum to migrate to IPv6 dated September 2021. This memo states they would be migrating in 2023. Perhaps we're seeing evidence of a recent change?<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/www.faa.gov/sites/faa.gov/files/about/office_org/headquarters_offices/afn/transition-ipv6.pdf__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWPAxlYWQ$" target="_blank">https://www.faa.gov/sites/faa.gov/files/about/office_org/headquarters_offices/afn/transition-ipv6.pdf</a><o:p></o:p></p></div><div><p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p><div><p class="MsoNormal">—Sent from my iPhone<o:p></o:p></p></div><div><p class="MsoNormal"><br><br><o:p></o:p></p><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">On Mar 25, 2023, at 6:53 PM, Michael B. Williams via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div></blockquote></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal"><span style="font-family:"Tahoma",sans-serif"></span>Seeing the same here across all our POPs.<o:p></o:p></p><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">Has anyone notified FAA NOC yet?<o:p></o:p></p></div></div></blockquote></div></blockquote><div><p class="MsoNormal">---------------<o:p></o:p></p></div><div><p class="MsoNormal">I did notice ipv6 path traversal...but now its totally dead<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">/vrode<o:p></o:p></p></div></blockquote></div><div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal">_______________________________________________<o:p></o:p></p></div><div><p class="MsoNormal">Outages mailing list<o:p></o:p></p></div><div><p class="MsoNormal"><a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><o:p></o:p></p></div></blockquote><div><p class="MsoNormal">-------------------<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><div><p class="MsoNormal">More proof, just so I'm not blowing smoke,<o:p></o:p></p></div></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">traceroute to <a href="https://urldefense.com/v3/__https:/www.faa.gov__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWTxg6fRg$" target="_blank">www.faa.gov</a> (2600:1406:6c00:192::1256), 30 hops max, 80 byte packets<o:p></o:p></p></div><div><p class="MsoNormal">1 <a href="https://urldefense.com/v3/__http:/2603-8001-3b00-2dc7-0000-0000-0000-0001.res6.spectrum.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhVNye0yxA$" target="_blank">2603-8001-3b00-2dc7-0000-0000-0000-0001.res6.spectrum.com</a> (2603:8001:3b00:2dc7::1) 15.618 ms 15.521 ms 15.473 ms<o:p></o:p></p></div><div><p class="MsoNormal">2 <a href="https://urldefense.com/v3/__http:/2603-90c5-0001-0927-0000-0000-0000-0001.inf6.spectrum.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhVOufjceA$" target="_blank">2603-90c5-0001-0927-0000-0000-0000-0001.inf6.spectrum.com</a> (2603:90c5:1:927::1) 31.726 ms 19.029 ms 20.498 ms<o:p></o:p></p></div><div><p class="MsoNormal">3 <a href="https://urldefense.com/v3/__http:/lag-61.snaucaoszh1.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhXcPtSajw$" target="_blank">lag-61.snaucaoszh1.netops.charter.com</a> (2605:e000:0:4::7:37d) 21.835 ms 31.496 ms 31.462 ms<o:p></o:p></p></div><div><p class="MsoNormal">4 <a href="https://urldefense.com/v3/__http:/lag-22.cyprcabw02r.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhUfU3ZmIQ$" target="_blank">lag-22.cyprcabw02r.netops.charter.com</a> (2605:e000:0:8::6:e) 31.500 ms 31.464 ms 38.891 ms<o:p></o:p></p></div><div><p class="MsoNormal">5 * * *<o:p></o:p></p></div><div><p class="MsoNormal">6 * * *<o:p></o:p></p></div><div><p class="MsoNormal">7 <a href="https://urldefense.com/v3/__http:/lag-1.pr2.lax10.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhUMcgbOHg$" target="_blank">lag-1.pr2.lax10.netops.charter.com</a> (2001:1998:0:4::559) 25.888 ms 24.790 ms <a href="https://urldefense.com/v3/__http:/lag-2.pr2.lax10.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWIIaxxoQ$" target="_blank">lag-2.pr2.lax10.netops.charter.com</a> (2001:1998:56::27) 32.321 ms<o:p></o:p></p></div><div><p class="MsoNormal">8 2001:1998:0:8::667 (2001:1998:0:8::667) 24.557 ms 32.133 ms 32.091 ms<o:p></o:p></p></div><div><p class="MsoNormal">9 * * <a href="https://urldefense.com/v3/__http:/ae2.ctl-lax8.netarch.akamai.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhW5tAaIhg$" target="_blank">ae2.ctl-lax8.netarch.akamai.com</a> (2600:1488:a080:114::b) 49.474 ms<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal">/vrode<o:p></o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><div><p class="MsoNormal"><o:p> </o:p></p></div><blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div><p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/puck.nether.net/mailman/listinfo/outages__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhXeGYiCdw$" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><o:p></o:p></p></div></blockquote><div><p class="MsoNormal"><o:p> </o:p></p></div></div><p class="MsoNormal"><o:p> </o:p></p></blockquote></div></div></div></blockquote></div></div></div></blockquote><div><p class="MsoNormal"><o:p> </o:p></p></div></div></blockquote><div><br></div><div><span></span></div></body></html>