<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Initial looks from the firewall team point to an automatic failover event and the secondary failed.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">John W Blue<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Infrastructure Services - AIF-330<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">d: 405-954-4177<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">c: 405-443-8445<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a href="mailto:john.w.blue@faa.gov"><span style="color:#0563C1">john.w.blue@faa.gov</span></a><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> virendra rode <virendra.rode@outages.org>
<br>
<b>Sent:</b> Saturday, March 25, 2023 11:05 PM<br>
<b>To:</b> Chapman, Brad (NBCUniversal) <Brad.Chapman@nbcuni.com>; Michael B. Williams <Michael.Williams@glexia.com><br>
<b>Cc:</b> outages <outages@outages.org>; Blue, John W (FAA) <john.w.blue@faa.gov><br>
<b>Subject:</b> Re: [outages] [EXTERNAL] Re: FAA.gov nameserver outage<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">+I'm adding John Blue (cc'd) to see if he has any insight into this matter.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">/vrode<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Sun, 2023-03-26 at 03:41 +0000, Chapman, Brad (NBCUniversal) wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">This screenshot of the FAA status page says otherwise.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><img border="0" width="800" height="815" style="width:8.3333in;height:8.4895in" id="_x0000_i1025" src="cid:image001.jpg@01D95F72.F20D03F0" alt="image0.jpeg"><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">—Sent from my iPhone<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">On Mar 25, 2023, at 8:29 PM, Michael B. Williams <<a href="mailto:Michael.Williams@glexia.com">Michael.Williams@glexia.com</a>> wrote:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</blockquote>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal"><span style="font-family:"Tahoma",sans-serif"></span><o:p></o:p></p>
<div>
<p class="MsoNormal">All -<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I finally got a hold of someone at FAA and they said they aren’t seeing any issues.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I tried to explain but didn’t get anywhere.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Michael <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Sun, Mar 26, 2023 at 14:21 virendra rode <<a href="mailto:virendra.rode@outages.org">virendra.rode@outages.org</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">On Sat, 2023-03-25 at 20:06 -0700, virendra rode via Outages wrote:<o:p></o:p></p>
</div>
</div>
<div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">On Sun, 2023-03-26 at 02:00 +0000, Chapman, Brad (NBCUniversal) via Outages wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">I don't know how one would contact them, but the list of the senior IT officers are on their memorandum to migrate to IPv6 dated September 2021. This memo states they would be migrating in 2023. Perhaps we're seeing evidence of a recent
change?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/www.faa.gov/sites/faa.gov/files/about/office_org/headquarters_offices/afn/transition-ipv6.pdf__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWPAxlYWQ$" target="_blank">https://www.faa.gov/sites/faa.gov/files/about/office_org/headquarters_offices/afn/transition-ipv6.pdf</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">—Sent from my iPhone<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">On Mar 25, 2023, at 6:53 PM, Michael B. Williams via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</blockquote>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal"><span style="font-family:"Tahoma",sans-serif"></span>Seeing the same here across all our POPs.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Has anyone notified FAA NOC yet?<o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
</blockquote>
<div>
<p class="MsoNormal">---------------<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I did notice ipv6 path traversal...but now its totally dead<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">/vrode<o:p></o:p></p>
</div>
</blockquote>
</div>
<div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">_______________________________________________<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Outages mailing list<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><o:p></o:p></p>
</div>
</blockquote>
<div>
<p class="MsoNormal">-------------------<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">More proof, just so I'm not blowing smoke,<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">traceroute to <a href="https://urldefense.com/v3/__https:/www.faa.gov__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWTxg6fRg$" target="_blank">
www.faa.gov</a> (2600:1406:6c00:192::1256), 30 hops max, 80 byte packets<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">1 <a href="https://urldefense.com/v3/__http:/2603-8001-3b00-2dc7-0000-0000-0000-0001.res6.spectrum.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhVNye0yxA$" target="_blank">
2603-8001-3b00-2dc7-0000-0000-0000-0001.res6.spectrum.com</a> (2603:8001:3b00:2dc7::1) 15.618 ms 15.521 ms 15.473 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">2 <a href="https://urldefense.com/v3/__http:/2603-90c5-0001-0927-0000-0000-0000-0001.inf6.spectrum.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhVOufjceA$" target="_blank">
2603-90c5-0001-0927-0000-0000-0000-0001.inf6.spectrum.com</a> (2603:90c5:1:927::1) 31.726 ms 19.029 ms 20.498 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">3 <a href="https://urldefense.com/v3/__http:/lag-61.snaucaoszh1.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhXcPtSajw$" target="_blank">
lag-61.snaucaoszh1.netops.charter.com</a> (2605:e000:0:4::7:37d) 21.835 ms 31.496 ms 31.462 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">4 <a href="https://urldefense.com/v3/__http:/lag-22.cyprcabw02r.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhUfU3ZmIQ$" target="_blank">
lag-22.cyprcabw02r.netops.charter.com</a> (2605:e000:0:8::6:e) 31.500 ms 31.464 ms 38.891 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">5 * * *<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">6 * * *<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">7 <a href="https://urldefense.com/v3/__http:/lag-1.pr2.lax10.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhUMcgbOHg$" target="_blank">
lag-1.pr2.lax10.netops.charter.com</a> (2001:1998:0:4::559) 25.888 ms 24.790 ms <a href="https://urldefense.com/v3/__http:/lag-2.pr2.lax10.netops.charter.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhWIIaxxoQ$" target="_blank">
lag-2.pr2.lax10.netops.charter.com</a> (2001:1998:56::27) 32.321 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">8 2001:1998:0:8::667 (2001:1998:0:8::667) 24.557 ms 32.133 ms 32.091 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">9 * * <a href="https://urldefense.com/v3/__http:/ae2.ctl-lax8.netarch.akamai.com__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhW5tAaIhg$" target="_blank">
ae2.ctl-lax8.netarch.akamai.com</a> (2600:1488:a080:114::b) 49.474 ms<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">/vrode<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/puck.nether.net/mailman/listinfo/outages__;!!PIZeeW5wscynRQ!qznGJHQ7J3qeiuEgKIkWMakaGx4TN4Cq8BxLL-K0TVQAYbHmNgMKD1DffUYQu7QG6zFyNhv4Fob9UnWNVe0_RhXeGYiCdw$" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><o:p></o:p></p>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>