<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Appears to be inside of fb’s network – prn1 = Prineville and San Francisco = frc1. Here’s some non-working traces:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 7 sl-st31-chi-bu-20.v6.sprintlink.net (2600:0:2:1239:144:232:1:104) 16.873 ms 16.069 ms 15.925 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 8 2600:4:2000::f (2600:4:2000::f) 15.715 ms 15.688 ms 15.682 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 9 ae1.bb02.ord1.tfbnw.net (2620:0:1cff:dead:beee::452) 16.016 ms 15.897 ms 15.957 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>10 ae12.bb02.atl1.tfbnw.net (2620:0:1cff:dead:beef::1336) 36.603 ms 36.825 ms 36.497 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>11 ae7.bb02.frc1.tfbnw.net (2620:0:1cff:dead:beef::ce) 40.452 ms 40.345 ms 40.291 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>12 ae2.dr03.frc1.tfbnw.net (2620:0:1cff:dead:beef::1d6) 40.156 ms 40.093 ms 40.147 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>13 po1022.csw03c.frc1.tfbnw.net (2620:0:1cff:dead:beef::1631) 40.661 ms 48.299 ms 40.817 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>14 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 7 sl-st31-chi-bu-20.v6.sprintlink.net (2600:0:2:1239:144:232:1:104) 15.932 ms 15.758 ms 15.881 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 8 2600:4:2000::f (2600:4:2000::f) 15.424 ms 15.469 ms 15.494 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 9 ae1.bb01.ord1.tfbnw.net (2620:0:1cff:dead:beee::450) 15.719 ms 15.754 ms 15.674 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>10 ae16.bb05.prn1.tfbnw.net (2620:0:1cff:dead:beee::591) 68.011 ms 67.868 ms 67.854 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>11 ae33.dr06.prn1.tfbnw.net (2620:0:1cff:dead:beee::236) 63.434 ms 63.440 ms 63.383 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>12 po1021.csw08a.prn1.tfbnw.net (2620:0:1cff:dead:beee::14d) 66.504 ms 64.966 ms 64.429 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>13 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 7 sl-st31-chi-bu-20.v6.sprintlink.net (2600:0:2:1239:144:232:1:104) 16.297 ms 16.055 ms 15.914 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 8 2600:4:2000::f (2600:4:2000::f) 15.614 ms 15.596 ms 15.567 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 9 ae1.bb01.ord1.tfbnw.net (2620:0:1cff:dead:beee::450) 15.871 ms 15.798 ms 15.695 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>10 ae22.bb01.prn1.tfbnw.net (2620:0:1cff:dead:beee::593) 68.502 ms 68.354 ms 68.531 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>11 ae0.dr05.prn1.tfbnw.net (2620:0:1cff:dead:beef::33) 63.433 ms 63.487 ms 63.491 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>12 po1021.csw08d.prn1.tfbnw.net (2620:0:1cff:dead:beee::149) 72.100 ms 65.004 ms 63.671 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>13 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>And a working trace that appears to go through Ashburn:<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'># tcptraceroute6 www.facebook.com<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>traceroute to edge-star6-ecmp-02-ash3.facebook.com (2a03:2880:2030:2f01:face:b00c:0:8) from 2607:fe28:0:1000::5, port 80, from port 59526, 30 hops max, 60 bytes packets<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'><snip><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 8 sl-crs2-chi-te1-2-0-1.v6.sprintlink.net (2600:4::6) 16.147 ms 16.101 ms 16.032 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'> 9 sl-st31-chi-bu-20.v6.sprintlink.net (2600:0:2:1239:144:232:1:104) 17.147 ms 16.948 ms 17.116 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>10 2600:4:2000::f (2600:4:2000::f) 16.588 ms 35.301 ms 16.540 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>11 ae1.bb01.ord1.tfbnw.net (2620:0:1cff:dead:beee::450) 59.335 ms 16.766 ms 16.871 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>12 ae27.bb01.iad1.tfbnw.net (2620:0:1cff:dead:beef::13df) 36.157 ms 40.243 ms 35.998 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>13 ae0.dr02.ash3.tfbnw.net (2620:0:1cff:dead:beef::2f1) 35.736 ms 35.771 ms 35.755 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>14 po1020.csw02b.ash3.tfbnw.net (2620:0:1cff:dead:beef::1605) 36.800 ms 40.665 ms 36.404 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>15 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>16 edge-star6-ecmp-02-ash3.facebook.com (2a03:2880:2030:2f01:face:b00c:0:8) 36.043 ms [open] 36.122 ms 36.060 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>#</span><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Frank<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> Frank Bulk [mailto:frnkblk@iname.com] <br><b>Sent:</b> Monday, January 28, 2013 7:33 PM<br><b>To:</b> 'Josh Luthman'; outages@outages.org<br><b>Subject:</b> RE: [outages] Facebook is down<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I monitor a couple of their IPv6 addresses and 2a03:2880:10:8f01:face:b00c:0:25 and 2a03:2880:10:8f02:face:b00c:0:25 had HTTP issues at 5:03 pm Central and also had a blip at 4:04 pm Central, and the hosts 2a03:2880:2110:3f01:face:b00c::, 2a03:2880:10:8f01:face:b00c:0:25, and 2a03:2880:10:8f02:face:b00c:0:25 have been down since about 6:56 pm Central.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>But the AAAA in my local cache for <a href="http://www.facebook.com">www.facebook.com</a> resolves to 2a03:2880:2050:1f01:face:b00c:0:9, and so things work for me. The joys of GLBDNS (or whatever facebook uses).<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Frank<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> <a href="mailto:outages-bounces@outages.org">outages-bounces@outages.org</a> [<a href="mailto:outages-bounces@outages.org">mailto:outages-bounces@outages.org</a>] <b>On Behalf Of </b>Josh Luthman<br><b>Sent:</b> Monday, January 28, 2013 7:14 PM<br><b>To:</b> <a href="mailto:outages@outages.org">outages@outages.org</a><br><b>Subject:</b> [outages] Facebook is down<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal><a href="http://isup.me/facebook.com">http://isup.me/facebook.com</a><o:p></o:p></p><div><p class=MsoNormal><br clear=all><o:p></o:p></p><div><p class=MsoNormal>Josh Luthman<br>Office: 937-552-2340<br>Direct: 937-552-2343<br>1100 Wayne St<br>Suite 1337<br>Troy, OH 45373<o:p></o:p></p></div></div></div></div></body></html>