<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.statusgood
{mso-style-name:statusgood;}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Tahoma","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Tahoma","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'>I should have noted that my times were Central, so the same time as the other two reports.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'>Frank<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> outages-bounces@outages.org [mailto:outages-bounces@outages.org] <b>On Behalf Of </b>Frank Bulk<br><b>Sent:</b> Wednesday, October 26, 2011 8:25 AM<br><b>To:</b> 'Jason J. W. Williams'; outages@outages.org<br><b>Subject:</b> Re: [outages] Qwest Re-Convergence<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'>I also received an alert at 5:07 which cleared at 5:11 am about access to the v6 sites of <a href="http://www.qwest.com">www.qwest.com</a> and <a href="http://www.informationweek.com">www.informationweek.com</a><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'># traceroute6 <a href="http://www.qwest.com">www.qwest.com</a><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>traceroute to <a href="http://www.qwest.com">www.qwest.com</a> (2001:428:b21:1::20), 30 hops max, 80 byte packets<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>1 2607:fe28:0:1003::2 (2607:fe28:0:1003::2) 3.937 ms 4.363 ms 5.375 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>2 router-core.mtcnet.net (2607:fe28:0:1000::1) 6.884 ms 7.300 ms 8.069 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>3 sxct.movl.mtcnet.net (2607:fe28:11:1002::194) 8.708 ms 8.953 ms 9.779 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>4 v6-siouxcenter.movl.153.netins.net (2001:5f8:7f06::9) 12.212 ms 12.452 ms 12.825 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>5 v6-ins-kb1-te-13-2-220.kmrr.netins.net (2001:5f8:2:2::1) 18.798 ms 19.071 ms 19.416 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>6 v6-ins-kc2-te-8-3.kmrr.netins.net (2001:5f8::11:1) 19.755 ms 15.928 ms 16.124 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>7 v6-ins-dc1-et-8-1.desm.netins.net (2001:5f8::8:1) 17.461 ms 16.944 ms 16.998 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>8 2001:428:3801:210:0:1:0:1 (2001:428:3801:210:0:1:0:1) 29.131 ms 28.281 ms 28.456 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>9 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>10 2001:428:b21:fc03::2 (2001:428:b21:fc03::2) 43.020 ms 43.045 ms 43.362 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>11 * * *<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>12 2001:428:b21:1::20 (2001:428:b21:1::20) 44.318 ms 44.506 ms 44.730 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'># traceroute6 <a href="http://www.informationweek.com">www.informationweek.com</a><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>traceroute to <a href="http://www.informationweek.com">www.informationweek.com</a> (2001:428:1002:10:0:3:0:150), 30 hops max, 80 byte packets<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>1 2607:fe28:0:1003::2 (2607:fe28:0:1003::2) 3.949 ms 4.387 ms 5.835 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>2 router-core.mtcnet.net (2607:fe28:0:1000::1) 6.162 ms 7.018 ms 7.658 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>3 sxct.sxcy.mtcnet.net (2607:fe28:11:1002::197) 7.974 ms 8.798 ms 9.563 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>4 v6-siouxcenter.sxcy.137.netins.net (2001:5f8:7f06::5) 11.640 ms 11.949 ms 12.261 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>5 v6-ins-db1-te-13-2-219.desm.netins.net (2001:5f8:1:1::1) 16.679 ms 16.882 ms 17.242 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>6 v6-ins-dc1-et-8-2.desm.netins.net (2001:5f8::1:1) 19.425 ms 15.611 ms 15.720 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>7 2001:428:3801:210:0:1:0:1 (2001:428:3801:210:0:1:0:1) 27.257 ms 27.094 ms 26.704 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>8 2001:428::205:171:203:118 (2001:428::205:171:203:118) 73.502 ms 73.745 ms 73.336 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>9 2001:428:1002:10:0:3:0:150 (2001:428:1002:10:0:3:0:150) 74.478 ms 69.405 ms 71.713 ms<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:Consolas'>nagios:/home/fbulk#<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'>Frank<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> outages-bounces@outages.org [mailto:outages-bounces@outages.org] <b>On Behalf Of </b>Jason J. W. Williams<br><b>Sent:</b> Wednesday, October 26, 2011 5:31 AM<br><b>To:</b> outages@outages.org<br><b>Subject:</b> [outages] Qwest Re-Convergence<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Has anyone noticed issues reaching Qwest destinations around 4:05a-4:07a Mountain Time today? We received alerts that two of our sites that happened to have Qwest connectivity in common were unavailable during that period. Both sites being monitored were in different facilities but both in Boise.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>-J<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Traceroute #1<o:p></o:p></span></p></div><div><pre style='line-height:18.0pt;background:white;orphans: 2;widows: 2;-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:0px'><span class=statusgood><span style='font-size:9.5pt;color:#00CC00'> 1 ip-67-205-112-66.static.privatedns.com (67.205.112.66) 0.842 ms 0.908 ms 0.936 ms</span></span><span style='font-size:9.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:9.5pt;color:#00CC00'> 2 te8-4.v0707.cl-core04.mtl.iweb.com (67.205.127.121) 1.047 ms 1.068 ms 1.089 ms</span></span><span style='font-size:9.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:9.5pt;color:#00CC00'> 3 if-9-1.icore1.MTT-Montreal.as6453.net (206.82.135.29) 7.737 ms 7.813 ms 7.837 ms 4 if-10-0-0-19.mcore3.MTT-Montreal.as6453.net (216.6.114.13) 0.907 ms 0.935 ms 0.955 ms</span></span><span style='font-size:9.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:9.5pt;color:#00CC00'> 5 if-9-0-0-0.tcore2.NYY-NewYork.as6453.net (216.6.99.9) 7.871 ms 7.904 ms 7.926 ms 6 if-11-2.tcore1.NYY-NewYork.as6453.net (216.6.99.2) 7.815 ms 8.013 ms 8.032 ms</span></span><span style='font-size:9.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:9.5pt;color:#00CC00'> 7 jfk-brdr-04.inet.qwest.net (63.146.27.41) 7.942 ms 7.827 ms 7.790 ms</span></span><span style='font-size:9.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white;orphans: 2;widows: 2;-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:0px'><span class=apple-style-span><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Traceroute #2</span></span><span style='font-size:8.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white;orphans: 2;widows: 2;-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:0px'><span class=statusgood><span style='font-size:8.5pt;color:#00CC00'> 1 207.97.207.194 (207.97.207.194) 0.549 ms 0.578 ms 0.620 ms</span></span><span style='font-size:8.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:8.5pt;color:#00CC00'> 2 core1-5.iad1.rackspace.com (69.20.2.18) 0.303 ms 0.354 ms 0.400 ms</span></span><span style='font-size:8.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:8.5pt;color:#00CC00'> 3 vlan901.edge3.iad1.rackspace.com (69.20.1.3) 196.221 ms 196.284 ms 196.328 ms</span></span><span style='font-size:8.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white'><span class=statusgood><span style='font-size:8.5pt;color:#00CC00'> 4 dcx2-edge-01.inet.qwest.net (67.133.246.157) 0.368 ms 0.355 ms 0.349 ms</span></span><span style='font-size:8.5pt;color:#333333'><o:p></o:p></span></pre><pre style='line-height:18.0pt;background:white;orphans: 2;widows: 2;-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:0px'><span style='font-size:9.5pt;color:#333333'><o:p> </o:p></span></pre></div><div><div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>-------------------<o:p></o:p></span></p></div></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>Jason J. W. Williams<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>COO/CTO, DigiTar<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><a href="mailto:williamsjj@digitar.com">williamsjj@digitar.com</a><o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>V: 208.343.8520<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>M: 208.863.0727<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>F: 208.322.8522<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.5pt;font-family:"Calibri","sans-serif";color:black'>IM: <a href="mailto:williamsjj@digitar.com">williamsjj@digitar.com</a><o:p></o:p></span></p></div></div></div></div></div></body></html>