<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:"Lucida Sans Unicode"}
@font-face
{font-family:Tahoma}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif"}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline}
tt
{font-family:"Courier New"}
span.EmailStyle18
{font-family:"Calibri","sans-serif";
color:#1F497D}
.MsoChpDefault
{font-family:"Calibri","sans-serif"}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.WordSection1
{}
-->
</style>
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D">Likewise. Must be addressing root cause now?</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><b><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#535353">Andrew Bunde</span></b></p>
<p class="MsoNormal"><b><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#535353">Team Lead, Storage & Network</span></b><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#535353">(405) 217 3811 Direct</span><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#535353">(405) 543 8288 Mobile</span><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#535353">(877) 405 2446 Agio Support</span><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#595959"><a href="mailto:andrew.bunde@agio.com"><span style="color:#595959">andrew.bunde@agio.com</span></a></span><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#595959"></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:9.0pt; font-family:"Lucida Sans Unicode","sans-serif"; color:#666666"><br>
<b>Agio</b> | <u>agio.com</u></span><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"; color:#1F497D"> </span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt; font-family:"Calibri","sans-serif"">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri","sans-serif""> Outages [mailto:outages-bounces@outages.org]
<b>On Behalf Of </b>Vincent Aniello<br>
<b>Sent:</b> Thursday, November 07, 2013 3:29 PM<br>
<b>To:</b> kclapp@staff.gwi.net<br>
<b>Cc:</b> outages@outages.org; Outages<br>
<b>Subject:</b> Re: [outages] Lightower/Sidera - NYC</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Arial","sans-serif"">Our circuits stabilized mid-afternoon, but shortly after 4pm EST we started seeing issues again.</span>
<br>
<br>
<span style="font-size:10.0pt; font-family:"Arial","sans-serif"">--Vincent</span>
<br>
<br>
<br>
<br>
<span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:#5F5F5F">From: </span><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">Karl Clapp <<a href="mailto:kclapp@staff.gwi.net">kclapp@staff.gwi.net</a>></span>
<br>
<span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:#5F5F5F">To: </span><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">"<a href="mailto:outages@outages.org">outages@outages.org</a>" <<a href="mailto:outages@outages.org">outages@outages.org</a>></span>
<br>
<span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:#5F5F5F">Date: </span><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">11/07/2013 03:23 PM</span>
<br>
<span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:#5F5F5F">Subject: </span><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">Re: [outages] Lightower/Sidera - NYC</span>
<br>
<span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:#5F5F5F">Sent by: </span><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">"Outages" <<a href="mailto:outages-bounces@outages.org">outages-bounces@outages.org</a>></span>
</p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" align="center" style="color:gray">
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"">I contacted their NOC about 45min ago. They have stated they are still working on resolution. They have reports about some services being functional, while other still experiencing packet-loss
and latency. It does not sound like they have been able to identify the root cause and are still troubleshooting.<br>
</span><br>
Here is the number I<span style="font-size:10.0pt; font-family:"Tahoma","sans-serif""> used to get through to their NOC: 888-583-4237, option 1. From there, just follow the prompts.<br>
<br>
Fwiw, my customer circuit from NYC to NJ is still affected.</span><br>
<br>
On Thu, Nov 7, 2013 at 10:25 AM, John Kinsella <<a href="mailto:jlk@thrashyour.com" target="_blank">jlk@thrashyour.com</a>> wrote:
<br>
Just as a data point, LT for me is routing into Equinix NY5 over HE, so at least there's connectivity...
<br>
<br>
My traceroute [v0.82] <br>
icmp (0.0.0.0) Thu Nov 7 07:24:09 2013
<br>
Keys: Help Display mode Restart statistics Order of fields quit <br>
Packets Pings <br>
Host Loss% Snt Last Avg Best Wrst StDev
<br>
1. 10.0.1.1 0.0% 29 6.7 3.2 0.8 12.2 2.7
<br>
2. 10.0.1.49 0.0% 28 8.0 4.3 1.5 13.1 3.0
<br>
3. 10.0.24.73 0.0% 28 6.7 4.5 1.9 14.7 3.4
<br>
4. 25.66.208.<a href="http://web-pass.com/" target="_blank">web-pass.com</a> 0.0% 28 1.9 11.2 1.9 48.0 12.3
<br>
5. 2-1.760.<a href="http://core.fre.web-pass.com/" target="_blank">core.fre.web-pass.com</a> 0.0% 28 9.2 6.4 3.1 19.7 4.0
<br>
6. gige-g6-2.<a href="http://core1.fmt1.he.net/" target="_blank">core1.fmt1.he.net</a> 0.0% 28 9.6 12.4 3.5 26.4 6.2
<br>
7. 10gigabitethernet1-2.<a href="http://core1.sjc2.he.net/" target="_blank">core1.sjc2.he.net</a> 0.0% 28 11.9 9.5 3.5 18.7 4.3
<br>
8. 10gigabitethernet9-1.<a href="http://core1.nyc4.he.net/" target="_blank">core1.nyc4.he.net</a> 0.0% 28 87.9 79.5 73.3 92.7 5.5
<br>
9. 10gigabitethernet4-1.<a href="http://core1.nyc5.he.net/" target="_blank">core1.nyc5.he.net</a> 0.0% 28 76.6 80.5 73.6 106.7 7.0
<br>
10. lightower-fiber-networks.10gigabitether 0.0% 28 78.0 82.3 74.4 108.0 9.4
<br>
11. <a href="http://xe-8-3-0.nycmnyzrj91.lightower.net/" target="_blank">xe-8-3-0.nycmnyzrj91.lightower.net</a> 0.0% 28 89.1 83.6 74.2 144.7 15.8
<br>
12. <a href="http://ae2-jrcynj67j41.lightower.net/" target="_blank">ae2-jrcynj67j41.lightower.net</a> 0.0% 28 85.4 88.6 80.1 131.5 12.1
<br>
13. 192.154.116.14.<a href="http://lightower.net/" target="_blank">lightower.net</a> 0.0% 28 85.6 83.9 80.2 95.6 3.5
<br>
14. ??? <br>
<br>
<span style="color:#8F8F8F">John</span> <br>
<br>
On Nov 7, 2013, at 7:19 AM, Karl Clapp <<a href="mailto:kclapp@staff.gwi.net" target="_blank">kclapp@staff.gwi.net</a>> wrote:
<br>
<br>
<span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"">LightTower/Sidera master ticker for this is LT1323725.<br>
</span><br>
<span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"">I was able to get through their support line now.</span>
<br>
<span style="font-size:10.0pt; font-family:"Tahoma","sans-serif""><br>
The ETR is 1-2 hours from now.</span> <br>
<br>
<span style="font-family:"Tahoma","sans-serif"">---<br>
Karl Clapp<br>
Network Engineering Manager<br>
Biddeford Internet Corp. d.b.a. GWI (AS5760)<br>
Office: </span><a href="tel:207.602.1144" target="_blank"><span style="font-family:"Tahoma","sans-serif"">207.602.1144</span></a><span style="font-family:"Tahoma","sans-serif""><br>
Mobile: </span><a href="tel:207.641.3907" target="_blank"><span style="font-family:"Tahoma","sans-serif"">207.641.3907</span></a><span style="font-family:"Tahoma","sans-serif""><br>
Fax: </span><a href="tel:207.286.2061" target="_blank"><span style="font-family:"Tahoma","sans-serif"">207.286.2061</span></a>
<br>
<br>
<br>
On Thu, Nov 7, 2013 at 9:39 AM, <<a href="mailto:SRonan@eexchange.com" target="_blank">SRonan@eexchange.com</a>> wrote:
<br>
<span style="font-size:7.5pt; font-family:"Calibri","sans-serif"">Likely related to the fiber cut they experienced on their network earlier this week which they routed around.</span>
<br>
<br>
<a name="142332be2a606f1c_142330201e9fe8e9__MailA"></a><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">Shane Ronan, Vice President – Technology Architect </span>
<br>
<span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">State Street Global Exchange | 1230 Avenue of the Americas, 18th Fl | New York, NY 10020</span>
<br>
<span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">P </span><a href="tel:%28212%29%20259-3023" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">(212) 259-3023</span></a><span style="font-size:10.0pt; font-family:"Calibri","sans-serif""> | M
</span><a href="tel:%28347%29%20413-4503" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">(347) 413-4503</span></a>
<br>
<a href="mailto:sronan@eexchange.com" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">sronan@eexchange.com</span></a>
<br>
<br>
<b><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">From: </span>
</b><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">Jayson Navitsky <</span><a href="mailto:jnavitsky@gmail.com" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">jnavitsky@gmail.com</span></a><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">><b><br>
Date: </b>Thursday, November 7, 2013 at 6:55 AM<b><br>
To: </b>"</span><a href="mailto:outages@outages.org" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">outages@outages.org</span></a><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">" <</span><a href="mailto:outages@outages.org" target="_blank"><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">outages@outages.org</span></a><span style="font-size:10.0pt; font-family:"Calibri","sans-serif"">><b><br>
Subject: </b>[outages] Lightower/Sidera - NYC</span> <br>
<br>
<span style="font-size:7.5pt; font-family:"Calibri","sans-serif"">Anyone else seeing any issues in NYC with Lightower/Sidera? Starting around 6:05AM (EST) we saw heavy packet loss across their network (from Sidera legacy) and some of our point to points bounce.
The P to P's have some what stabilized (though we've seen a couple more bounces since then) the IP side of things have been pretty much unusable (we shut our session down.) It also looks like their phone system is having a problem - calls into them seem to
drop after trying to connect to the NOC - which I'm sure is pretty busy. <br>
</span><br>
<span style="font-size:7.5pt; font-family:"Calibri","sans-serif"">-Jayson </span>
</p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u><span style="font-size:7.5pt; font-family:"Arial","sans-serif"; color:blue"><br>
</span></u><a href="http://www.statestreet.com/emaildisclaimer/" target="_blank"><span style="font-size:7.5pt; font-family:"Arial","sans-serif"">http://www.statestreet.com/emaildisclaimer/</span></a>
<br>
<br>
_______________________________________________<br>
Outages mailing list<u><span style="color:blue"><br>
</span></u><a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><u><span style="color:blue"><br>
</span></u><a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br>
<br>
_______________________________________________<br>
Outages mailing list<u><span style="color:blue"><br>
</span></u><a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><u><span style="color:blue"><br>
</span></u><a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>
<br>
<br>
<br>
_______________________________________________<br>
Outages mailing list<u><span style="color:blue"><br>
</span></u><a href="mailto:Outages@outages.org">Outages@outages.org</a><u><span style="color:blue"><br>
</span></u><a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br>
<tt><span style="font-size:10.0pt">_______________________________________________</span></tt><span style="font-size:10.0pt; font-family:"Courier New""><br>
<tt>Outages mailing list</tt><br>
<tt><a href="mailto:Outages@outages.org">Outages@outages.org</a></tt><br>
</span><a href="https://puck.nether.net/mailman/listinfo/outages"><tt><span style="font-size:10.0pt">https://puck.nether.net/mailman/listinfo/outages</span></tt></a></p>
</div>
<font color="#999999" face="Arial" size="1">The information in this transmittal may be legally privileged, confidential, and/or otherwise protected by law from disclosure, and is intended only for the recipient(s) listed above. If you are neither the intended
recipient(s) nor a person responsible for the delivery of this transmittal to the intended recipient(s), you are hereby notified that any distribution or copying of this transmittal is prohibited. If you have received this transmittal in error, please notify
Agio LLC immediately at (405) 217-3800 or by return e-mail and take the steps necessary to delete it completely from your computer system. Thank you.</font>
</body>
</html>