<div dir="ltr">This is the full timeline from the outage today. We first had complaints around 15:35 and monitoring detected issues around 15:15<div><br></div><div><p class=""><b>Tue, 14 Jun 2016 20:23:57 </b>:</p></div><div><span style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">Dear Customer,</span><br style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px"><br style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px"><span style="color:rgb(0,0,0);font-family:Calibri,sans-serif;font-size:14px">We have got confirmation from our 3rd line that there should not be any packet loss and everything is back to normal. Once all the info in regards to this issue has been collected , RFO drafted and ready to be sent we will share it. </span><br><div><br></div><div>
<p class=""><b>Tue, 14 Jun 2016 19:34:57 </b>:</p>
<p class="">Issue is getting better as right now . We are pending final confirmation from 3rd line Engineers and full report as well once it is available. </p>
<p class=""><b>Tue, 14 Jun 2016 18:55:07 </b>:</p>
<p class="">Also this case has been escalated to the Escalation manager as well . So 3rd line Engineers and Escalation manager for prompt resolution. </p>
<p class=""><b>Tue, 14 Jun 2016 18:53:01 </b>:</p>
<p class="">Our 3RD line Engineers are still working on resolving this issue . No traffic Engineer has been implemented as they have been able to mitigate some of the issue , not all by other means . More update to follow . </p>
<p class="">Truly sorry for the inconvenience . </p>
<p class=""><b>Tue, 14 Jun 2016 17:52:54 </b>:</p>
<p class="">Our 3rd line Engineers are currently investigating the issue and in the meantime they deciding where to apply traffic engineering to mitigate the packet loss. </p>
<p class=""><b>Tue, 14 Jun 2016 17:28:47 </b>:<br></p>
<p class="">This issue has been escalated and our core engineers are investigating. More updates to follow. </p>
<p class=""><b>Tue, 14 Jun 2016 17:16:31 </b>:</p>
<p class="">We observed one system down between 2016-06-14 15:40 to 15:46 UTC.This flapped congested links in the west/central US. We are investigating what caused this flap. And the current packet loss issues </p></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 14, 2016 at 2:25 PM, Estevan Pagan via Outages <span dir="ltr"><<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">This is all the info I have from Telia atm:<div><br></div><div><span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:14.6667px">We are currently experiencing a mass event on our U.S Backbone. This event is being tracked under ticket number 00566484. If you can provide the IC-number we can open a separate ticket for your service and link them together. We are still investigating this issue.</span><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 14, 2016 at 12:22 PM, Jeff McAdams via Outages <span dir="ltr"><<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I'm not a Telia customer. Can anyone relay the gist of what's in the<br>
ticket? I'm particularly looking for a start time to maybe correlate with<br>
a problem in one of our setups that may be related.<br>
<div><div><br>
On Tue, June 14, 2016 15:08, Estevan Pagan via Outages wrote:<br>
> Telia seems to be having a backbone issue in the US. Master ticket:<br>
> 00566484<br>
><br>
><br>
> My traceroute was having packet loss in chicago.<br>
</div></div>> _______________________________________________<br>
> Outages mailing list<br>
> <a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
> <a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
><br>
><br>
<span><font color="#888888"><br>
<br>
--<br>
Jeff<br>
<br>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</font></span></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br></blockquote></div><br></div>