[outages] Telia issues in US

[Ryan Gelobter]

This is the full timeline from the outage today. We first had complaints
around 15:35 and monitoring detected issues around 15:15

*Tue, 14 Jun 2016 20:23:57 *:
Dear Customer,

We have got confirmation from our 3rd line that there should not be any
packet loss and everything is back to normal. Once all the info in regards
to this issue has been collected ,  RFO drafted and ready to be sent we
will share it.

*Tue, 14 Jun 2016 19:34:57 *:

Issue is getting better as right now . We are pending final confirmation
from 3rd line Engineers and full report as well once it is available.

*Tue, 14 Jun 2016 18:55:07 *:

Also this case has been escalated to the Escalation manager as well . So
3rd line Engineers and Escalation manager for prompt resolution.

*Tue, 14 Jun 2016 18:53:01 *:

Our 3RD line Engineers are still working on resolving this issue . No
traffic Engineer has been implemented as they have been able to mitigate
some of the issue , not all by other means . More update to follow .

Truly sorry for the inconvenience .

*Tue, 14 Jun 2016 17:52:54 *:

Our 3rd line Engineers are currently investigating the issue and in the
meantime they deciding where to apply traffic engineering to mitigate the
packet loss.

*Tue, 14 Jun 2016 17:28:47 *:

This issue has been escalated and our core engineers are investigating.
More updates to follow.

*Tue, 14 Jun 2016 17:16:31 *:

We observed one system down between 2016-06-14 15:40 to 15:46 UTC.This
flapped congested links in the west/central US.   We are investigating what
caused this flap. And the current packet loss issues

On Tue, Jun 14, 2016 at 2:25 PM, Estevan Pagan via Outages <
outages at outages.org> wrote:

> This is all the info I have from Telia atm:
>
> We are currently experiencing a mass event on our U.S Backbone. This event
> is being tracked under ticket number 00566484. If you can provide the
> IC-number we can open a separate ticket for your service and link them
> together. We are still investigating this issue.
>
> On Tue, Jun 14, 2016 at 12:22 PM, Jeff McAdams via Outages <
> outages at outages.org> wrote:
>
>> I'm not a Telia customer.  Can anyone relay the gist of what's in the
>> ticket?  I'm particularly looking for a start time to maybe correlate with
>> a problem in one of our setups that may be related.
>>
>> On Tue, June 14, 2016 15:08, Estevan Pagan via Outages wrote:
>> > Telia seems to be having a backbone issue in the US. Master ticket:
>> > 00566484
>> >
>> >
>> > My traceroute was having packet loss in chicago.
>> > _______________________________________________
>> > Outages mailing list
>> > Outages at outages.org
>> > https://puck.nether.net/mailman/listinfo/outages
>> >
>> >
>>
>>
>> --
>> Jeff
>>
>> _______________________________________________
>> Outages mailing list
>> Outages at outages.org
>> https://puck.nether.net/mailman/listinfo/outages
>>
>
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20160615/f0339f1f/attachment.htm>