[outages] XO / Level 3 Outage | Chicago - St Louis | 11/19/2015

[Kegan Myers]

As far as I can tell, the route we are using to Chicago is back up, but am
having a surprising number of ping timeouts/latency within the level3 path.
I know they de-prioritize ICMP, but this degree of it is just silly and
makes trying to understand what's going on to cause the performance issues
we are having much harder.

traceroute 8.8.8.8:
https://gist.github.com/terribleplan/902f15e4729511e9b4c1

On Fri, Nov 20, 2015 at 10:01 AM, Erik Sundberg via Outages <
outages at outages.org> wrote:

> We are still seeing some issue from yesterday’s fiber cut on Level3. Some
> circuit’s never came back up and other went back down this morning. I am
> working with Level3 on this now.
>
>
>
> Wondering if anyone else is still having issues between Chicago and St
> Louis?
>
>
>
>
>
>
>
> *From:* Outages [mailto:outages-bounces at outages.org] *On Behalf Of *Thom
> Cleary via Outages
> *Sent:* Thursday, November 19, 2015 7:01 PM
> *To:* frnkblk at iname.com; outages at outages.org
> *Subject:* [outages] XO / Level 3 Outage | Chicago - St Louis | 11/19/2015
>
>
>
> Here's the latest:
>
> *** CASCADED EXTERNAL NOTES 20-Nov-2015 00:36:21 GMT From CASE: 10003567 -
> Event
> Field Services continue preparation efforts at this time.
>
> 11/20/2015 00:40:36 GMT -
> *** CASCADED EXTERNAL NOTES 20-Nov-2015 00:36:21 GMT From CASE: 10003567 -
> Event
> Field Services continue preparation efforts at this time.
>
>
> 11/19/2015 23:47:36 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 23:43:49 GMT From CASE: 10003567 -
> Event
> Restoration efforts are still ongoing, an estimated restoral time has not
> been provided.
>
>
> 11/19/2015 23:05:21 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 23:00:53 GMT From CASE: 10003567 -
> Event
> Field Services have excavated three hand holes to reach the 108-count
> fiber cable for repair. Efforts are ongoing at the site with no estimated
> restoral time currently available.
>
>
> 11/19/2015 22:29:51 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 22:25:57 GMT From CASE: 10003567 -
> Event
> Field Services have accessed one hand hole and are working on accessing a
> second. Evaluation of the cable damage is underway.
>
>
> 11/19/2015 21:51:05 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 21:47:47 GMT From CASE: 10003567 -
> Event
> Field Services are now excavating to the hand hole with a backhoe. Once
> access is available, evaluation of the fault will continue.
>
>
> 11/19/2015 20:54:23 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 20:50:55 GMT From CASE: 10003567 -
> Event
> Field Services are manually digging to access the hand hole closest to the
> suspected damage point. Once accessed, Field Services will be able to
> better evaluate the issue.
>
>
> 11/19/2015 20:12:15 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 20:08:11 GMT From CASE: 10003567 -
> Event
> The plow work at the site has made isolation of the damage point difficult
> to pinpoint. Field Services are working to access hand holes in order to
> continue investigation and restoration efforts.
>
>
> 11/19/2015 19:08:37 GMT -
> *** CASCADED EXTERNAL NOTES 19-Nov-2015 19:04:13 GMT From CASE: 10003567 -
> Event
> Field Services are onsite in the construction area working to locate the
> exact damage point. Replacement cable is being dispatched to the site to
> have available for repair and should arrive by 20:00 GMT.
>
>
>
>
>
>
>
> ------------------------------
>
> CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files
> or previous e-mail messages attached to it may contain confidential
> information that is legally privileged. If you are not the intended
> recipient, or a person responsible for delivering it to the intended
> recipient, you are hereby notified that any disclosure, copying,
> distribution or use of any of the information contained in or attached to
> this transmission is STRICTLY PROHIBITED. If you have received this
> transmission in error please notify the sender immediately by replying to
> this e-mail. You must destroy the original transmission and its attachments
> without reading or saving in any manner. Thank you.
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20151120/a23e2886/attachment.htm>