[outages] Level 3 Detroit issues again

[Bill Wichers]

It appears to have been a new issue, but possibly related to the previous one. Level(3) reported the following this morning:

13:53 GMT<x-apple-data-detectors://1> - The IP NOC reports that protocol drops following a scheduled maintenance, GCR 7622319<tel:7622319>, in Detroit, MI impacted IP services. The issue existed on a connection between two of the routers in Detroit, MI. The IP NOC has disabled that connection to allow traffic to flow through alternate routes and eliminate the protocol drops. The IP NOC will continue investigating the faulty connection in an attempt to determine the root cause and restore the connection for service. At this time, the IP NOC reports that services are up and stable

Sent from my iPhone

On Mar 8, 2014, at 6:36 AM, "Mitch Patterson" <mitpatterson at gmail.com<mailto:mitpatterson at gmail.com>> wrote:


They were doing emergency maintance likely related to the other night

On Mar 8, 2014 6:34 AM, "Greg Smythe" <greg at thesmythes.org<mailto:greg at thesmythes.org>> wrote:
As I type this I am seeing Level3 issues in the Detroit area. Been going on since about 4:30am Eastern. My co-lo provider had to disable peering to get us back and running.



-=-=-=-=-=-=-=-=-=-=--=-=-
Greg Smythe


From: Outages [mailto:outages-bounces at outages.org<mailto:outages-bounces at outages.org>] On Behalf Of Mitch Patterson
Sent: Friday, March 07, 2014 12:51 AM
To: Bill Wichers
Cc: outages at outages.org<mailto:outages at outages.org>
Subject: Re: [outages] Level 3 Detroit issues again

Just got this

*** CASCADED EXTERNAL NOTES 07-Mar-2014 05:48:37 GMT From CASE: 7621845 - Event The Operations Engineering team has isolated the cause of the packet loss failure.  A change in parameters on the Detroit's network router has been initiated to restore normal operations.

On Fri, Mar 7, 2014 at 12:41 AM, Mitch Patterson <mitpatterson at gmail.com<mailto:mitpatterson at gmail.com>> wrote:
Just got this

03/07/2014 05:06 AM GMT






*** CASCADED EXTERNAL NOTES 07-Mar-2014 05:06:43 GMT From CASE: 7621845 - Event

The Technical Services Center (TSC) detected a packet loss condition on a network router in Detroit, MI.  The Operations Engineering team has been engaged on the issue and they are currently analyzing the packet loss condition to determine the cause of the failure.

On Fri, Mar 7, 2014 at 12:01 AM, Mitch Patterson <mitpatterson at gmail.com<mailto:mitpatterson at gmail.com>> wrote:
Do you know are the circuits you are on legacy GLBX? from what i'm told by our guy who handles the colo the legacy GLBX ones are fine. but the other ones are not.

On Thu, Mar 6, 2014 at 11:59 PM, Bill Wichers <billw at waveform.net<mailto:billw at waveform.net>> wrote:
We connect into them in Detroit and we don't see this. We aren't in their colo though.

-Bill

Sent from my iPhone

On Mar 6, 2014, at 11:44 PM, "Mitch Patterson" <mitpatterson at gmail.com<mailto:mitpatterson at gmail.com>> wrote:

> We are seeing over 20% packet loss on our circuits at their colo in Southfield. They are telling me its been refereed to their IP core team as its a high level issue. Anyone else seeing this?
> _______________________________________________
> Outages mailing list
> Outages at outages.org<mailto:Outages at outages.org>
> https://puck.nether.net/mailman/listinfo/outages



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20140308/38ba9852/attachment.htm>