[outages] Level3 circuit issues in SoCal

[Bobin Joseph]

Got this couple hours ago.


*** CASCADED EXTERNAL NOTES 25-Aug-2016 23:03:17 GMT From CASE: 11364554 - Event
Event Conclusion Summary
Outage Start:  August 25, 2016 20:00 GMT
Outage Stop: August 25, 2016 21:50 GMT
Root Cause:  An unknown issue was causing a link to bounce in San Diego, CA, impacting IP services.
Fix Action: The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state.
Reason for Outage (RFO) Summary: The IP NOC reported that an unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Tier III Technical Support and the equipment vendor were engaged for further investigation into the root cause. This service impact has concluded; however, there may be additional analysis and discovery that occurs as the incident is reviewed by NOC management. Any available updates will be relayed upon event ticket closure. If additional issues are experienced, please contact the Level 3 Technical Service Center at 1-877-4LEVEL3.​


Thanks,

Bobin

________________________________
From: Outages <outages-bounces at outages.org> on behalf of Eric Kuhnke via Outages <outages at outages.org>
Sent: Thursday, August 25, 2016 3:20 PM
To: outages at outages.org
Subject: Re: [outages] Level3 circuit issues in SoCal


It is interesting to see that the reliability of an IP transit provider sometimes has no direct correlation with their pricing structure for various commitments in $/MRC for a given value of Gbps. No matter what the marketing materials/sales say about how awesome their network is.

In my experience, in a particular metro area, buying transit from a well-peered medium sized regional tier 2/3 size carrier where you personally know the people who have enable on the core routers can result in a more resilient network.

On 8/25/16 3:15 PM, David Hubbard via Outages wrote:
Just got this:

*** CASCADED EXTERNAL NOTES 25-Aug-2016 22:11:34 GMT From CASE: 11364554 - Event
The IP NOC reported that an unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Tier III Technical Support and the equipment vendor were engaged for further investigation into the root cause. The IP NOC is continuing to monitor and a final notification will be sent when stability has been confirmed.


But yeah, I feel the same way.  Their network has been an absolute mess since they started trying to merge the legacy Twtelecom network together; it’s been really bad as of late, and any redundancy we had via the other provider is now gone as we have some locations with only L3 / TW circuits; both have issues at the same time now if it’s routing related.  Ugh

David

From: Matt Hoppes <mattlists at rivervalleyinternet.net><mailto:mattlists at rivervalleyinternet.net>
Date: Thursday, August 25, 2016 at 6:11 PM
To: David Hubbard <dhubbard at dino.hostasaurus.com><mailto:dhubbard at dino.hostasaurus.com>
Cc: Bobin Joseph <Bobin.Joseph at mitchell.com><mailto:Bobin.Joseph at mitchell.com>, "outages at outages.org"<mailto:outages at outages.org> <outages at outages.org><mailto:outages at outages.org>
Subject: Re: [outages] Level3 circuit issues in SoCal

What in the world is going on with the Level3 network over the last two weeks?  It's falling apart.

On Aug 25, 2016, at 17:46, David Hubbard via Outages <outages at outages.org<mailto:outages at outages.org>> wrote:
Same; San Diego area fiber connection.  Does not seem to be affecting our legacy TW phone circuits.  Happened about an hour ago and has just started again.  Was about to open a ticket.

David

From: Outages <outages-bounces at outages.org<mailto:outages-bounces at outages.org>> on behalf of Bobin Joseph via Outages <outages at outages.org<mailto:outages at outages.org>>
Reply-To: Bobin Joseph <Bobin.Joseph at mitchell.com<mailto:Bobin.Joseph at mitchell.com>>
Date: Thursday, August 25, 2016 at 5:38 PM
To: "outages at outages.org<mailto:outages at outages.org>" <outages at outages.org<mailto:outages at outages.org>>
Subject: [outages] Level3 circuit issues in SoCal

Are anybody else experiencing issues with Level3 in the Southern California region?
We are seeing constant intermittent outages on our internet and VPLS circuit.

Thanks,
Bobin

_______________________________________________
Outages mailing list
Outages at outages.org<mailto:Outages at outages.org>
https://puck.nether.net/mailman/listinfo/outages



_______________________________________________
Outages mailing list
Outages at outages.org<mailto:Outages at outages.org>
https://puck.nether.net/mailman/listinfo/outages


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20160826/14c00c4b/attachment.htm>