[outages] Restored? Lightower, Worcester, MA fiber cut

[Chuck Anderson]

The last email update I received was:

---------
Sat, 8 Nov 2014 07:21:07 -0500

ETTR: Not at this time
Current Update: Fiber reroute still ongoing, no ETTR as of yet.
--------

However, all the circuits I have visibility to are restored, other
than one circuit on a diverse path out of the building that got
knocked offline while repairs were happening to the first path.  That
incident took my campus entirely offline for several hours early this
morning until a manual workaround was put into place.

What a "fun" 2 days this was.  I hope we find out what caused the
explosion/fire in the first place... I think it was some kind of
electrical fault.

Not much news on this one, but I did find this which gets the details
wrong (location should be Lincoln Square, not Lincoln St.):

http://www.masslive.com/news/worcester/index.ssf/2014/11/manhole_explosion_knocks_worce.html

http://www.telegram.com/article/20141107/NEWS/311079660/1116#.VF0G5aguXC4.twitter

http://www.qcc.edu/ was also affected:

"Last night a fire in a manhole in Lincoln Square severed the fiber
that connects the West Boylston St campus to the Internet. Using
back-up lines we were able to ..."

On Fri, Nov 07, 2014 at 06:33:43PM -0500, Chuck Anderson via Outages wrote:
> Today's updates:
> 
> Fri, 7 Nov 2014 11:10:02 -0500
> 
> ETTR: Mid-Afternoon
> 
> Lightower fiber crew has completed installation of replacement temp
> cable and advised prep work is ongoing, Once complete we will commence
> splicing. Updates will be provided as they are recieved.
> 
> Fri, 7 Nov 2014 13:39:53 -0500
> 
> ETTR: Mid-Afternoon
> 
> Cable has been pulled, Prep work has been completed. Splicing has
> commenced... Updates will be provided as they are recieved.
> 
> Fri, 7 Nov 2014 16:19:19 -0500
> 
> ETTR: N/A
> 
> Lightower fiber crew advised that splicing is still ongoing to
> re-route services. Updates will be provided as they are
> available. There is no current ETTR available.
> 
> Fri, 7 Nov 2014 18:29:03 -0500
> 
> ETTR: N/A
> 
> Lightower fiber crew advised that splicing is still ongoing to
> re-route services. Updates will be provided as they are
> available. There is no current ETTR available.
> 
> On Fri, Nov 07, 2014 at 08:30:38AM -0500, Chuck Anderson via Outages wrote:
> > Update Fri, 7 Nov 2014 08:25:53 -0500:
> > 
> > "Regions/Locations:
> > New England
> > Trouble Description:
> > Fiber Cut
> > 
> > ETTR:
> > Mid-Afternoon
> > 
> > Current Update:
> > 
> > Dear Valued Customer,
> > 
> > Impact Update: Estimated timeline of reroute, 500 feet of cable is
> > being pulled, ETA to complete cable pull is 9am. Cable prepping will
> > be performed from 9-10am, splicing should start by 11am."
> > 
> > On Fri, Nov 07, 2014 at 07:26:56AM -0500, Chuck Anderson via Outages wrote:
> > > Update as of 06:05:16 -0500:
> > > 
> > > "Status has remained the same Lightower has two (2) 288 cables that
> > > were burnt through in a National Grid  enclosure. National Grid has
> > > informed us that there is an exposed high tension power line in this
> > > enclosure and there will be no access granted in the near
> > > future. National Grid has deemed this manhole unsafe at this
> > > time. Lightower is working on an alternate solution that will re-route
> > > fibers around the affected man hole still NO ETTR at this time. We
> > > apologize for this inconvenience."
> > > 
> > > On Fri, Nov 07, 2014 at 04:04:27AM -0500, Chuck Anderson wrote:
> > > > Updates as of 01:41:40 -0500 and 02:58:11 -0500:
> > > > 
> > > > "We have two (2) 288 cables that were burnt through in this National
> > > > Grid enclosure. National Grid has informed us that there is an exposed
> > > > high tension power line in this enclosure and there will no access
> > > > granted in the near future. National Grid has deemed this manhole
> > > > unsafe at this time. Lightower is working on an alternate solution
> > > > that will re-route fibers around the affected man hole. NO ETTR at
> > > > this time."
> > > > 
> > > > My initial outage time was exactly 18:58:54 EST on two circuits.
> > > > 
> > > > On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
> > > > > We lost several dark fiber circuits out of Lightower in Worcester, MA.
> > > > > There is a manhole fire down the street at Main St. & Highland
> > > > > St. that is most likely the cause.  Smoke is billowing out of several
> > > > > manholes.  NGrid, NStar, police & fire are on the scene.  Lightower
> > > > > has dispatched techs.  No ETR yet.
> > > > > 
> > > > > One other of my circuits that leaves the building via a diverse path
> > > > > is still up luckily, or we'd be off the net entirely.