[outages] Centurylink Fiber cut in Phoenix

[Tim Densmore]

On 07/17/2018 07:10 PM, Murali Medikonda via Outages wrote:
> Curious if anyone has any further updates on this fiber-cut.. I 
> appreciate it

Here's the latest I've got:

07/18/2018 00:51:39 GMT -
*** CASCADED EXTERNAL NOTES 18-Jul-2018 00:49:51 GMT From CASE: 14896554 - Event
The excavation crew continues working to expose the rest of the conduit.


07/18/2018 00:12:38 GMT -
*** CASCADED EXTERNAL NOTES 18-Jul-2018 00:05:57 GMT From CASE: 14896554 - Event
Field Operations on site reports that 25 feet of conduit has been exposed and the damaged area has been located. 10 conduits have been determined to be destroyed. Crews on site continue excavating the area to completely uncover the damaged conduit; this process is expected to take 2 hours. After this process has been completed, the fiber will be brought to the surface so preparation efforts may begin for splicing.


07/17/2018 23:15:57 GMT -
*** CASCADED EXTERNAL NOTES 17-Jul-2018 23:08:50 GMT From CASE: 14896554 - Event
The Outside Plant team has located the conduit around 12 feet under the ground, and are currently excavating the area to discern the total extent of the damage. There are 12 conduits in total, so it may take time in isolating which conduits are damaged.


07/17/2018 19:51:58 GMT -
*** CASCADED EXTERNAL NOTES 17-Jul-2018 19:50:18 GMT From CASE: 14896554 - Event
Field Operations have reported that the Construction team is en route to the site with backhoes and the shoring supplies. An ETA of 20:00 GMT has been provided. In addition, local utility providers are currently on site marking existing utility lines in the area to prevent impacts during the repairs.  Once on site, the Construction team will commence with installing the necessary shoring around the damage site. It is estimated that the shoring activities will be completed at 23:00 GMT and excavation activities will commence at that time.  The Transport NOC has reported that there are currently no reroute opportunities. The next update will be relayed once the shoring has been completed or additional information becomes available.


07/17/2018 18:30:15 GMT -
*** CASCADED EXTERNAL NOTES 17-Jul-2018 18:28:16 GMT From CASE: 14896554 - Event
Field Operations have identified a 96-count buried fiber cable that has been cut by boring activities occurring in the area. The cable is buried 14 feet deep and is within 25 feet of a railroad line. As such, the railroad line provider will not allow excavations activities to commence until all necessary shoring supplies are on site.  The supplies are being obtained at this time, however, the ETA to the site is not yet known.  Once the shoring is in place, the excavation team will begin digging a trench to access the damaged fiber and perform the repairs.  The trench will need to be approximately 50 feet in length and at least 15 feet deep to access the fiber and raise it for splicing repairs to commence.  The initial activities are expected to take approximately two hours. As such the next update will be relayed at 20:30 GMT or as additional information becomes available.  This issue has been escalated internally to the Executive level proactively.


07/17/2018 17:35:02 GMT -
*** CASCADED EXTERNAL NOTES 17-Jul-2018 17:33:12 GMT From CASE: 14896554 - Event
Field Operations and the OSPE team have arrived at the site and have identified a location where they believe a buried fiber cable has been damaged by construction activities occurring in the area. Additional assessments are on ongoing at this time.  A fiber splicing repair team has been engaged to assist with the repairs once the damaged fiber has been identified, however the ETA to the site is not yet known.


07/17/2018 16:40:17 GMT -
*** CASCADED EXTERNAL NOTES 17-Jul-2018 16:39:24 GMT From CASE: 14896554 - Event
Field Operations have performed light measurement readings from the CenturyLink Gateway in Phoenix and have identified the fault condition 28.43 miles from the site.  The Outside Plant Engineer (OSPE) has been engaged to assist with further isolation.


07/17/2018 16:20:14 GMT - 07/17/2018 15:54:16 GMT - The Transport NOC has reported that a suspected fiber cut in Phoenix, AZ is impacting unprotected transport services. Field Operations are being engaged to investigate further; however, an estimated time of arrival (ETA) is not yet known.  Please be advised that updates for this event will be relayed at a minimum of hourly unless otherwise noted. The information conveyed hereafter is associated to live troubleshooting effort and as the discovery process evolves through to service resolution, ticket closure, or post incident review, details may evolve.