<html>
<body>
<br>
Oddly enough, the ckt came up a few hours ago - I'm wondering if they
re-routed us. No notes in the ticket (we're getting the updates
now... they had a bad email address).<br><br>
At 04:53 PM 30/07/2014, Luke Rockwell wrote:<br>
<blockquote type=cite class=cite cite="">7/30/14 8:27:19 PM GMT Repair
work is ongoing at the site. Updates will be provided as they are
received.<br>
7/30/14 7:32:21 PM GMTField Services continue excavation efforts and have
estimated splicing will begin in approximately one hour. <br>
7/30/14 7:10:12 PM GMT Repair efforts are ongoing at the site. No
estimated restoral time is currently available.<br>
7/30/14 6:18:25 PM GMTField Services report excavation efforts are in
progress to access the damaged cable. The splice crew is onsite to
continue with repair following excavation. <br>
7/30/14 5:58:09 PM GMT Repair crews continue en route to the site to
proceed with restoration efforts.<br>
7/30/14 5:18:26 PM GMTA 108-count fiber cut has been confirmed to have
been caused by construction near the railway. All necessary repair crews
are en route with no ETA available at this time. <br>
7/30/14 4:22:00 PM GMT Field Services report that there is construction
in the area that has likely caused the fiber cut. An excavation crew has
been engaged to uncover the suspected damaged portion of the span. No ETA
has been provided for the excavation crew. <br>
7/30/14 4:03:40 PM GMT Field Services continue investigation in
conjunction with railway workers to further isolate the suspected fiber
cut.<br>
7/30/14 3:41:00 PM GMTField Services report that the fault location is in
close proximity to a railway. As such, Field Services is coordinating
with railway workers to ensure safe access to continue investigation.
Splice crews have been dispatched to the site and are expected to arrive
shortly. <br>
7/30/14 2:58:44 PM GMT Field Services arrived in Southfield, MI and
detected a fault approximately 52 miles from the site. Field Services is
proceeding en route to the fault location.<br>
7/30/14 2:11:36 PM GMTThe Transport NOC detected a loss of signal in
Dexter, MI is impacting unprotected services. A fiber cut is suspected
and Field Services have been engaged for investigation. Updates will be
provided as they are received. <br><br>
<tt>.....................................<br>
</tt><b>Luke Rockwell</b><br>
<font color="#003478">Systems Administrator</font><br>
Information Technology<br><br>
<tt>.....................................<br>
</tt><br>
Cal Alumni Association | UC Berkeley<br>
1 Alumni House, Berkeley, CA 94720<br>
<b>T</b>Â 510.900.8196<br>
<b>F</b>Â 510.642.6252<br><br>
<tt>.....................................<br>
</tt><br>
<i>Commitment, Support, Passion</i><br><br>
<tt>_____________________________________<br>
</tt><b><a href="http://alumni.berkeley.edu/">alumni.berkeley.edu</a></b>
<br><br>
<tt>_____________________________________<br>
</tt><b><a href="https://www.facebook.com/CalAlumni">Facebook</a>Â |Â
<a href="http://www.linkedin.com/groups?gid=70245">LinkedIn</a></b>
<br><br>
<br>
On Wed, Jul 30, 2014 at 9:41 AM, Bill Wichers
<<a href="mailto:billw@waveform.net">billw@waveform.net</a>>
wrote:<br>
<dl><br>
<dd>This is affecting XO in Detroit too, I can see them on protect path
due to higher than normal latency Detroit<->Chicago.<br><br>
<dd>Â <br><br>
<dd>Â -Bill<br><br>
<dd>Â <br><br>
<dd>From:</b> Outages
[<a href="mailto:outages-bounces@outages.org" eudora="autourl">
mailto:outages-bounces@outages.org</a>] On Behalf Of </b>Luke Rockwell
via Outages<br>
<dd>Sent:</b> Wednesday, July 30, 2014 12:14 PM<br>
<dd>To:</b> Clayton Zekelman<br>
<dd>Cc:</b>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<dd>Subject:</b> Re: [outages] Level3 10G DWDM Ckt Detroit to
Chicago<br><br>
<dd>Â <br><br>
<dd>Latest update from Level 3 trouble board<br><br>
<dd>Â <br><br>
<dd>7/30/14 4:03:40 PM GMT<br><br>
<dd>Field Services continue investigation in conjunction with railway
workers to further isolate the suspected fiber cut.<br><br>
<dd>7/30/14 3:41:00 PM GMT<br><br>
<dd>Field Services report that the fault location is in close proximity
to a railway. As such, Field Services is coordinating with railway
workers to ensure safe access to continue investigation. Splice crews
have been dispatched to the site and are expected to arrive
shortly.<br><br>
<dd>7/30/14 2:58:44 PM GMT<br><br>
<dd>Field Services arrived in Southfield, MI and detected a fault
approximately 52 miles from the site. Field Services is proceeding en
route to the fault location.<br><br>
<dd>7/30/14 2:11:36 PM GMT<br><br>
<dd>The Transport NOC detected a loss of signal in Dexter, MI is
impacting unprotected services. A fiber cut is suspected and Field
Services have been engaged for investigation. Updates will be provided as
they are received.<br><br>
<br>
<dd><tt>.....................................<br>
</tt><br>
<dd>Luke Rockwell</b><br>
<dd>Systems Administrator<br>
<dd>Information Technology<br><br>
<dd><tt>.....................................<br>
</tt><br>
<dd>Cal Alumni Association | UC Berkeley<br>
<dd>1 Alumni House, Berkeley, CA 94720<br>
<dd>T</b>Â 510.900.8196<br>
<dd>F</b>Â 510.642.6252<br><br>
<dd><tt>.....................................<br>
</tt><br>
<dd>Commitment, Support, Passion<br>
</i><br>
<dd><tt>_____________________________________<br>
</tt><br>
<dd><a href="http://alumni.berkeley.edu/">alumni.berkeley.edu</a><br>
</b><br>
<dd><tt>_____________________________________<br>
</tt><br>
<dd><a href="https://www.facebook.com/CalAlumni">Facebook</a>Â |Â
<a href="http://www.linkedin.com/groups?gid=70245">LinkedIn</a></b>
<br><br>
<dd>Â <br><br>
<dd>On Wed, Jul 30, 2014 at 8:47 AM, Clayton Zekelman via Outages
<<a href="mailto:outages@outages.org">outages@outages.org</a>>
wrote:<br><br>
<br><br>
<dd>Well, the same 10 Gig DWDM is down again - 10:53am. Â Level3 reports
a fibre cut this time - near the same location as the card failure on the
19th...<br><br>
<br><br>
<br><br>
<dd>At 11:38 AM 19/07/2014, Clayton Zekelman via Outages wrote:<br><br>
<dd>Looks like our circuit came back up a few minutes ago.<br><br>
<dd>We took a couple of brief hits on 2 1Gig DIAs out of Southfield, MI
though - not sure if that was related.<br><br>
<br>
<dd>At 06:48 AM 19/07/2014, Clayton Zekelman wrote:<br><br>
<dd>Level3 10G DWDM Ckt from Detroit to Chicago currently out of service
(down at 6:15am EDT).<br><br>
<dd>Possibly related to some sort of transport failure in Dexter, MI that
happened around the same time.<br><br>
<br>
<dd>---<br><br>
<dd>Â <br><br>
<dd>---<br><br>
<dd>Clayton Zekelman<br>
<dd>Managed Network Systems Inc. (MNSi)<br>
<dd>3363 Tecumseh Rd. E<br>
<dd>Windsor, Ontario<br>
<dd>N8W 1H4<br><br>
<dd>tel. 519-985-8410<br>
<dd>fax. 519-985-8409 Â Â Â Â <br>
<dd>_______________________________________________<br>
<dd>Outages mailing list<br>
<dd><a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<dd>
<a href="https://puck.nether.net/mailman/listinfo/outages" eudora="autourl">
https://puck.nether.net/mailman/listinfo/outages</a><br><br>
<dd>Â <br><br>
</dl></blockquote>
<x-sigsep><p></x-sigsep>
---<br><br>
Clayton Zekelman<br>
Managed Network Systems Inc. (MNSi)<br>
3363 Tecumseh Rd. E<br>
Windsor, Ontario<br>
N8W 1H4<br><br>
tel. 519-985-8410<br>
fax.
519-985-8409<x-tab> </x-tab>
</body>
</html>