<div dir="ltr">Looks like it was resolved around noon today EST for us.<div><br></div><div>
<p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><strong>Update<span> </span><span class="gmail-aBn" tabindex="0" style="border-bottom:1px dashed rgb(204,204,204)"><span class="gmail-aQJ" style="top: 2px; z-index: -1;">2:43 EDT</span></span><span> </span>Hrs -<span> </span><span class="gmail-aBn" tabindex="0" style="border-bottom:1px dashed rgb(204,204,204)"><span class="gmail-aQJ" style="top: 2px; z-index: -1;">16 MAY 2018</span></span></strong></p><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">We have diagnosed a MAC address flooding issue which was affecting connectivity for a number of our clients. We have implemented a temporary control to resolve the impact.<span> </span><br>This temporary control was implemented just over an hour ago and since then we have not seen any reoccurrence of the issue and all ports remain enabled. We will continue to closely monitor the situation as we implement a permanent resolution to the issue.<span> </span></div>
<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 16, 2018 at 12:54 PM, Nick Pron via Outages <span dir="ltr"><<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_2218064838507105889WordSection1">
<p class="MsoNormal">Might be an attack of some sort. We pressured our rep and he seemed to point it at a security issue, but wasn’t able to give any more details.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Their latest update seems to confirm it:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Update 12:43 EDT Hrs - 16 MAY 2018<u></u><u></u></p>
<p class="MsoNormal">The Cogeco Peer 1 Networking team and our equipment partner, Cisco, have been enabling additional
<b><span style="color:red">security features</span></b><span style="color:red"> </span>
on the affected switch. We continue to monitor the success of that feature and will send an update once we have more information available.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>From:</b> Outages [mailto:<a href="mailto:outages-bounces@outages.org" target="_blank">outages-bounces@<wbr>outages.org</a>] <b>
On Behalf Of </b>Mike Dresser via Outages<br>
<b>Sent:</b> Wednesday, May 16, 2018 12:39 PM<br>
<b>To:</b> <a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a> List <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>></p><div><div class="h5"><br>
<b>Subject:</b> Re: [outages] Cogeco - Toronto outage?<u></u><u></u></div></div><p></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Appears they're having some bigger issues, I couldn't reach
<a href="http://www.esasafe.com" target="_blank">www.esasafe.com</a> from a Cogeco business fiber line, but could from a connection that is based off cogeco's cable network(<a href="http://start.ca" target="_blank">start.ca</a>). MTR got completely lost on the fiber link(stops two hops past
<a href="http://burl-ts1.cgocable.net" target="_blank">burl-ts1.cgocable.net</a>, with heavy(8-10%) packet loss from that point on), but made it to Rogers (the hoster of
<a href="http://esasafe.com" target="_blank">esasafe.com</a>) from the home connection just fine.<u></u><u></u></p>
</div>
<p class="MsoNormal">Just retested after typing the above up and it appears to work again, so they're having some issues.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, May 16, 2018 at 9:20 AM, Nick Pron via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">LAN type. That’s what it seems like.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We did notice that a customer we have on ICA we can’t reach them as one of the hops goes through Cogeco
<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Paul Stewart [mailto:<a href="mailto:paul@paulstewart.org" target="_blank">paul@paulstewart.org</a>]
<br>
<b>Sent:</b> Wednesday, May 16, 2018 8:57 AM<br>
<b>To:</b> Nick Pron <<a href="mailto:Nick.Pron@xbase.com" target="_blank">Nick.Pron@xbase.com</a>>;
<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a> List <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>><br>
<b>Subject:</b> Re: [outages] Cogeco - Toronto outage?<u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Is the NNI with them for LAN type services or is it TPIA? We have both and are not experiencing any issues so sounds like possibly the demarcation switch you are connected to possibly
….<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Paul<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span lang="EN-CA" style="font-size:12.0pt;color:black">From:
</span></b><span lang="EN-CA" style="font-size:12.0pt;color:black">Outages <</span><a href="mailto:outages-bounces@outages.org" target="_blank"><span lang="EN-CA" style="font-size:12.0pt">outages-bounces@outages.org</span></a><span lang="EN-CA" style="font-size:12.0pt;color:black">>
on behalf of Nick Pron via Outages <</span><a href="mailto:outages@outages.org" target="_blank"><span lang="EN-CA" style="font-size:12.0pt">outages@outages.org</span></a><span lang="EN-CA" style="font-size:12.0pt;color:black">><br>
<b>Reply-To: </b>Nick Pron <</span><a href="mailto:Nick.Pron@xbase.com" target="_blank"><span lang="EN-CA" style="font-size:12.0pt">Nick.Pron@xbase.com</span></a><span lang="EN-CA" style="font-size:12.0pt;color:black">><br>
<b>Date: </b>Wednesday, May 16, 2018 at 8:54 AM<br>
<b>To: </b>"</span><a href="mailto:outages@outages.org%20List" target="_blank"><span lang="EN-CA" style="font-size:12.0pt">outages@outages.org List</span></a><span lang="EN-CA" style="font-size:12.0pt;color:black">" <</span><a href="mailto:outages@outages.org" target="_blank"><span lang="EN-CA" style="font-size:12.0pt">outages@outages.org</span></a><span lang="EN-CA" style="font-size:12.0pt;color:black">><br>
<b>Subject: </b>[outages] Cogeco - Toronto outage?</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-CA"> </span><u></u><u></u></p>
</div>
<p class="MsoNormal"><a name="m_2218064838507105889_m_7369072815452903611__MailOriginalBody"><span lang="EN-CA">Anyone have info about this? We’ve been having issues with our NNI since Monday with our customers (down, packet
loss, etc)</span></a><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">Cogeco’s master tickets 718506 and 719701 claim they’ve swapped line cards in a core switch, upgraded IOS and still working with Cisco.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">Our rep seems to hint at that there’s more at play here than the tickets are saying..</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">Last update from them was 7:35 AM EDT</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">Unfortunately, we have seen further instability on the affected network device and are continuing to work with our Cisco partner to isolate the issue and implement
a restoration plan. </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">We are still unable to provide an estimated time to restore but we will provide further updates as soon as more information becomes available.
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">Once again we apologize for any disruption to your services that this may be causing.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-CA">______________________________<wbr>_________________ Outages mailing list
</span><a href="mailto:Outages@outages.org" target="_blank"><span lang="EN-CA">Outages@outages.org</span></a>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank"><span lang="EN-CA">https://puck.nether.net/<wbr>mailman/listinfo/outages</span></a>
<u></u><u></u></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
______________________________<wbr>_________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/<wbr>mailman/listinfo/outages</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/<wbr>mailman/listinfo/outages</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div style="font-size:12.8px;color:rgb(136,136,136)"><b><font face="arial, helvetica, sans-serif">Laurent Dumont</font></b></div><div style="font-size:12.8px;color:rgb(136,136,136)"><i style="font-size:12.8px;color:rgb(34,34,34)"><font color="#888888">Spécialiste réseau / Network specialist</font></i><br></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif"><b style="color:rgb(34,34,34)"><font color="#444444">Fibre</font><font color="#6aa84f">noire</font></b> - <a href="http://www.fibrenoire.ca/" style="color:rgb(0,0,204)" target="_blank">www.fibrenoire.ca</a></font></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif">A: 550<div style="display:inline">, avenue </div>Beaumont, <div style="display:inline">bureau</div> 320, <div style="display:inline">Montréal (Québec)</div> H3N 1V1</font></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif">T. 514 907-3002 x132</font></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif">C.438-825-4642</font></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif" style="color:rgb(17,85,204)">ldumont<a href="mailto:farchambault@fibrenoire.ca" style="color:rgb(17,85,204)" target="_blank">@fibrenoire.ca</a></font></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif">Twitter: <a href="https://twitter.com/fibrenoire" target="_blank">Twitter Fibrenoire</a></font><br></div><div style="font-size:12.8px;color:rgb(136,136,136)"><font face="arial, helvetica, sans-serif"><br></font></div><div style="font-size:12.8px"><font face="arial, helvetica, sans-serif" size="1" color="#666666"><i>--Note de confidentialité--</i></font></div><div style="font-size:12.8px"><font face="arial, helvetica, sans-serif" size="1" color="#666666"><i><br></i></font></div><div style="font-size:12.8px"><font size="1" face="arial, helvetica, sans-serif" color="#666666"><i>Ce message électronique et toutes pièces jointes contiennent des informations privilégiées et confidentielles. Si vous n'êtes pas le destinataire prévu, il est strictement interdit d'utiliser, de copier ou divulguer les informations ainsi transmises; merci d'en aviser l'expéditeur et de les supprimer de votre ordinateur.</i></font></div><div style="font-size:12.8px"><font size="1" face="arial, helvetica, sans-serif" color="#666666"><i><br></i></font></div><div style="font-size:12.8px"><font size="1" face="arial, helvetica, sans-serif" color="#666666"><i>--Confidentiality Note--</i></font></div><div style="font-size:12.8px"><font size="1" face="arial, helvetica, sans-serif" color="#666666"><i><br></i></font></div><div style="font-size:12.8px"><font size="1" face="arial, helvetica, sans-serif" color="#666666"><i>This email message and any attachments contain privileged and confidential information. If you are not the intended recipient, your use, copying or disclosure of this information is prohibited; please contact the sender and delete the material from your computer.</i></font></div></div></div></div></div></div></div>
</div>