<p dir="ltr">Yup, we had level 3 circuits drop in UK, Japan, Australia and US. Looks like a very widespread issues. Has cleared up for us here.</p>
<p dir="ltr">Cheers,<br>
Ashley Tayles</p>
<div class="gmail_extra"><br><div class="gmail_quote">On 2 Nov 2016 15:40, "Ben Montour via Outages" <<a href="mailto:outages@outages.org">outages@outages.org</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Seeing the same thing on a Level3 Amsterdam, NL circuit. Dropped 14:51 UTC, recovered 14:53 UTC.<div class="gmail_extra"><br clear="all"><div><div class="m_8786268768597839855m_5992825347232931752gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">
<div title="Page 1">
<div><span style="font-family:Arial;font-weight:700;color:rgb(105,105,105)"><font size="2">Ben Montour<br></font></span></div><div><font size="2"><span style="font-family:Arial;font-weight:700;color:rgb(105,105,105)">Network Engineer</span><span style="font-family:Arial;font-weight:700;color:rgb(105,105,105)"><br></span></font></div><div><font size="2"><span style="font-family:Arial;font-weight:700;color:rgb(105,105,105)">Workiva</span><br><br></font></div><div><font size="2"><br></font></div></div></div></div></div></div></div></div></div></div></div></div></div><div class="gmail_quote">On Wed, Nov 2, 2016 at 10:32 AM, Max Mühlbronner via Outages <span dir="ltr"><<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-cite-prefix">We also had slight issues in Germany
via GBLX (level3) starting around the time when it was first
reported here. Probably no coincidence...<br>
<br>
BR<br>
<br>
Max M.<span><br>
<br>
On 02.11.2016 16:13, Neil Robst via Outages wrote:<br>
</span></div>
<blockquote type="cite">
<pre>I had a brief out on a TW/L3 P2P circuit in San Diego, CA at 7:52am Pacific. Coincidence? Seems odd, to me, that there was such a widespread brief incident?
Neil
From: Outages <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages-bounces@outages.org" target="_blank">outages-bounces@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages-bounces@outages.org" target="_blank"><m<wbr>ailto:outages-bounces@outages.<wbr>org></a>> on behalf of "<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages@outages.org" target="_blank"><mailto:ou<wbr>tages@outages.org></a>" <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages@outages.org" target="_blank"><mailto:ou<wbr>tages@outages.org></a>>
Reply-To: Jayson Navitsky <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:jnavitsky@gmail.com" target="_blank">jnavitsky@gmail.com</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:jnavitsky@gmail.com" target="_blank"><mailto:jn<wbr>avitsky@gmail.com></a>>
Date: Wednesday, November 2, 2016 at 8:01 AM
To: Brad Riemann <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:briemann@nmi.com" target="_blank">briemann@nmi.com</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:briemann@nmi.com" target="_blank"><mailto:briem<wbr>ann@nmi.com></a>>
Cc: "<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages@outages.org" target="_blank"><mailto:ou<wbr>tages@outages.org></a>" <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages@outages.org" target="_blank"><mailto:ou<wbr>tages@outages.org></a>>
Subject: Re: [outages] TW/Level 3 issues?
Confirmed - we saw some MPLS circuits drop between NJ, NY and Houston along with some IP circuits BGP sessions drop in NYC.Looks like it's clearing up now.
On Wed, Nov 2, 2016 at 10:57 AM, Brad Riemann via Outages <<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:outages@outages.org" target="_blank"><mailto:ou<wbr>tages@outages.org></a>> wrote:
Anyone seeing anything, have links with high (80-100%) packetloss in DC and Chicago, our P2P just dropped as well.
[<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-freetext" href="https://ci3.googleusercontent.com/proxy/MI3Tr0-S1A9lnN4pbtzF7dl0IN4-Vcue5z3XqIWdQQR4sDljaGNwzEaPyLYO0ThmlKci55t-7Fg49PW-J3pRM0Mm=s0-d-e1-ft#https://www.nmi.com/images/nmi-signature.png" target="_blank">https://ci3.googleusercontent<wbr>.com/proxy/MI3Tr0-S1A9lnN4pbtz<wbr>F7dl0IN4-Vcue5z3XqIWdQQR4sDlja<wbr>GNwzEaPyLYO0ThmlKci55t-<wbr>7Fg49PW-J3pRM0Mm=s0-d-e1-ft#<wbr>https://www.nmi.com/images/nmi<wbr>-signature.png</a>]
Brad Riemann
Senior Systems and Network Engineer
Tel: <a href="tel:847.352.4850%20x125" value="+18473524850" target="_blank">847.352.4850 x125</a><tel:847.352.4850%20x125>
<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:briemann@nmi.com" target="_blank">briemann@nmi.com</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:briemann@nmi.com" target="_blank"><mailto:briema<wbr>nn@nmi.com></a> | <a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="http://www.nmi.com" target="_blank">www.nmi.com</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="http://www.nmi.com/" target="_blank"><http://www.nmi.com<wbr>/></a>
______________________________<wbr>_________________
Outages mailing list
<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-rfc2396E" href="mailto:Outages@outages.org" target="_blank"><mailto:Out<wbr>ages@outages.org></a>
<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-freetext" href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailma<wbr>n/listinfo/outages</a>
</pre><span>
<br>
<fieldset class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521mimeAttachmentHeader"></fieldset>
<br>
<pre>______________________________<wbr>_________________
Outages mailing list
<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-abbreviated" href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a>
<a class="m_8786268768597839855m_5992825347232931752m_-4794640757816228521moz-txt-link-freetext" href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailma<wbr>n/listinfo/outages</a>
</pre>
</span></blockquote>
<br>
<br>
</div>
<br>______________________________<wbr>_________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailma<wbr>n/listinfo/outages</a><br>
<br></blockquote></div><br></div></div>
<br>______________________________<wbr>_________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/<wbr>mailman/listinfo/outages</a><br>
<br></blockquote></div></div>