<div dir="ltr"><div class="gmail_default" style="font-family:arial,sans-serif;font-size:small;color:rgb(0,0,0)">and i can confirm this is also ongoing for my clients</div><div class="gmail_default" style="font-family:arial,sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,sans-serif;font-size:small;color:rgb(0,0,0)">Is anyone from verizon/alter online ? </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 18, 2020 at 10:57 AM David Rubin <<a href="mailto:drubin@cubexgroup.com">drubin@cubexgroup.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Yup - I have multiple clients complaining - same exact thing - VPN drops - remote dies - have to reconnect - repeatedly. Driving them crazy - me too :)</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 18, 2020 at 10:49 AM Matthew Huff <<a href="mailto:mhuff@ox.com" target="_blank">mhuff@ox.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div>
<p class="MsoNormal">We have opened a case with CenturyLink/Level3 to see if they can put pressure on Verizon. It’s wrecking havoc with our Voip and VPN/Remote desktops.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>From:</b> Outages-discussion <<a href="mailto:outages-discussion-bounces@outages.org" target="_blank">outages-discussion-bounces@outages.org</a>>
<b>On Behalf Of </b>David Rubin<br>
<b>Sent:</b> Thursday, June 18, 2020 10:24 AM<br>
<b>To:</b> Cary Wiedemann <<a href="mailto:carywiedemann@gmail.com" target="_blank">carywiedemann@gmail.com</a>><br>
<b>Cc:</b> <a href="mailto:outages-discussion@outages.org" target="_blank">outages-discussion@outages.org</a><br>
<b>Subject:</b> Re: [Outages-discussion] [outages] Fios in NYC area?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">I'm still having users reporting issues today - do we know if this is ongoing / if Verizon is aware of what's going on? I'm guessing they aren't - because why would they be?<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Wed, Jun 17, 2020 at 6:40 PM Cary Wiedemann via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">I've definitely seen loss from FiOS circuits in Manhattan and Long Island to many routes (examples: AT&T and Cox, but not Google's local 8.8.8.8 resolver) starting around 8:45pm EDT last night.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Some graphs:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">24-hour Long Island FiOS to Cox:<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"><img border="0" width="561" height="87" style="width: 5.8437in; height: 0.9062in;" id="gmail-m_-7829523903937630231gmail-m_-467566557401573385_x0000_i1025" src="cid:172c7ea31954cff311" alt="image.png"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2-hour Long Island FiOS to Cox:<u></u><u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><img border="0" width="561" height="87" style="width: 5.8437in; height: 0.9062in;" id="gmail-m_-7829523903937630231gmail-m_-467566557401573385_x0000_i1026" src="cid:172c7ea31955b16b22" alt="image.png"><u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal">2-hour Manhattan to FiOS to AT&T:<u></u><u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><img border="0" width="561" height="85" style="width: 5.8437in; height: 0.8854in;" id="gmail-m_-7829523903937630231gmail-m_-467566557401573385_x0000_i1027" src="cid:172c7ea3195692e333" alt="image.png"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">And of course New York is one of the IPv6 FiOS regions that broke traditional traceroute, so it's tougher than normal to nail down which router is the culprit. I have some UDP MTRs running now which should hopefully answer that question.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I've seen several days of high latency and intermittent loss to many Verizon peers via their old
<a href="http://ALTER.NET" target="_blank">ALTER.NET</a> routers in the DC region too, which may or may not be related.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">No, it's not just you. But it's not the last-mile FiOS either. Looks like Verizon backbone routing woes.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">- Cary<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12pt"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Wed, Jun 17, 2020 at 5:13 PM Izzy Goldstein - TeleGo via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:12pt;font-family:Arial,sans-serif;color:black">getting complaints from customers using FiOS of packet loss to our data center<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12pt;font-family:Arial,sans-serif;color:black">but getting word there is an issue in NYC area with other data centers too?<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in 0in 0.0001pt"><b><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">Izzy Goldstein </span></b><span style="font-size:9.5pt"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt"><i><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">Chief Technology Officer </span></i><span style="font-size:9.5pt"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">Main:
</span><u><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)"><a href="tel:(212)%20477-1000" target="_blank"><span style="color:rgb(17,85,204)">(212) 477-1000 x 2085</span></a></span></u><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">
</span><span style="font-size:9.5pt"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">Direct:
</span><u><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)"><a href="tel:(929)%20477-2085" target="_blank"><span style="color:rgb(17,85,204)">(929) 477-2085</span></a></span></u><span style="font-size:9.5pt"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt;background:white;text-align:start;word-spacing:0px">
<span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">Website:</span><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">
</span><span style="font-size:9.5pt;font-family:Arial,sans-serif;color:rgb(34,34,34)"><a href="http://www.telego.net/" target="_blank"><span style="font-size:10pt;color:rgb(17,85,204)">www.telego.com</span></a></span><span style="font-size:10pt;font-family:Arial,sans-serif;color:rgb(67,67,67)">
</span><span style="font-size:9.5pt;font-family:Arial,sans-serif;color:rgb(34,34,34)"><u></u><u></u></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:9.5pt"><u></u> <u></u></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:9.5pt"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u><u></u></span></a></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:9.5pt"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></span></p>
<p style="margin:0in 0in 0.0001pt"><i><span style="font-size:8pt;font-family:Arial,sans-serif;color:rgb(153,153,153)"><a href="http://www.telego.com/" target="_blank"><span style="color:rgb(153,153,153);text-decoration:none">Confidentiality Notice: This e-mail may
contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the
material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and
not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any
liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising.</span><span style="font-size:9.5pt;font-family:Calibri,sans-serif;color:windowtext;font-style:normal;text-decoration:none"><u></u><u></u></span></a></span></i></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:9.5pt"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<u><span style="font-size:11pt;font-family:Arial,sans-serif;color:rgb(17,85,204)">TeleGo Hosted PBX</span></u><u></u><u></u></span></a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none">_______________________________________________<br>
Outages mailing list<br>
<u><span style="color:blue">Outages@outages.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/outages</span></u><u></u><u></u></span></a></p>
</blockquote>
</div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none">_______________________________________________<br>
Outages mailing list<br>
<u><span style="color:blue">Outages@outages.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/outages</span></u><u></u><u></u></span></a></p>
</blockquote>
</div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><br clear="all">
<u></u><u></u></span></a></p>
<div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none">--
<u></u><u></u></span></a></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none">David Rubin <u></u><u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none">Cubex Group
<br>
223 Wall Street - PMB #267 <br>
Huntington, NY 11743 <br>
646.221.3283<u></u><u></u></span></a></p>
</div>
<div>
<div>
<p class="MsoNormal"><a href="http://www.telego.com/" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<div>
<p class="MsoNormal"><b><span style="color:red"><a href="http://www.telego.com/" target="_blank"><span style="color:red;text-decoration:none">If you have a support-related issue, please email to
<u><span style="color:blue">support@cubexgroup.com</span></u>.</span><span style="color:windowtext;font-weight:normal;text-decoration:none"><u></u><u></u></span></a></span></b></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>David Rubin <br></div>Cubex Group <br>223 Wall Street - PMB #267 <br>Huntington, NY 11743 <br><span style="display:inline;font-size:inherit;padding:0pt"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice"><span title="Call with Google Voice">646.221.3283</span></span></span></span></span></span></span></span></span></span></span></span></span></span></span></div><div dir="ltr"><div><br></div><div><b><font color="#ff0000">If you have a support-related issue, please email to <a href="mailto:support@cubexgroup.com" target="_blank">support@cubexgroup.com</a>.</font></b></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
_______________________________________________<br>
Outages-discussion mailing list<br>
<a href="mailto:Outages-discussion@outages.org" target="_blank">Outages-discussion@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages-discussion" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><span style="font-size:12.8px"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;font-weight:700;vertical-align:baseline;white-space:pre-wrap">Izzy Goldstein </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;font-style:italic;vertical-align:baseline;white-space:pre-wrap">Chief Technology Officer </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Main: </span><span style="font-size:13.3333px;font-family:arial;color:rgb(17,85,204);background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap"><a href="tel:(212)%20477-1000" value="+12124771000" style="color:rgb(17,85,204)" target="_blank">(212) 477-1000 x 2085</a></span><span style="font-size:13.3333px;font-family:arial;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Direct: </span><span style="font-size:13.3333px;font-family:arial;color:rgb(17,85,204);background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap"><a href="tel:(929)%20477-2085" value="+19294772085" style="color:rgb(17,85,204)" target="_blank">(929) 477-2085</a></span></p><p dir="ltr" style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-style:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Website:</span><span style="font-size:13.3333px;font-family:arial;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><a href="http://www.telego.net/" style="color:rgb(17,85,204);text-decoration:none" target="_blank"><span style="font-size:13.3333px;font-family:arial;background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">www.telego.com</span></a><span style="font-size:13.3333px;font-family:arial;color:rgb(67,67,67);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:12.8px"></span><span style="font-size:12.8px"><br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><a href="http://www.telego.com/" style="color:rgb(17,85,204);text-decoration:none" target="_blank"><span style="font-size:13.3333px;font-family:arial;background-color:transparent;font-weight:700;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap"><img src="https://lh4.googleusercontent.com/Ze7NkT2QtotXfVWbpWXrpSMRIcAdqb0Ci0_RZsAjQzmRrd-_v02-O86QlqwZnGUE8SlBECXBvJUPXSH7ZRyDvDVeaXQFSS5SiA4gan112DN-0s2D3prRdt2UeUprZQEo1YmUFfZ7" width="182" height="54" style="border: none;"></span></a></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:12.8px"><br></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10.6667px;font-family:arial;color:rgb(153,153,153);font-style:italic;vertical-align:baseline;white-space:pre-wrap">Confidentiality Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising.</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:12.8px"><br></span><a href="https://youtu.be/DaT8YAZ4V0w" style="color:rgb(17,85,204);font-size:12.8px;text-decoration:none" target="_blank"><span style="font-size:14.6667px;font-family:arial;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">TeleGo Hosted PBX</span></a><br></p></span></div></div></div></div></div></div></div></div></div></div></div></div>