<div dir="auto">All I have I seen is a few reddit threads on it.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Sep 27, 2021, 6:40 PM Mike Hammett <<a href="mailto:voiceops@ics-il.net">voiceops@ics-il.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:arial,helvetica,sans-serif;font-size:10pt;color:#000000">Wow, there really isn't anything anywhere...<br><br><div><span name="x"></span><br><br>-----<br>Mike Hammett<br>Intelligent Computing Solutions<br><a href="http://www.ics-il.com" target="_blank" rel="noreferrer">http://www.ics-il.com</a><br><br><br><br>Midwest Internet Exchange<br><a href="http://www.midwest-ix.com" target="_blank" rel="noreferrer">http://www.midwest-ix.com</a><br><br><span name="x"></span><br></div><br><hr id="m_-3524218444489374583zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From: </b>"Mark Wiles via VoiceOps" <<a href="mailto:voiceops@voiceops.org" target="_blank" rel="noreferrer">voiceops@voiceops.org</a>><br><b>To: </b>"Voiceops.org" <<a href="mailto:voiceops@voiceops.org" target="_blank" rel="noreferrer">voiceops@voiceops.org</a>><br><b>Sent: </b>Monday, September 27, 2021 7:27:02 PM<br><b>Subject: </b>Re: [VoiceOps] Bandwidth - Monday Outage<br><br>
<div>
<p class="MsoNormal">I have been asking myself that question all day… how is this not somehow covered on the news somewhere?</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> VoiceOps <<a href="mailto:voiceops-bounces@voiceops.org" target="_blank" rel="noreferrer">voiceops-bounces@voiceops.org</a>> <b>On Behalf Of
</b>Carlos Alvarez<br>
<b>Sent:</b> Monday, September 27, 2021 8:04 PM<br>
<b>To:</b> Voiceops.org <<a href="mailto:voiceops@voiceops.org" target="_blank" rel="noreferrer">voiceops@voiceops.org</a>><br>
<b>Subject:</b> Re: [VoiceOps] Bandwidth - Monday Outage</p>
</div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">I never watch news, but I would have expected my news cycle addict friends to be asking me by now. Hmm. There have to be some three letter agencies fully involved, too.</p>
<div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal"> </p>
</div>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal">On Mon, Sep 27, 2021 at 4:57 PM Pete Eisengrein <<a href="mailto:peeip989@gmail.com" target="_blank" rel="noreferrer">peeip989@gmail.com</a>> wrote:</p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Bandwidth is a $2.5B publicly traded company... how is this not national news?</p>
</div>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal">On Mon, Sep 27, 2021 at 5:44 PM Ryan Delgrosso <<a href="mailto:ryandelgrosso@gmail.com" target="_blank" rel="noreferrer">ryandelgrosso@gmail.com</a>> wrote:</p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p>Would it? Or would SIP/TLS supplant that? </p>
<p>The VZ VPN requirement was a bad solution to a paranoid delusion that really didnt solve anything.
</p>
<p>As were all being dragged kicking and screaming into TLS based peering for the sake of SHAKEN/STIR why not fully embrace what it provides?
</p>
<div>
<p class="MsoNormal">On 9/27/2021 2:35 PM, Aryn Nakaoka 808.356.2901 wrote:</p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">If its SIP based, Verizon standard to run a VPN would become a norm.
</p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><br clear="all">
</p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">Aryn Nakaoka<br>
<a href="mailto:anakaoka@trinet-hi.com" target="_blank" rel="noreferrer">anakaoka@trinet-hi.com</a><br>
Direct: 808.356.2901</span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">518 Holokahana Lane</span></p>
</div>
<div>
<p class="MsoNormal">Honolulu, Hi<span style="font-size:10.0pt"> 96817</span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> </p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt">AlohaTone Mobile: <a href="https://youtu.be/PdUyuf0hTYY" target="_blank" rel="noreferrer">https://youtu.be/PdUyuf0hTYY</a></span></p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">A Better Solution <a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.trinet-hi.com%2fabettersolution.pdf&c=E,1,vVZhovUZ1o17KCIjdRySxSGEenQpgBmJa1OUz9mbXp2yN6CxWyyk-5149MHEfEtE57QWD_RdV3M7MEjwKndyfpNxMn03p7-JoZIutCmCTrObSLNPBeU,&typo=1" target="_blank" rel="noreferrer">https://www.trinet-hi.com/abettersolution.pdf <br>
</a></span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">Aloha Tone PBX <a href="https://www.youtube.com/watch?v=96YWPY9wCeU" target="_blank" rel="noreferrer">https://www.youtube.com/watch?v=96YWPY9wCeU</a></span></p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">CONFIDENTIALITY NOTICE: The information contained in this email and any attachments may be privileged, confidential and protected from disclosure. Any disclosure, distribution or copying of this email or
any attachments by persons or entities other than the intended recipient is prohibited. If you have received this email in error, please notify the sender immediately by replying to the message and deleting this email and any attachments from your system.
Thank you for your cooperation.</span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"> </p>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal">On Mon, Sep 27, 2021 at 11:27 AM Ryan Delgrosso <<a href="mailto:ryandelgrosso@gmail.com" target="_blank" rel="noreferrer">ryandelgrosso@gmail.com</a>> wrote:</p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">Do we know this is a SIP/RTP targeted volumetric attack and those arent
<br>
just collateral damage in a more plebian attack aimed ad portals/apis or <br>
routers?<br>
<br>
I can understand them being tight lipped but some transparency helps the <br>
situation.<br>
<br>
I wonder if DHS is involved yet?<br>
<br>
On 9/27/2021 1:48 PM, Jay Hennigan via VoiceOps wrote:<br>
> On 9/27/21 13:30, Darren via VoiceOps wrote:<br>
>> I know it’s hard to be patient but I can’t imagine they’re NOT all <br>
>> hands on deck.<br>
>><br>
>> The reality is probably that the DDoS attack is now so big, they <br>
>> can’t handle it on their own, so they’re scrambling to contract out <br>
>> with another provider who can handle it. That would explain why the <br>
>> BGP routes they advertise have shifted. These DDoS products typically <br>
>> take weeks to setup, so they’re likely having to scramble. I’ll be <br>
>> surprised if this does NOT continue tomorrow (unfortunately).<br>
><br>
> From my understanding this is not your typical volumetric DDoS but <br>
> something specific to SIP or VoIP and thus the typical scrubbing <br>
> services aren't going to be effective against the voice side of things.<br>
><br>
> Obviously they are keeping things close to the vest in order not to <br>
> give too much information to the bad guys but I agree that it may take <br>
> some time to resolve.<br>
><br>
>> *From: *VoiceOps <<a href="mailto:voiceops-bounces@voiceops.org" target="_blank" rel="noreferrer">voiceops-bounces@voiceops.org</a>> on behalf of Carlos
<br>
>> Alvarez <<a href="mailto:caalvarez@gmail.com" target="_blank" rel="noreferrer">caalvarez@gmail.com</a>><br>
>> *Date: *Monday, September 27, 2021 at 1:23 PM<br>
><br>
>> Generic SIP client here, and the ongoing "continue to investigate" <br>
>> notices are infuriatingly like "we have no damn clue what we're <br>
>> doing." Try explaining to customers why it's not "our fault*" and <br>
>> that there's no way to estimate a repair time.<br>
><br>
> I think the ongoing "continue to investigate" messages are fine. <br>
> They're obviously dealing with a major incident and trying their best <br>
> to keep their customers informed. This IMHO beats silence.<br>
><br>
>> *Our fault for choosing them I guess, but not something we can fix in <br>
>> minutes.<br>
><br>
> The same thing could and has affected others. <a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fVoip.ms&c=E,1,Fp6Nhg6BP8_CqPyCOWiaM9wOMsCx0CCgsZJDSqGHmgIdSMb0YsiF_gJCAjs0_Y0nT7F9JY-rWJCokZTX57EPLWMlERlN6MAhKatc-HqS4CpBO4xjYJZNCGIK&typo=1&ancr_add=1" target="_blank" rel="noreferrer">
Voip.ms</a> has been dealing <br>
> with a similar attack for at least a week. We've had excellent service <br>
> from Bandwidth for years and I trust that they will be able to get <br>
> through this as well as anyone.<br>
><br>
> It's the nature of the legacy PSTN that redundant providers or fast <br>
> failover for inbound calling isn't (yet) a thing.<br>
><br>
_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank" rel="noreferrer">VoiceOps@voiceops.org</a><br>
<a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fpuck.nether.net%2fmailman%2flistinfo%2fvoiceops&c=E,1,fBHre1MZgNcXdPtFt1TIUULdMwgiKht4aAPAMJhM0mPl_M-VA3vCDSHs7iyZsv7o7gRm6bJWe8PYOuPbS9aAoHnucY8irU_ifD4iwJi_pweM_mtjRYSh&typo=1" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/voiceops</a></p>
</blockquote>
</div>
</blockquote>
</div>
<p class="MsoNormal">_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank" rel="noreferrer">VoiceOps@voiceops.org</a><br>
<a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fpuck.nether.net%2fmailman%2flistinfo%2fvoiceops&c=E,1,WZcKxLiq6YefVsNZy-WVXoKlwjAB2mzajAo9hwFOVEj84NSyMn5vyODLtNELXGBIYbF-5VrLPQGbJ5jtYGCzwvgdTSxHG6gTeDj7lX5Jd8GVUtMrIwxmqOotwhE,&typo=1" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/voiceops</a></p>
</blockquote>
</div>
<p class="MsoNormal">_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank" rel="noreferrer">VoiceOps@voiceops.org</a><br>
<a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fpuck.nether.net%2fmailman%2flistinfo%2fvoiceops&c=E,1,k1fqwfwzE5XRJuMAJvMCFd0Sz9yiToZpt2E_XstZ5VHbaDRO1yqqf0IjlksBmwJNHtR1bahj292vjE-bsXW8lA0hecxy3qeZJKMsFUC22F7GZoO_&typo=1" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/voiceops</a></p>
</blockquote>
</div>
</div>
<br>_______________________________________________<br>VoiceOps mailing list<br><a href="mailto:VoiceOps@voiceops.org" target="_blank" rel="noreferrer">VoiceOps@voiceops.org</a><br><a href="https://puck.nether.net/mailman/listinfo/voiceops" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/voiceops</a><br></div><br></div></div>_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank" rel="noreferrer">VoiceOps@voiceops.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/voiceops" rel="noreferrer noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/voiceops</a><br>
</blockquote></div>