<div dir="ltr">outgoing works for us.<br clear="all"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><font size="2"><br></font></div><div><font size="2"><br></font></div><div><font size="2">Aryn Nakaoka<br><a href="mailto:anakaoka@trinet-hi.com" target="_blank">anakaoka@trinet-hi.com</a><br>Direct: 808.356.2901<br></font></div><div><font size="2">518 Holokahana Lane</font></div><div>Honolulu, Hi<font size="2"> 96817<br></font></div><div><div><div><font size="2"><br></font></div><font size="2">AlohaTone Mobile: <a href="https://youtu.be/PdUyuf0hTYY" target="_blank">https://youtu.be/PdUyuf0hTYY</a></font></div><div><font size="2"><br></font></div><div><font size="2">A Better Solution <a href="https://www.trinet-hi.com/abettersolution.pdf" target="_blank">https://www.trinet-hi.com/abettersolution.pdf <br></a></font><div><font size="2">Aloha Tone PBX <a href="https://www.youtube.com/watch?v=96YWPY9wCeU" target="_blank">https://www.youtube.com/watch?v=96YWPY9wCeU</a><br></font></div><div><font size="2"><br></font></div></div><div><div><font size="2">CONFIDENTIALITY NOTICE: The information contained in this email and any attachments may be privileged, confidential and protected from disclosure. Any disclosure, distribution or copying of this email or any attachments by persons or entities other than the intended recipient is prohibited. If you have received this email in error, please notify the sender immediately by replying to the message and deleting this email and any attachments from your system. Thank you for your cooperation.<br></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Sep 29, 2021 at 9:12 AM Brandon Svec via VoiceOps <<a href="mailto:voiceops@voiceops.org">voiceops@voiceops.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:monospace,monospace">Definitely losing customers rapidly. I just got this update from a company that uses them. I don't really want to name them, but this is part of service status update email they just sent out-</div><div class="gmail_default" style="font-family:monospace,monospace"><br></div><div class="gmail_default" style="font-family:monospace,monospace"><p style="font-family:Arial,Helvetica,sans-serif">Here is what has been done:</p><p style="font-family:Arial,Helvetica,sans-serif">1. Began testing the transition of numbers to a different carrier early morning 9/28/21. That test was very successful.</p><p style="font-family:Arial,Helvetica,sans-serif">2. All toll-free numbers have transitioned to the new carrier.</p><p style="font-family:Arial,Helvetica,sans-serif">3. 64,000 DIDs were moved yesterday to an alternate carrier.</p><p style="font-family:Arial,Helvetica,sans-serif">4. Several hundred thousand additional DIDs are staged to move in an orderly sequence by end of day.</p></div><div><div dir="ltr"><div dir="ltr"><table width="300" border="0" style="font-size:12.8px"><tbody><tr><td style="font-family:"Courier New",Courier,monospace;font-stretch:normal;font-size:12px;padding-top:15px;padding-bottom:10px;border-top:1px solid rgb(255,255,255)"><strong><font color="#000000">Brandon Svec</font></strong><font color="#000000"> </font><font color="#000000"><br></font><b><a href="tel:15106862204" value="+15106862204" style="color:rgb(17,85,204)" target="_blank">15106862204</a> voice|sms<br></b><span style="color:rgb(29,2,153)"><strong><a href="https://teamonesolutions.com/" style="color:rgb(17,85,204)" target="_blank">teamonesolutions.com</a></strong> </span></td></tr></tbody></table></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Sep 29, 2021 at 11:09 AM Mark Wiles <<a href="mailto:mwiles@akabis.com" target="_blank">mwiles@akabis.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US" style="overflow-wrap: break-word;">
<div>
<p class="MsoNormal">While we all might love to know what they’ve done to TRY to mitigate the issue; it’s reasonable to assume that they’d be fairly quiet about what they’re doing/trying to do. Right now, I’d rather them keep a low profile and simply get the
issue addressed. You know they’re hemorrhaging customers left-and-right due to port-aways.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div style="border-style:solid none none;border-top-width:1pt;border-top-color:rgb(225,225,225);padding:3pt 0in 0in">
<p class="MsoNormal"><b>From:</b> VoiceOps <<a href="mailto:voiceops-bounces@voiceops.org" target="_blank">voiceops-bounces@voiceops.org</a>> <b>On Behalf Of
</b>Ryan Delgrosso<br>
<b>Sent:</b> Wednesday, September 29, 2021 1:52 PM<br>
<b>To:</b> <a href="mailto:voiceops@voiceops.org" target="_blank">voiceops@voiceops.org</a><br>
<b>Subject:</b> Re: [VoiceOps] Bandwidth - Monday Outage<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<p>FYI a pretty weak but publicly referencable acknowledgement of whats going on<u></u><u></u></p>
<p><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.bandwidth.com%2fblog%2fa-message-to-our-customers-and-partners%2f&c=E,1,owS2cVWZA1WGtGMAEPu5Ti5eAX1FOEqqPpmk_aMkLeDVGUmFu8zbe-bfN7-I3BmpNDZJ3qFWqtTezgSk_R_ZotZ43dLmcgYlB_u6Qh-e-AkGRe0,&typo=1" target="_blank">https://www.bandwidth.com/blog/a-message-to-our-customers-and-partners/</a><u></u><u></u></p>
<p><u></u> <u></u></p>
<div>
<p class="MsoNormal">On 9/29/2021 10:37 AM, Pete Eisengrein wrote:<u></u><u></u></p>
</div>
<blockquote style="margin-top:5pt;margin-bottom:5pt">
<div>
<p class="MsoNormal">They have publicly acknowledge it as a DDoS ( <a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.bandwidth.com%2fblog%2fa-message-to-our-customers-and-partners%2f&c=E,1,uAmO5u5c6u8d8fA2aiZUY71pe5rUngX8otVxHtppAMoqMT4mPT6x-kUwGStbW61Br73eiJFUz_ELBDJljCzgYb-3jTJ4oRlE2hKikfXw-w,,&typo=1" target="_blank">
https://www.bandwidth.com/blog/a-message-to-our-customers-and-partners/</a> ) , but being pretty tight-lipped with specifics on what it is or how they are mitigating. <u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Wed, Sep 29, 2021 at 12:29 PM Carlos Alvarez <<a href="mailto:caalvarez@gmail.com" target="_blank">caalvarez@gmail.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Is this some sort of ransom event against them maybe? And what are the rest of you telling your customers? We seem to have only a few specifically complaining, but those are complaining a lot.
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Tue, Sep 28, 2021 at 11:06 PM Ivan Kovacevic <<a href="mailto:ivan.kovacevic@startelecom.ca" target="_blank">ivan.kovacevic@startelecom.ca</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12pt">Happening again. <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12pt"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12pt"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fstatus.bandwidth.com%2f&c=E,1,WolwFQSZ1OSs3rjO6hgO6OvRKpAzNrbIinIqdFrjiYR6iDxcrIaOmjTwQjb8h9dH4srU-RncK8II-R8Nr7Hs6VVXDGoF_4tEQzedk5uxxsq3FSj8yodwABlgng,,&typo=1" target="_blank">https://status.bandwidth.com/</a><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12pt"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12pt"><u></u> <u></u></span></p>
</div>
<div>
<div>
<div>
<table border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td width="10" valign="top" style="width:7.5pt;padding:7.5pt 22.5pt 0in 7.5pt">
<p><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u><u></u></span></a></p>
</td>
<td valign="top" style="border-style:none solid none none;border-right-width:1pt;border-right-color:rgb(177,177,177);padding:0in">
</td>
<td valign="top" style="padding:0in 0in 0in 15pt">
<p><b><span style="font-size:10.5pt;font-family:"Trebuchet MS",sans-serif;color:rgb(51,51,51)"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:rgb(51,51,51);text-decoration:none">Ivan
Kovacevic</span><span style="font-size:9pt;color:rgb(173,173,173);font-weight:normal;text-decoration:none"><br>
</span><i><span style="font-size:7.5pt;color:rgb(153,153,153);font-weight:normal;text-decoration:none">Co-Founder and VP Client Services</span></i><span style="font-size:11pt;font-family:Calibri,sans-serif;color:windowtext;font-weight:normal;text-decoration:none"><u></u><u></u></span></a></span></b></p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
<div>
<div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">On
Mon, Sep 27, 2021 at 10:19 PM Peter Beckman via VoiceOps <<u><span style="color:blue">voiceops@voiceops.org</span></u>> wrote:<u></u><u></u></span></a></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">On
Mon, 27 Sep 2021, Ryan Delgrosso wrote:<br>
<br>
> Nothing meaningful other than the normal public party line.<br>
><br>
> I too have heard unofficially that its DDOS, which makes sense given the <br>
> recurring nature.<br>
><br>
> 4.5hrs down Sat<br>
<br>
Our monitoring showed 2 hours 47 minutes of actual service affecting<br>
outages across Voice (Inbound and Outbound), Messaging, and API/Portal.<br>
<br>
The issue started at 3pm and recovered at 5:47pm EDT. We reported it to<br>
the TAC at 3:07pm, they did not post on Status until 3:31pm.<br>
<br>
> Some small downtime Sun<br>
><br>
> Now deep into Monday with problems.<br>
><br>
> Its not a good look, but id like some more transparency.<br>
<br>
DDoS attacks are real and hard to null route. You've got millions of IP<br>
addresses slamming you with data. Your router has a capacity, and your<br>
router cannot handle all of that extra crap data along with all of our<br>
traffic too.<br>
<br>
I'm sure BW will be investing in some beefy hardware that will be able to<br>
better handle DDoS attacks, as well as working more closely with their<br>
peering providers. I have to assume that they were getting gigabits of<br>
traffic, overwhelming their links in addition to their edge routers.<br>
<br>
Cloudflare details how they do it here:<br>
<u><span style="color:blue">https://support.cloudflare.com/hc/en-us/articles/200172676-Understanding-Cloudflare-DDoS-protection</span></u><br>
<br>
Not much to be transparent about. The Internet is an unfriendly place, and<br>
bad actors can rain hell upon any public IP they want. Unsecured laptops,<br>
desktops, TVs, IOT devices, etc, all contribute just a little tiny bit,<br>
and all focus on one single point, kinda like those giant solar farms with<br>
the mirrors and single tower in the middle to boil the molten salt.<br>
<br>
Well, Bandwidth is the molten salt, and the mirrors are a bunch of<br>
unsecured devices on the Internet.<br>
<br>
---------------------------------------------------------------------------<br>
Peter Beckman Internet Guy<br>
<u><span style="color:blue">beckman@angryox.com</span></u>
<u><span style="color:blue">https://www.angryox.com/</span></u><br>
---------------------------------------------------------------------------_______________________________________________<br>
VoiceOps mailing list<br>
<u><span style="color:blue">VoiceOps@voiceops.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/voiceops</span></u><br>
_______________________________________________<br>
VoiceOps mailing list<br>
<u><span style="color:blue">VoiceOps@voiceops.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/voiceops</span></u><u></u><u></u></span></a></p>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u><u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
<p><span style="font-size:10pt"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">NOTE:
This email message and any attachments are for the sole use of the intended recipient(s) and may contain confidential and/or privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient,
please contact the sender by replying to this email, and destroy all copies of the original message.</span><span style="font-size:11pt;color:windowtext;text-decoration:none"><u></u><u></u></span></a></span></p>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">_______________________________________________<br>
VoiceOps mailing list<br>
<u><span style="color:blue">VoiceOps@voiceops.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/voiceops</span></u><u></u><u></u></span></a></p>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">_______________________________________________<br>
VoiceOps mailing list<br>
<u><span style="color:blue">VoiceOps@voiceops.org</span></u><br>
<u><span style="color:blue">https://puck.nether.net/mailman/listinfo/voiceops</span></u><u></u><u></u></span></a></p>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<br>
<u></u><u></u></span></a></p>
<pre><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">_______________________________________________<u></u><u></u></span></a></pre>
<pre><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none">VoiceOps mailing list<u></u><u></u></span></a></pre>
<pre><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u><span style="color:blue">VoiceOps@voiceops.org</span></u><u></u><u></u></span></a></pre>
<pre><a href="https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fwww.startelecom.ca%2f&c=E,1,z1xMwqyQSba2tIyKk3epfyt83pf2_1tWCHxSK_gEIhOKhqWf0AI2Pjim0jG0f0GhZfi9CRSrv_uuignvRskhETaKKEng-Jqv74-nf4cdBQ,,&typo=1" target="_blank"><span style="color:windowtext;text-decoration:none"><u><span style="color:blue">https://puck.nether.net/mailman/listinfo/voiceops</span></u><u></u><u></u></span></a></pre>
</blockquote>
</div>
</div>
_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank">VoiceOps@voiceops.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/voiceops" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/voiceops</a><br>
</blockquote></div></div>
_______________________________________________<br>
VoiceOps mailing list<br>
<a href="mailto:VoiceOps@voiceops.org" target="_blank">VoiceOps@voiceops.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/voiceops" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/voiceops</a><br>
</blockquote></div>