<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Sep 27, 2021, at 2:31 PM, Jared Geiger <<a href="mailto:jared@compuwizz.net" class="">jared@compuwizz.net</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">It looks like Bandwidth dropped all their BGP peers except NTT, presumably to use NTT's DDoS services.</div></div></blockquote><div><br class=""></div><div>How many do they typically have?</div><br class=""><blockquote type="cite" class=""><div class=""><div dir="ltr" class=""><div class=""><br class=""></div><div class="">As far as peering, Bandwidth offers connectivity via Megaport. Peerless (21808) is on a bunch of Equinix exchanges <a href="https://peeringdb.com/net/16256" class="">https://peeringdb.com/net/16256</a>. Inteliquent (40160) is on some exchanges as well <a href="https://peeringdb.com/net/18236" class="">https://peeringdb.com/net/18236</a>. </div><div class=""><br class=""></div><div class="">I did try and get Peerless to join Coresite Any2East last year because they are in the same building but they said no.</div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Sep 27, 2021 at 11:19 AM Douglas Vought <<a href="mailto:douglas.vought@themsgctr.com" class="">douglas.vought@themsgctr.com</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div class=""><p class="">They are. Several customers have contacted me demanding that I
plug the phone line back in. <br class="">
</p>
<div class="">On 9/27/2021 13:54, Drew Matthews via
Outages wrote:<br class="">
</div>
<blockquote type="cite" class="">
<div dir="ltr" class="">i believe they are having issues again, not sure if
its ddos related. but they are experiencing some major issues. <a href="https://status.bandwidth.com/" target="_blank" class="">https://status.bandwidth.com/</a>
<div class=""><br class="">
</div>
<div class="">
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
Bandwidth teams are also investigating delays with Toll-Free
Messaging at this time along with V2 Voice, Standard Voice,
911 traffic, Portal & API with intermittent service
disruptions.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">13:01</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
We continue to investigate this incident.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">11:57</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
Bandwidth teams are also investigating delayed ports at this
time along with V2 Voice, Standard Voice, 911 traffic,
Portal & API with intermittent service disruptions.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">11:07</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
We continue to investigate this incidnet.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">11:02</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
Bandwidth teams are investigating an incident impacting
Voice, V2 Voice, 911 traffic, Portal & API with
intermittent service disruption.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">10:00</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Update</span> -
Bandwidth teams are investigating an incident impacting
Voice, V2 Voice, and 911 traffic with intermittent service
disruption.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">09:42</var> EDT</small></div>
<div class=""><span style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-weight:700" class="">Investigating</span> -
Bandwidth teams are investigating an incident impacting our
V2 Voice services. Customers may notice intermittent service
disruptions.<br style="box-sizing:border-box" class="">
<small style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-size:0.875rem;line-height:1.33438rem" class="">Sep <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">27</var>, <var style="box-sizing:border-box;margin:0px;padding:0px;border:0px;outline:0px;vertical-align:baseline;background:transparent;font-style:normal" class="">09:12</var> EDT</small></div>
</div>
</div>
<br class="">
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Sun, Sep 26, 2021 at 3:13
PM Peter Beckman via Outages <<a href="mailto:outages@outages.org" target="_blank" class="">outages@outages.org</a>>
wrote:<br class="">
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Again
today, on the heels of the 2h 47m DDoS-related outage
yesterday, right at<br class="">
11:01am US EDT (15:01:28 UTC), our monitoring alerted us to
another incident at<br class="">
Bandwidth. The impact to us was much reduced this time, as we
saw some flapping<br class="">
of their SIP Inbound SBCs, but around 15:20:12 UTC it was
responsive enough to<br class="">
fall below our thresholds.<br class="">
<br class="">
The API started acting up at 14:56:00 UTC, but recovered, and
then has been<br class="">
flapping between OK and degraded since then. As of 21:52 UTC,
the API and<br class="">
Portal/Dashboard are either non-responsive, slow, or degraded.<br class="">
<br class="">
Inbound Voice Traffic has remaind at expected historical
levels throughout.<br class="">
I have not checked on Termination, but it was working earlier
today without<br class="">
issue.<br class="">
<br class="">
Latest from BW <a href="https://status.bandwidth.com/" rel="noreferrer" target="_blank" class="">https://status.bandwidth.com/</a><br class="">
<br class="">
Update - Bandwidth teams have observed expected call
behavior for 911<br class="">
calls. 911 calls are processing as designed and are fully
restored. Teams<br class="">
continue to work on standard voice traffic.<br class="">
<br class="">
Sep 26, 17:20 EDT<br class="">
<br class="">
I question the phrase "processing as designed" which implies
it is not<br class="">
working as the end user expects... odd.<br class="">
<br class="">
Beckman<br class="">
---------------------------------------------------------------------------<br class="">
Peter Beckman
Internet Guy<br class="">
<a href="mailto:beckman@angryox.com" target="_blank" class="">beckman@angryox.com</a>
<a href="https://www.angryox.com/" rel="noreferrer" target="_blank" class="">https://www.angryox.com/</a><br class="">
---------------------------------------------------------------------------<br class="">
_______________________________________________<br class="">
Outages mailing list<br class="">
<a href="mailto:Outages@outages.org" target="_blank" class="">Outages@outages.org</a><br class="">
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank" class="">https://puck.nether.net/mailman/listinfo/outages</a><br class="">
</blockquote>
</div>
<br class="">
<fieldset class=""></fieldset>
<pre class="">_______________________________________________
Outages mailing list
<a href="mailto:Outages@outages.org" target="_blank" class="">Outages@outages.org</a>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank" class="">https://puck.nether.net/mailman/listinfo/outages</a>
</pre>
</blockquote>
</div>
_______________________________________________<br class="">
Outages-discussion mailing list<br class="">
<a href="mailto:Outages-discussion@outages.org" target="_blank" class="">Outages-discussion@outages.org</a><br class="">
<a href="https://puck.nether.net/mailman/listinfo/outages-discussion" rel="noreferrer" target="_blank" class="">https://puck.nether.net/mailman/listinfo/outages-discussion</a><br class="">
</blockquote></div>
_______________________________________________<br class="">Outages-discussion mailing list<br class=""><a href="mailto:Outages-discussion@outages.org" class="">Outages-discussion@outages.org</a><br class="">https://puck.nether.net/mailman/listinfo/outages-discussion<br class=""></div></blockquote></div><br class=""></body></html>