<div dir="ltr">It looks like they just rerouted traffic through another device and I'm able to hit 4.2.2.2 now.<div><br></div><div>Tracing route to <a href="http://b.resolvers.Level3.net">b.resolvers.Level3.net</a> [4.2.2.2]<br>over a maximum of 30 hops:<br><br> 1 <1 ms <1 ms <1 ms gw<br> 2 8 ms 8 ms 7 ms 142.254.150.77<br> 3 24 ms 23 ms 21 ms <a href="http://ae59.nolmoh2201h.midwest.rr.com">ae59.nolmoh2201h.midwest.rr.com</a> [24.164.119.89]<br> 4 9 ms 9 ms 11 ms <a href="http://be23.sgvlohaj01r.midwest.rr.com">be23.sgvlohaj01r.midwest.rr.com</a> [24.33.103.92]<br> 5 14 ms 16 ms 14 ms <a href="http://be11.clevohek02r.midwest.rr.com">be11.clevohek02r.midwest.rr.com</a> [65.29.1.97]<br> 6 16 ms 15 ms 15 ms <a href="http://be25.clevohek01r.midwest.rr.com">be25.clevohek01r.midwest.rr.com</a> [65.29.1.32]<br> 7 38 ms 39 ms 39 ms <a href="http://bu-ether17.vinnva0510w-bcr00.tbone.rr.com">bu-ether17.vinnva0510w-bcr00.tbone.rr.com</a> [66.109.6.70]<br> 8 38 ms 39 ms 39 ms <a href="http://bu-ether12.nwrknjmd67w-bcr00.tbone.rr.com">bu-ether12.nwrknjmd67w-bcr00.tbone.rr.com</a> [66.109.6.29]<br> 9 * * * Request timed out.<br> 10 * * * Request timed out.<br> 11 39 ms 38 ms 38 ms <a href="http://b.resolvers.Level3.net">b.resolvers.Level3.net</a> [4.2.2.2]<br><br></div><div><br clear="all"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Eric Rechnitzer<div><a href="mailto:eric.rechnitzer@gmail.com" target="_blank">eric.rechnitzer@gmail.com</a><br></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Oct 9, 2019 at 2:37 PM Mark Price <<a href="mailto:mprice@tqhosting.com">mprice@tqhosting.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div>I'm seeing the same problem from RoadRunner/Spectrum 96.10.190.170<br></div><div><br></div><div><br></div><div>$ mtr --report-wide 4.2.2.2<br>Start: 2019-10-09T14:29:48-0400<br>HOST: asdf Loss% Snt Last Avg Best Wrst StDev<br> 1.|-- _gateway 0.0% 10 0.3 0.3 0.2 0.3 0.0<br> 2.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0<br> 3.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0<br> 4.|-- <a href="http://cpe-174-111-105-048.triad.res.rr.com" target="_blank">cpe-174-111-105-048.triad.res.rr.com</a> 0.0% 10 16.9 19.5 14.7 29.3 4.9<br> 5.|-- <a href="http://cpe-024-025-041-106.ec.res.rr.com" target="_blank">cpe-024-025-041-106.ec.res.rr.com</a> 0.0% 10 14.9 15.7 8.4 22.4 4.6<br> 6.|-- <a href="http://be31.drhmncev01r.southeast.rr.com" target="_blank">be31.drhmncev01r.southeast.rr.com</a> 0.0% 10 26.2 24.8 14.1 48.4 11.8<br> 7.|-- 66.109.10.176 0.0% 10 24.2 25.7 19.9 30.8 3.3<br> 8.|-- <a href="http://ae-2-0.c1.chi75.tbone.rr.com" target="_blank">ae-2-0.c1.chi75.tbone.rr.com</a> 0.0% 10 34.6 28.2 22.0 34.6 3.8<br> 9.|-- <a href="http://0.ae1.pr0.dca20.tbone.rr.com" target="_blank">0.ae1.pr0.dca20.tbone.rr.com</a> 0.0% 10 36.1 29.0 21.5 38.3 6.1<br> 10.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0<br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Oct 9, 2019 at 11:34 AM Eric Rechnitzer via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">My ticket # is sci-251834 and I sent them Shawn's traceroutes as well.</div><div dir="ltr"><br></div><div dir="ltr">Thanks,<br clear="all"><div><div dir="ltr"><div dir="ltr">Eric Rechnitzer<div><a href="mailto:eric.rechnitzer@gmail.com" target="_blank">eric.rechnitzer@gmail.com</a><br></div></div></div></div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Oct 9, 2019 at 11:16 AM Jordan Morris via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I think you are correct that this is the root cause a few of the sites even the alternative DNS servers routed out <a href="http://0.ae1.pr0.dca20.tbone.rr.com" rel="noreferrer" target="_blank">0.ae1.pr0.dca20.tbone.rr.com</a> and went dead in the water after that.<br>
<br>
<br>
Jordan Morris<br>
SALES: 800-249-1348<br>
SUPPORT: 888-920-5685<br>
<a href="http://www.crosswindvoip.com" rel="noreferrer" target="_blank">www.crosswindvoip.com</a><br>
2201 N. Camino Principal Ste. 125<br>
Tucson, AZ 85715 <br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
-----Original Message-----<br>
From: Shawn Solomon <<a href="mailto:sdsolomo@gmail.com" target="_blank">sdsolomo@gmail.com</a>> <br>
Sent: Wednesday, October 9, 2019 8:04 AM<br>
To: Jordan Morris <<a href="mailto:jmorris@crosswindvoip.com" target="_blank">jmorris@crosswindvoip.com</a>><br>
Cc: <a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><br>
Subject: Re: [outages] Odd name resolution Errors OpenDNS In NC & SC<br>
<br>
potentially related, we are seeing problems with rr/charter/spectrum/brighthouse/tw getting traffic back to level3/centurylink this morning. Seems anything routing via <a href="http://0.ae0.pr0.dca20.tbone.rr.com" rel="noreferrer" target="_blank">0.ae0.pr0.dca20.tbone.rr.com</a><br>
just dies if its destined for as3356. If it takes a path via<br>
Atlanta, works great. Interestingly, both of the following destinations are in the same subnet, just a different fourth octet.<br>
<br>
roampile (0.0.0.0)<br>
Wed Oct 9 10:03:51 2019<br>
Keys: Help Display mode Restart statistics Order of fields quit<br>
<br>
Packets Pings<br>
Host<br>
Loss% Snt Last Avg Best Wrst StDev<br>
1. Linksys20360<br>
0.0% 4 0.8 1.1 0.8 1.9 0.0<br>
2. <a href="http://cpe-69-132-132-1.carolina.res.rr.com" rel="noreferrer" target="_blank">cpe-69-132-132-1.carolina.res.rr.com</a><br>
0.0% 4 11.7 13.3 11.7 16.1 1.9<br>
3. <a href="http://cpe-174-111-099-000.triad.res.rr.com" rel="noreferrer" target="_blank">cpe-174-111-099-000.triad.res.rr.com</a><br>
0.0% 4 20.3 18.7 15.1 22.8 3.4<br>
4. 24.93.70.64<br>
0.0% 4 9.2 13.8 9.2 18.7 4.1<br>
5. <a href="http://ge-5-1-0.rlghncpop-rtr1.southeast.rr.com" rel="noreferrer" target="_blank">ge-5-1-0.rlghncpop-rtr1.southeast.rr.com</a><br>
0.0% 4 34.4 22.7 16.8 34.4 8.2<br>
6. 66.109.10.176<br>
0.0% 4 32.9 32.9 27.2 40.6 5.7<br>
7. <a href="http://ae-2-0.c1.chi75.tbone.rr.com" rel="noreferrer" target="_blank">ae-2-0.c1.chi75.tbone.rr.com</a><br>
0.0% 4 35.9 35.2 29.8 41.3 4.7<br>
8. <a href="http://0.ae0.pr0.dca20.tbone.rr.com" rel="noreferrer" target="_blank">0.ae0.pr0.dca20.tbone.rr.com</a><br>
0.0% 4 30.9 33.7 26.7 48.0 9.7<br>
9. ???<br>
dead..goes no further..<br>
<br>
<br>
roampile (0.0.0.0)<br>
Wed Oct 9 10:04:20 2019<br>
Keys: Help Display mode Restart statistics Order of fields quit<br>
<br>
Packets Pings<br>
Host<br>
Loss% Snt Last Avg Best Wrst StDev<br>
1. Linksys20360<br>
0.0% 7 0.9 1.1 0.8 2.3 0.4<br>
2. <a href="http://cpe-69-132-132-1.carolina.res.rr.com" rel="noreferrer" target="_blank">cpe-69-132-132-1.carolina.res.rr.com</a><br>
0.0% 7 12.8 13.5 6.4 19.3 3.8<br>
3. <a href="http://cpe-174-111-099-002.triad.res.rr.com" rel="noreferrer" target="_blank">cpe-174-111-099-002.triad.res.rr.com</a><br>
0.0% 7 12.3 18.4 11.0 34.4 9.3<br>
4. <a href="http://chrlncnor-vis1.carolina.rr.com" rel="noreferrer" target="_blank">chrlncnor-vis1.carolina.rr.com</a><br>
0.0% 7 13.9 13.9 8.8 21.2 4.2<br>
5. 24.93.67.204<br>
0.0% 7 16.9 18.0 13.8 26.1 4.1<br>
6. <a href="http://bu-ether11.atlngamq46w-bcr00.tbone.rr.com" rel="noreferrer" target="_blank">bu-ether11.atlngamq46w-bcr00.tbone.rr.com</a><br>
0.0% 7 19.3 23.5 19.3 29.6 3.5<br>
7. 66.109.5.125<br>
0.0% 7 14.7 16.7 13.5 22.3 3.3<br>
8. <a href="http://ae-10.edge4.Atlanta2.Level3.net" rel="noreferrer" target="_blank">ae-10.edge4.Atlanta2.Level3.net</a><br>
0.0% 7 19.1 22.2 18.6 32.7 4.8<br>
9. ???<br>
10. hidden in dallas 0.0% 7<br>
38.8 37.5 32.1 41.0 3.5<br>
11. hidden in dallas<br>
0.0% 6 32.7 34.5 32.7 36.9 1.5<br>
<br>
<br>
On Wed, Oct 9, 2019 at 10:27 AM Jordan Morris via Outages <<a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a>> wrote:<br>
><br>
> Seeing some odd name resolutions errors in the NC and SC regions getting random name resolutions that resolve to mail*.<a href="http://newsgeni.us" rel="noreferrer" target="_blank">newsgeni.us</a>. This is happening across multiple domain names even seeing it with reverse IP resolutions. Our monitoring alerts detected this so far at about 10+ sites in those states. The fix has been to move the sites off 208.67.222.222 and 208.67.220.220 and using a different DNS servers/providers. Anyone else seeing similar?<br>
><br>
><br>
><br>
><br>
><br>
><br>
><br>
> _______________________________________________<br>
> Outages mailing list<br>
> <a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
> <a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</blockquote></div>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</blockquote></div>
</blockquote></div>