[outages] google DNS issues this AM ?

Phil Sykes phil at atdot.at
Fri Jan 8 11:33:44 EST 2021


Google is aware this has recurred over the last 3 days and we are digging
into it.

If you happen to have crisper start-stop times than ~09:20-09:50 EST for
any of the last three days, that might well help us narrow it down.
Thanks to those who have come via noc at google.com (our master ticket:
b/176930179).

Phil Sykes
(day job: Google Networking SRE)

On Wed, Jan 6, 2021 at 2:55 PM mike tancsa via Outages <outages at outages.org>
wrote:

> Seems to be sporadic.  When trying to resolve via ns2.google.com which I
> see as
>
> % host ns2.google.com.
> ns2.google.com has address 216.239.34.10
>
> and I see via me-gtt-google ( 3257 15169)
>
> % traceroute -n -q1 -I 216.239.38.10
> traceroute to 216.239.38.10 (216.239.38.10), 64 hops max, 48 byte packets
>  1  67.43.128.6  8.145 ms
>  2  205.211.164.33  7.990 ms
>  3  67.43.129.247  42.967 ms
>  4  69.174.3.205  31.794 ms
>  5  74.125.147.196  30.198 ms
>  6  74.125.244.146  41.023 ms
>  7  172.253.64.254  59.708 ms
>  8  72.14.232.70  41.107 ms
>  9  *
> 10  108.170.225.193  61.710 ms
> 11  *
> 12  *
> 13  *
>
> I am getting timeouts or very slow responses
>
> % date;host www.gmail.com 216.239.38.10;date
> Wed Jan  6 09:44:17 EST 2021
> ;; connection timed out; no servers could be reached
> Wed Jan  6 09:44:27 EST 2021
> %
>
> I dont think its packet loss  /  a transport issue
>
> % ping -q -i.1 -c 10 216.239.34.10
> PING 216.239.34.10 (216.239.34.10): 56 data bytes
>
> --- 216.239.34.10 ping statistics ---
> 10 packets transmitted, 10 packets received, 0.0% packet loss
> round-trip min/avg/max/stddev = 33.021/60.500/93.991/16.585 ms
>
> However, routing is asymmetric as its coming back via Torix in Toronto,
> Canada.
>
> But I dont see any packet loss on the pings.
>
>     ---Mike
>
> On 1/6/2021 9:35 AM, mike tancsa via Outages wrote:
> > It seems to be resolved (excuse the pun), but I was getting DNS timeouts
> > on various google domains just now.  downforme,
> > https://downdetector.ca/status/gmail/ etc all noted it too so it didnt
> > seem specific to my ASN.  By the time I got a pcap going, it seemed to
> > be back to normal
> >
> >     ---Mike
> >
> >
> > _______________________________________________
> > Outages mailing list
> > Outages at outages.org
> > https://puck.nether.net/mailman/listinfo/outages
> >
>
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages/attachments/20210108/10a5913a/attachment.htm>


More information about the Outages mailing list