[outages] HE.net Chicago router link issue?

Peter Beckman beckman at angryox.com
Tue Apr 26 16:14:46 EDT 2016


Thanks All. Looks like someone routed around HE for me. Came back at 16:00 EDT:

nog2.angryox.com (0.0.0.0)                                     Tue Apr 26 16:13:08 2016
                                                Packets               Pings
  Host                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
  1. xl0.tic.nova.org                          0.0%     5    0.1   0.1   0.1   0.2   0.0
  2. wsip-70-168-111-17.dc.dc.cox.net          0.0%     5    1.4   1.4   1.2   1.6   0.0
  3. ip68-100-3-109.dc.dc.cox.net              0.0%     5    1.1   1.5   1.1   2.3   0.0
  4. ashbbprj01-ae5.0.rd.as.cox.net            0.0%     4    1.7   1.8   1.7   2.1   0.0
  5. xe-5-0-0.edge2.Washington4.Level3.net     0.0%     4    2.3   2.0   1.8   2.3   0.0
  6. ae-3-80.edge1.Washington4.Level3.net      0.0%     4    3.3   3.1   2.6   3.8   0.0
  7. ash-b1-link.telia.net                     0.0%     4    3.3  18.3   3.3  59.8  27.7
  8. ash-bb4-link.telia.net                    0.0%     4    2.8   3.0   2.8   3.3   0.0
  9. sjo-b21-link.telia.net                    0.0%     4   76.7  76.2  75.5  76.7   0.0
10. den-b1-link.telia.net                     0.0%     4   73.0  73.0  72.7  73.5   0.0
11. handynet-ic-145041-den-b1.c.telia.net     0.0%     4   72.7  73.1  72.7  73.4   0.0
12. ae2-14.core1.denver2.handynetworks.com    0.0%     4   73.0  72.9  72.7  73.1   0.0
13. ae0-10.dist2.denver2.handynetworks.com    0.0%     4   73.5  73.8  73.5  74.3   0.0
14. vlan954.sw2-g4.denver2.handynetworks.com  0.0%     4   74.1  74.6  73.7  76.7   1.2
15. vlan11.sw1-h3.softsyshosting.com          0.0%     4   72.8  73.0  72.8  73.4   0.0
16. 72.18.145.210                             0.0%     4   73.4  73.0  72.7  73.4   0.0

On Tue, 26 Apr 2016, Jason Lixfeld wrote:

> Our NLNOG ring alerted us to a brief issue which lasted about 5 minutes:
>
> rackcentral02.ring.nlnog.net        AS58443  (AU)
> mtr -i0.5 -c5 -r -w -n 163.53.233.70
> HOST: beanfield01.ring.nlnog.net Loss%   Snt   Last   Avg  Best  Wrst StDev
> 1.|-- 66.207.196.129              0.0%     5    0.4   1.1   0.3   3.9   1.3
> 2.|-- 72.15.51.2                  0.0%     5    0.8   0.8   0.7   0.9   0.0
> 3.|-- 72.15.49.83                 0.0%     5    1.0   0.9   0.9   1.1   0.0
> 4.|-- 206.108.34.112              0.0%     5    0.4   1.9   0.4   8.1   3.3
> 5.|-- ???                        100.0     5    0.0   0.0   0.0   0.0   0.0
>
> vocus01.ring.nlnog.net              AS4826   (AU)
> mtr -i0.5 -c5 -r -w -n 175.45.73.66
> HOST: beanfield01.ring.nlnog.net Loss%   Snt   Last   Avg  Best  Wrst StDev
> 1.|-- 66.207.196.129              0.0%     5    0.3   0.3   0.3   0.4   0.0
> 2.|-- 72.15.51.2                  0.0%     5    0.6   0.8   0.6   1.0   0.0
> 3.|-- 72.15.49.83                 0.0%     5    1.0   1.1   1.0   1.2   0.0
> 4.|-- 206.108.34.112              0.0%     5    8.8  10.4   8.8  12.8   1.6
> 5.|-- ???                        100.0     5    0.0   0.0   0.0   0.0   0.0
>
> Once it came back:
>
> BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw rackcentral02.ring.nlnog.net
> Start: Tue Apr 26 16:04:49 2016
> HOST: BlackBox-3.local                                            Loss%   Snt   Last   Avg  Best  Wrst StDev
>  1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com               0.0%     5    3.1   4.9   1.9  15.5   5.9
>  2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com               0.0%     5    3.1   2.6   2.3   3.1   0.0
>  3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com            0.0%     5    3.1   3.1   2.9   3.4   0.0
>  4.|-- he.ip4.torontointernetxchange.net                            0.0%     5    2.0   4.2   2.0   9.2   3.1
>  5.|-- 100ge13-1.core1.chi1.he.net                                  0.0%     5   17.8  26.2  11.9  68.6  24.0
>  6.|-- 10ge11-4.core1.pao1.he.net                                   0.0%     5   70.2  73.0  70.1  79.2   3.6
>  7.|-- 10ge4-1.core1.sjc1.he.net                                    0.0%     5   76.7  81.0  76.7  92.4   6.5
>  8.|-- tpg-internet-pty-ltd.10gigabitethernet3-8.core1.lax2.he.net  0.0%     5  250.9 251.2 249.5 252.2   0.9
>  9.|-- 203-219-35-193.static.tpgi.com.au                            0.0%     5  233.9 233.4 231.2 235.2   1.5
> 10.|-- nme-apt-bur-wgw1-be-10.tpgi.com.au                           0.0%     5  264.4 264.9 264.1 266.7   0.9
> 11.|-- 203-219-107-206.static.tpgi.com.au                           0.0%     5  260.6 260.6 260.2 261.5   0.0
> 12.|-- po8.mburndist01.aapt.net.au                                  0.0%     5  443.5 296.5 259.4 443.5  82.2
> 13.|-- ???                                                         100.0     5    0.0   0.0   0.0   0.0   0.0
> 14.|-- 59-100-253-114.mel.static-ipl.aapt.com.au                    0.0%     5  249.3 251.9 249.1 256.8   3.1
> 15.|-- 163.53.233.254                                               0.0%     5  285.7 256.3 248.9 285.7  16.4
> 16.|-- 163.53.233.70                                                0.0%     5  250.4 250.3 250.0 250.5   0.0
> BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw vocus01.ring.nlnog.net
> Start: Tue Apr 26 16:05:15 2016
> HOST: BlackBox-3.local                                  Loss%   Snt   Last   Avg  Best  Wrst StDev
>  1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com     0.0%     5    2.2   2.4   2.0   2.8   0.0
>  2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com     0.0%     5    2.1   2.6   2.1   3.7   0.5
>  3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com  0.0%     5    2.7   2.8   2.7   3.0   0.0
>  4.|-- he.ip4.torontointernetxchange.net                  0.0%     5    2.6   6.4   2.0  13.5   4.5
>  5.|-- 100ge13-1.core1.chi1.he.net                        0.0%     5   11.8  14.8  11.8  16.9   1.9
>  6.|-- eqix-ch1.vocusconnect.com                          0.0%     5  104.1 117.0 103.1 148.2  20.1
>  7.|-- bundle153.cor02.lax01.ca.vocus.net                 0.0%     5  266.8 266.5 266.4 266.8   0.0
>  8.|-- 100g-0-1-0-0.cor01.lax01.ca.vocus.net              0.0%     5  266.2 266.4 266.2 266.6   0.0
>  9.|-- 100g-0-1-0-0.cor01.sjc01.ca.vocus.net              0.0%     5  266.4 266.4 266.3 266.5   0.0
> 10.|-- ten-0-2-0-3.cor01.syd04.nsw.vocus.net.au           0.0%     5  266.6 266.8 266.4 267.3   0.0
> 11.|-- 175.45.72.95                                       0.0%     5  266.0 266.1 265.8 266.4   0.0
> 12.|-- ring.vocus.net.au                                  0.0%     5  269.8 269.8 269.7 270.0   0.0
> BlackBox-3:Beanfield jlixfeld$
>
>> On Apr 26, 2016, at 3:59 PM, Peter Beckman via Outages <outages at outages.org> wrote:
>>
>> A few minutes ago I was notified that one of my servers in Denver, CO was
>> down (ip: 72.18.145.210).
>>
>> Anyone seeing a similar loss on he.net in Chicago?
>>
>> nog2.angryox.com (0.0.0.0)                                 Tue Apr 26 15:54:54 2016
>>                                           Packets               Pings
>> Host                                    Loss%   Snt   Last   Avg  Best  Wrst StDev
>> 1. xl0.tic.nova.org                      0.0%    36    0.1   0.1   0.1   1.0   0.0
>> 2. wsip-70-168-111-17.dc.dc.cox.net      2.8%    36    1.8  13.3   1.1 183.2  40.1
>> 3. ip68-100-3-109.dc.dc.cox.net          0.0%    36    1.1   3.0   1.1  25.6   4.9
>> 4. ashbbprj01-ae5.0.rd.as.cox.net        0.0%    36    1.7   3.6   1.7  20.7   4.3
>> 5. 68.105.30.114                         2.8%    36    7.8  15.1   1.8 120.4  21.0
>> 6. 10ge3-6.core2.chi1.he.net             2.8%    36   33.2  35.2  28.1  51.4   6.9
>> 7. ??
>>
>> But from Verizon it is up:
>>
>> max.angryox.com (0.0.0.0)                                  Tue Apr 26 15:56:08 2016
>>                                           Packets               Pings
>> Host                                    Loss%   Snt   Last   Avg  Best  Wrst StDev
>> 1. tomato.angryox.com                    0.0%   158    0.3   0.4   0.3   2.4   0.2
>> 2. lo0-100.WASHDC-VFTTP-312.verizon-gni  0.0%   158    3.7   7.0   3.0 153.9  13.1
>> 3. T1-3-0-4.WASHDC-LCR-21.verizon-gni.n  0.0%   158    7.9   8.1   3.1 156.9  12.0
>> 4. ???
>> 5. ???
>> 6. 0.ae3.GW11.IAD8.ALTER.NET             0.0%   157    6.5   8.5   5.4 118.2  12.1
>> 7. teliasonera-gw.customer.alter.net     0.0%   157    7.2   9.0   5.5 164.1  15.7
>> 8. ash-bb3-link.telia.net                0.0%   157    8.0   8.9   5.5 148.9  14.4
>> 9. sjo-b21-link.telia.net                0.0%   157   71.1  72.6  68.8 150.8   7.2
>> 10. den-b1-link.telia.net                 0.0%   157   99.3  99.6  98.0 122.4   2.4
>> 11. handynet-ic-145041-den-b1.c.telia.ne  0.0%   157  130.4 100.1  98.0 130.4   3.3
>> 12. ae2-14.core1.denver2.handynetworks.c  0.0%   157   97.1  97.1  95.5 113.8   1.8
>> 13. ae0-10.dist2.denver2.handynetworks.c  0.0%   157   99.5 103.9  95.6 828.6  58.2
>> 14. vlan954.sw2-g4.denver2.handynetworks  0.0%   157   98.5 104.7  98.1 761.2  52.8
>> 15. vlan11.sw1-h3.softsyshosting.com      0.0%   157   99.8 103.8  97.1 430.8  33.8
>> 16. 72.18.145.210                         0.0%   157   97.3  97.1  95.5 128.1   2.7
>>
>> ---------------------------------------------------------------------------
>> Peter Beckman                                                  Internet Guy
>> beckman at angryox.com                                 http://www.angryox.com/
>> ---------------------------------------------------------------------------
>> _______________________________________________
>> Outages mailing list
>> Outages at outages.org
>> https://puck.nether.net/mailman/listinfo/outages
>
>

---------------------------------------------------------------------------
Peter Beckman                                                  Internet Guy
beckman at angryox.com                                 http://www.angryox.com/
---------------------------------------------------------------------------



More information about the Outages mailing list