[outages] HE.net Chicago router link issue?

Jason Lixfeld jason at lixfeld.ca
Tue Apr 26 16:06:36 EDT 2016


Our NLNOG ring alerted us to a brief issue which lasted about 5 minutes:

rackcentral02.ring.nlnog.net        AS58443  (AU)
mtr -i0.5 -c5 -r -w -n 163.53.233.70
HOST: beanfield01.ring.nlnog.net Loss%   Snt   Last   Avg  Best  Wrst StDev
 1.|-- 66.207.196.129              0.0%     5    0.4   1.1   0.3   3.9   1.3
 2.|-- 72.15.51.2                  0.0%     5    0.8   0.8   0.7   0.9   0.0
 3.|-- 72.15.49.83                 0.0%     5    1.0   0.9   0.9   1.1   0.0
 4.|-- 206.108.34.112              0.0%     5    0.4   1.9   0.4   8.1   3.3
 5.|-- ???                        100.0     5    0.0   0.0   0.0   0.0   0.0

vocus01.ring.nlnog.net              AS4826   (AU)
mtr -i0.5 -c5 -r -w -n 175.45.73.66
HOST: beanfield01.ring.nlnog.net Loss%   Snt   Last   Avg  Best  Wrst StDev
 1.|-- 66.207.196.129              0.0%     5    0.3   0.3   0.3   0.4   0.0
 2.|-- 72.15.51.2                  0.0%     5    0.6   0.8   0.6   1.0   0.0
 3.|-- 72.15.49.83                 0.0%     5    1.0   1.1   1.0   1.2   0.0
 4.|-- 206.108.34.112              0.0%     5    8.8  10.4   8.8  12.8   1.6
 5.|-- ???                        100.0     5    0.0   0.0   0.0   0.0   0.0

Once it came back:

BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw rackcentral02.ring.nlnog.net
Start: Tue Apr 26 16:04:49 2016
HOST: BlackBox-3.local                                            Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com               0.0%     5    3.1   4.9   1.9  15.5   5.9
  2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com               0.0%     5    3.1   2.6   2.3   3.1   0.0
  3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com            0.0%     5    3.1   3.1   2.9   3.4   0.0
  4.|-- he.ip4.torontointernetxchange.net                            0.0%     5    2.0   4.2   2.0   9.2   3.1
  5.|-- 100ge13-1.core1.chi1.he.net                                  0.0%     5   17.8  26.2  11.9  68.6  24.0
  6.|-- 10ge11-4.core1.pao1.he.net                                   0.0%     5   70.2  73.0  70.1  79.2   3.6
  7.|-- 10ge4-1.core1.sjc1.he.net                                    0.0%     5   76.7  81.0  76.7  92.4   6.5
  8.|-- tpg-internet-pty-ltd.10gigabitethernet3-8.core1.lax2.he.net  0.0%     5  250.9 251.2 249.5 252.2   0.9
  9.|-- 203-219-35-193.static.tpgi.com.au                            0.0%     5  233.9 233.4 231.2 235.2   1.5
 10.|-- nme-apt-bur-wgw1-be-10.tpgi.com.au                           0.0%     5  264.4 264.9 264.1 266.7   0.9
 11.|-- 203-219-107-206.static.tpgi.com.au                           0.0%     5  260.6 260.6 260.2 261.5   0.0
 12.|-- po8.mburndist01.aapt.net.au                                  0.0%     5  443.5 296.5 259.4 443.5  82.2
 13.|-- ???                                                         100.0     5    0.0   0.0   0.0   0.0   0.0
 14.|-- 59-100-253-114.mel.static-ipl.aapt.com.au                    0.0%     5  249.3 251.9 249.1 256.8   3.1
 15.|-- 163.53.233.254                                               0.0%     5  285.7 256.3 248.9 285.7  16.4
 16.|-- 163.53.233.70                                                0.0%     5  250.4 250.3 250.0 250.5   0.0
BlackBox-3:Beanfield jlixfeld$ mtr -c 5 -rw vocus01.ring.nlnog.net
Start: Tue Apr 26 16:05:15 2016
HOST: BlackBox-3.local                                  Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- vl4091.trs01.002.77mowatav01.yyz.beanfield.com     0.0%     5    2.2   2.4   2.0   2.8   0.0
  2.|-- te0-2-0-2.bfr01.905kingstw01.yyz.beanfield.com     0.0%     5    2.1   2.6   2.1   3.7   0.5
  3.|-- te-0-2-0-14.bfr01.151frontstw01.yyz.beanfield.com  0.0%     5    2.7   2.8   2.7   3.0   0.0
  4.|-- he.ip4.torontointernetxchange.net                  0.0%     5    2.6   6.4   2.0  13.5   4.5
  5.|-- 100ge13-1.core1.chi1.he.net                        0.0%     5   11.8  14.8  11.8  16.9   1.9
  6.|-- eqix-ch1.vocusconnect.com                          0.0%     5  104.1 117.0 103.1 148.2  20.1
  7.|-- bundle153.cor02.lax01.ca.vocus.net                 0.0%     5  266.8 266.5 266.4 266.8   0.0
  8.|-- 100g-0-1-0-0.cor01.lax01.ca.vocus.net              0.0%     5  266.2 266.4 266.2 266.6   0.0
  9.|-- 100g-0-1-0-0.cor01.sjc01.ca.vocus.net              0.0%     5  266.4 266.4 266.3 266.5   0.0
 10.|-- ten-0-2-0-3.cor01.syd04.nsw.vocus.net.au           0.0%     5  266.6 266.8 266.4 267.3   0.0
 11.|-- 175.45.72.95                                       0.0%     5  266.0 266.1 265.8 266.4   0.0
 12.|-- ring.vocus.net.au                                  0.0%     5  269.8 269.8 269.7 270.0   0.0
BlackBox-3:Beanfield jlixfeld$

> On Apr 26, 2016, at 3:59 PM, Peter Beckman via Outages <outages at outages.org> wrote:
> 
> A few minutes ago I was notified that one of my servers in Denver, CO was
> down (ip: 72.18.145.210).
> 
> Anyone seeing a similar loss on he.net in Chicago?
> 
> nog2.angryox.com (0.0.0.0)                                 Tue Apr 26 15:54:54 2016
>                                           Packets               Pings
> Host                                    Loss%   Snt   Last   Avg  Best  Wrst StDev
> 1. xl0.tic.nova.org                      0.0%    36    0.1   0.1   0.1   1.0   0.0
> 2. wsip-70-168-111-17.dc.dc.cox.net      2.8%    36    1.8  13.3   1.1 183.2  40.1
> 3. ip68-100-3-109.dc.dc.cox.net          0.0%    36    1.1   3.0   1.1  25.6   4.9
> 4. ashbbprj01-ae5.0.rd.as.cox.net        0.0%    36    1.7   3.6   1.7  20.7   4.3
> 5. 68.105.30.114                         2.8%    36    7.8  15.1   1.8 120.4  21.0
> 6. 10ge3-6.core2.chi1.he.net             2.8%    36   33.2  35.2  28.1  51.4   6.9
> 7. ??
> 
> But from Verizon it is up:
> 
> max.angryox.com (0.0.0.0)                                  Tue Apr 26 15:56:08 2016
>                                           Packets               Pings
> Host                                    Loss%   Snt   Last   Avg  Best  Wrst StDev
> 1. tomato.angryox.com                    0.0%   158    0.3   0.4   0.3   2.4   0.2
> 2. lo0-100.WASHDC-VFTTP-312.verizon-gni  0.0%   158    3.7   7.0   3.0 153.9  13.1
> 3. T1-3-0-4.WASHDC-LCR-21.verizon-gni.n  0.0%   158    7.9   8.1   3.1 156.9  12.0
> 4. ???
> 5. ???
> 6. 0.ae3.GW11.IAD8.ALTER.NET             0.0%   157    6.5   8.5   5.4 118.2  12.1
> 7. teliasonera-gw.customer.alter.net     0.0%   157    7.2   9.0   5.5 164.1  15.7
> 8. ash-bb3-link.telia.net                0.0%   157    8.0   8.9   5.5 148.9  14.4
> 9. sjo-b21-link.telia.net                0.0%   157   71.1  72.6  68.8 150.8   7.2
> 10. den-b1-link.telia.net                 0.0%   157   99.3  99.6  98.0 122.4   2.4
> 11. handynet-ic-145041-den-b1.c.telia.ne  0.0%   157  130.4 100.1  98.0 130.4   3.3
> 12. ae2-14.core1.denver2.handynetworks.c  0.0%   157   97.1  97.1  95.5 113.8   1.8
> 13. ae0-10.dist2.denver2.handynetworks.c  0.0%   157   99.5 103.9  95.6 828.6  58.2
> 14. vlan954.sw2-g4.denver2.handynetworks  0.0%   157   98.5 104.7  98.1 761.2  52.8
> 15. vlan11.sw1-h3.softsyshosting.com      0.0%   157   99.8 103.8  97.1 430.8  33.8
> 16. 72.18.145.210                         0.0%   157   97.3  97.1  95.5 128.1   2.7
> 
> ---------------------------------------------------------------------------
> Peter Beckman                                                  Internet Guy
> beckman at angryox.com                                 http://www.angryox.com/
> ---------------------------------------------------------------------------
> _______________________________________________
> Outages mailing list
> Outages at outages.org
> https://puck.nether.net/mailman/listinfo/outages




More information about the Outages mailing list