[Outages-discussion] Charter in Northern MI

B.J. Ash bjash at kentrecords.com
Tue Mar 21 21:43:23 EDT 2017


From a Charter connection in the eastern U.P.:

--- www.mtu.edu ping statistics ---
39 packets transmitted, 32 packets received, 17.9% packet loss
round-trip min/avg/max/stddev = 96.207/104.530/121.833/5.174 ms

Same traceroute, ran twice with dead packets in different spots:
$ traceroute 141.219.70.106
traceroute to 141.219.70.106 (141.219.70.106), 64 hops max, 52 byte packets
 1  4.479 ms  1.705 ms  1.432 ms
 2  5.629 ms  17.470 ms  14.893 ms
 3 15.898 ms  32.822 ms  19.963 ms
 4  acr01escnmi-tge-0-1-1-2.escn.mi.charter.com (96.34.16.6)  19.835 ms  13.270 ms  23.396 ms
 5  dtr02mrqtmi-bue-96.mrqt.mi.charter.com (96.34.17.72)  28.244 ms  18.673 ms  27.752 ms
 6  crr01mrqtmi-bue-100.mrqt.mi.charter.com (96.34.18.50)  22.988 ms  22.516 ms  20.098 ms
 7  crr01stptwi-bue-251.stpt.wi.charter.com (96.34.18.180)  34.061 ms  41.392 ms  32.127 ms
 8  crr02euclwi-bue-400.eucl.wi.charter.com (96.34.24.83)  29.227 ms  34.993 ms  28.772 ms
 9  crr01sgnwmi-tge-0-0-0-4.sgnw.mi.charter.com (96.34.2.155)  38.035 ms  29.845 ms  35.807 ms
10  bbr01chcgil-bue-1.chcg.il.charter.com (96.34.0.9)  66.398 ms  80.199 ms  76.882 ms
11  prr01chcgil-bue-2.chcg.il.charter.com (96.34.3.9)  72.382 ms  71.415 ms  69.481 ms
12  ge-7-2-0.0.rtr.eqch.net.internet2.edu (162.252.69.153)  68.171 ms *
    ge-7-2-3.0.rtr.eqch.net.internet2.edu (64.57.20.49)  68.696 ms
13  ae-2.0.rtr.ashb.net.internet2.edu (64.57.20.218)  96.154 ms  96.224 ms  92.888 ms
14  * 64.57.29.178 (64.57.29.178)  101.061 ms  106.493 ms
15  irbx46.hldl-cor-hillcoll.mich.net (198.108.23.155)  107.161 ms  97.177 ms  106.299 ms
16  irbx5.ssmr-cor-lssu.mich.net (198.108.22.58)  103.617 ms  104.269 ms  90.400 ms
17  irbx70.hgtn-cor-mtu.mich.net (198.108.22.78)  125.193 ms  94.911 ms  106.193 ms
18  207.75.40.10 (207.75.40.10)  106.193 ms  104.280 ms  111.868 ms
19  mx480-07-001-rtr-brd-u.tc.mtu.edu (141.219.183.98)  111.149 ms  116.220 ms  97.454 ms
20  www.mtu.edu (141.219.70.106)  111.488 ms  106.589 ms  114.837 ms


$ traceroute 141.219.70.106
traceroute to 141.219.70.106 (141.219.70.106), 64 hops max, 52 byte packets
 1  4.514 ms  1.411 ms  1.449 ms
 2  5.624 ms  7.045 ms  5.820 ms
 3  18.357 ms  18.794 ms  18.443 ms
 4  acr01escnmi-tge-0-1-1-2.escn.mi.charter.com (96.34.16.6)  30.101 ms  24.256 ms  18.547 ms
 5  dtr02mrqtmi-bue-96.mrqt.mi.charter.com (96.34.17.72)  21.210 ms  19.389 ms  19.477 ms
 6  crr01mrqtmi-bue-100.mrqt.mi.charter.com (96.34.18.50)  16.288 ms  25.502 ms  18.368 ms
 7  crr01stptwi-bue-251.stpt.wi.charter.com (96.34.18.180)  34.544 ms  31.875 ms  31.007 ms
 8  crr02euclwi-bue-400.eucl.wi.charter.com (96.34.24.83)  42.272 ms  34.975 ms  26.887 ms
 9  crr01sgnwmi-tge-0-0-0-4.sgnw.mi.charter.com (96.34.2.155)  36.254 ms  34.032 ms  35.427 ms
10  * bbr01chcgil-bue-1.chcg.il.charter.com (96.34.0.9)  78.236 ms  68.679 ms
11  prr01chcgil-bue-2.chcg.il.charter.com (96.34.3.9)  65.834 ms  74.277 ms  71.371 ms
12  ge-7-2-0.0.rtr.eqch.net.internet2.edu (162.252.69.153)  66.110 ms  88.693 ms  66.827 ms
13  ae-2.0.rtr.ashb.net.internet2.edu (64.57.20.218)  121.245 ms  112.377 ms  102.074 ms
14  64.57.29.178 (64.57.29.178)  104.356 ms
    198.71.47.26 (198.71.47.26)  203.186 ms  103.496 ms
15  irbx46.hldl-cor-hillcoll.mich.net (198.108.23.155)  101.030 ms  108.354 ms *
16  * irbx5.ssmr-cor-lssu.mich.net (198.108.22.58)  101.149 ms  104.172 ms
17  irbx70.hgtn-cor-mtu.mich.net (198.108.22.78)  100.320 ms  102.926 ms  106.523 ms
18  207.75.40.10 (207.75.40.10)  93.641 ms  101.899 ms  107.091 ms
19  * mx480-07-001-rtr-brd-u.tc.mtu.edu (141.219.183.98)  111.892 ms  118.047 ms
20  www.mtu.edu (141.219.70.106)  97.818 ms  106.838 ms  95.455 ms


From a Qwest T-1 in the eastern U.P.:

Tracing the route to www.mtu.edu (141.219.70.106)
VRF info: (vrf in name/id, vrf out name/id)
  1 4 msec 4 msec 16 msec
  2 cer-edge-11.inet.qwest.net (63.149.1.21) 32 msec 32 msec 28 msec
  3 chp-brdr-03.inet.qwest.net (67.14.8.190) 36 msec 28 msec 32 msec
  4 63.146.26.218 44 msec 28 msec 32 msec
  5 cr1.cgcil.ip.att.net (12.122.133.106) 28 msec 32 msec 32 msec
  6 12.123.159.33 48 msec 40 msec 72 msec
  7 12.124.155.10 28 msec 32 msec 36 msec
  8 irbx18.pwrs-cor-powers.mich.net (198.108.22.33) 44 msec 32 msec 32 msec
  9 irbx70.hgtn-cor-mtu.mich.net (198.108.22.78) 44 msec 44 msec 60 msec
 10 207.75.40.10 60 msec 44 msec 60 msec
 11 mx480-07-001-rtr-brd-u.tc.mtu.edu (141.219.183.98) 52 msec 60 msec 60 msec
 12 www.mtu.edu (141.219.70.106) 48 msec 44 msec 48 msec


From a separate connection from downstate:

Tracing the route to www.mtu.edu (141.219.70.106)
VRF info: (vrf in name/id, vrf out name/id)
  1 0 msec 0 msec 9 msec
  2 6-2-40.ear3.chicago2.level3.net (4.35.108.249) 8 msec 8 msec 9 msec
  3  *  *  *
  4 192.205.37.149 9 msec 17 msec 17 msec
  5 cr1.cgcil.ip.att.net (12.122.133.162) 17 msec 17 msec 16 msec
  6 12.123.159.33 34 msec 67 msec 92 msec
  7 12.124.155.10 17 msec 8 msec 9 msec
  8 irbx18.pwrs-cor-powers.mich.net (198.108.22.33) 25 msec 17 msec 25 msec
  9 irbx70.hgtn-cor-mtu.mich.net (198.108.22.78) 17 msec 25 msec 25 msec
 10 207.75.40.10 26 msec 25 msec 17 msec
 11 mx480-07-001-rtr-brd-u.tc.mtu.edu (141.219.183.98) 16 msec 25 msec 25 msec
 12 www.mtu.edu (141.219.70.106) 17 msec 25 msec 25 msec

And another separate connection downstate (different provider):

Tracing the route to www.mtu.edu (141.219.70.106)
VRF info: (vrf in name/id, vrf out name/id)
  1 0 msec 4 msec 0 msec
  2 8 msec 8 msec 4 msec
  3 8 msec 8 msec 4 msec
  4 lag-13-744.ear1.chicago2.level3.net (4.30.175.37) 24 msec 20 msec 24 msec
  5  *  *  *
  6 192.205.37.149 28 msec *  24 msec
  7 cr2.cgcil.ip.att.net (12.122.132.198) 28 msec 32 msec 24 msec
  8 12.123.159.29 24 msec 20 msec 20 msec
  9 12.124.155.10 16 msec 24 msec 16 msec
 10 irbx18.pwrs-cor-powers.mich.net (198.108.22.33) 24 msec 24 msec 24 msec
 11 irbx70.hgtn-cor-mtu.mich.net (198.108.22.78) 24 msec 24 msec 32 msec
 12 207.75.40.10 32 msec 32 msec 32 msec
 13 mx480-07-001-rtr-brd-u.tc.mtu.edu (141.219.183.98) 32 msec *  24 msec
 14 www.mtu.edu (141.219.70.106) 36 msec 32 msec 32 msec

Seems to be a potential Level 3 issue?

--
B.J.



On 3/21/17, 21:24 , "Outages-discussion on behalf of Mitchell Kuch" <outages-discussion-bounces at outages.org on behalf of mdkuch at merit.edu> wrote:

    Hello, Matt -

    I'm currently on Charter in Northern Lower Michigan and see no such trouble.

     - - Mitchell

    mitch at paperclip:~$ ping -M dont -s 1472 www.mtu.edu
    PING www.mtu.edu (141.219.70.106) 1472(1500) bytes of data.
    1480 bytes from www.mtu.edu (141.219.70.106): icmp_seq=1 ttl=240 time=51.2 ms
    1480 bytes from www.mtu.edu (141.219.70.106): icmp_seq=2 ttl=240 time=51.2 ms
    1480 bytes from www.mtu.edu (141.219.70.106): icmp_seq=3 ttl=240 time=51.2 ms
    ...
    --- www.mtu.edu ping statistics ---
    783 packets transmitted, 782 received, 0% packet loss, time 782842ms
    rtt min/avg/max/mdev = 50.760/51.435/66.171/1.501 ms

    mitch at paperclip:~$ traceroute --resolve-hostnames -I www.mtu.edu
    traceroute to www.mtu.edu (141.219.70.106), 64 hops max
      1   * * *
      2   * * *
      3   96.34.34.3 (dtr04mnclmi-tge-0-0-0-3.mncl.mi.charter.com)  1.708ms  1.230ms  1.572ms
      4   96.34.35.92 (crr01trcymi-bue-343.trcy.mi.charter.com)  2.805ms  2.576ms  2.635ms
      5   96.34.33.97 (crr02trcymi-bue-10.trcy.mi.charter.com)  2.721ms  2.688ms  2.679ms
      6   96.34.36.20 (crr02aldlmi-bue-4.aldl.mi.charter.com)  6.965ms  6.961ms  6.917ms
      7   96.34.2.10 (bbr01aldlmi-bue-2.aldl.mi.charter.com)  11.248ms  8.733ms  7.971ms
      8   96.34.0.139 (bbr01chcgil-bue-805.chcg.il.charter.com)  19.026ms  15.542ms  15.947ms
      9   96.34.3.9 (prr01chcgil-bue-2.chcg.il.charter.com)  11.490ms  11.548ms  11.202ms
     10   162.252.69.153 (ge-7-2-0.0.rtr.eqch.net.internet2.edu)  11.359ms  11.476ms  11.329ms
     11   64.57.20.218 (ae-2.0.rtr.ashb.net.internet2.edu)  28.148ms  28.166ms  28.512ms
     12   198.71.47.26 (198.71.47.26)  56.311ms  56.870ms  57.351ms
     13   198.108.23.155 (irbx46.hldl-cor-hillcoll.mich.net)  61.000ms  60.838ms  60.378ms
     14   198.108.22.58 (irbx5.ssmr-cor-lssu.mich.net)  46.480ms  46.475ms  46.501ms
     15   198.108.22.78 (irbx70.hgtn-cor-mtu.mich.net)  50.096ms  50.098ms  50.098ms
     16   207.75.40.10 (207.75.40.10)  57.336ms  57.327ms  57.445ms
     17   141.219.183.98 (mx480-07-001-rtr-brd-u.tc.mtu.edu)  50.877ms  50.578ms  50.579ms
     18   141.219.70.106 (www.mtu.edu)  50.517ms  50.467ms  50.344ms

    mdkuch at hldl-cor-hillcoll> traceroute 96.34.34.2 source 198.108.23.155
    traceroute to 96.34.34.2 (96.34.34.2) from 198.108.23.155, 30 hops max, 40 byte packets
     1  ae1x46.sfld-cor-123net.mich.net (198.108.23.156)  3.219 ms  3.753 ms  3.233 ms
     2  irbx22.wsu5.mich.net (198.108.23.51)  13.552 ms  3.518 ms  3.541 ms
     3  ae1x76.eq-chi2.mich.net (198.108.23.12)  11.959 ms  11.941 ms ae0x14.eq-chi2.mich.net (198.108.22.9)  10.771 ms
     4  10gigabitethernet4-1.core1.chi1.he.NET (206.223.119.37)  10.873 ms  10.855 ms  18.110 ms
     5  charter-net-hky-nc-as20115.100gigabitethernet6-2.core2.chi1.he.net (184.105.250.38)  12.338 ms  12.019 ms  12.196 ms
     6  bbr01chcgil-bue-801.chcg.il.charter.com (96.34.3.8)  15.825 ms  19.691 ms  15.885 ms
     7  bbr01ftwotx-tge-0-3-0-2.ftwo.tx.charter.com (96.34.0.138)  27.724 ms  26.975 ms  32.001 ms
     8  crr02aldlmi-bue-808.aldl.mi.charter.com (96.34.2.11)  16.786 ms  18.312 ms  17.904 ms
     9  crr02trcymi-bue-4.trcy.mi.charter.com (96.34.36.21)  21.019 ms  26.582 ms  22.212 ms
    10  crr01trcymi-bue-10.trcy.mi.charter.com (96.34.33.96)  28.034 ms  29.139 ms  29.267 ms
    11  dtr04mnclmi-bue-343.mncl.mi.charter.com (96.34.35.93)  22.552 ms  23.459 ms  23.183 ms
    12  acr02mnclmi-tge-0-0-0-0.mncl.mi.charter.com (96.34.34.2)  23.463 ms  24.326 ms  23.967 ms


    ----- Original Message -----
    From: "Matt Freitag" <mlfreita at mtu.edu>
    To: outages-discussion at outages.org
    Sent: Tuesday, March 21, 2017 7:51:07 PM
    Subject: [Outages-discussion] Charter in Northern MI

    Hey everyone!

    I'm on Charter in the upper peninsula of Michigan and see a lot of packet loss to a lot of places, like Gmail or Michigan Tech University.

    Wondering if anyone else in the UP/Wisconsin sees something similar or knows anything.

    Thank you!


    Matt Freitag
    Network Engineer I
    Information Technology
    Michigan Technological University
    (906) 487-3696
    https://www.mtu.edu/
    https://www.mtu.edu/it
    _______________________________________________
    Outages-discussion mailing list
    Outages-discussion at outages.org
    https://puck.nether.net/mailman/listinfo/outages-discussion


Disclaimer: This email and its attachments may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Kent Record Management Inc. If you are not the intended recipient of this email and its attachments, you must take no action based upon them, nor must you copy or show them to anyone. Please contact the sender if you believe you have received this email in error.


More information about the Outages-discussion mailing list