<div dir="ltr">I'm not on the Comcast backbone team, but for what it's worth I just ran MTR to 96.120.14.165 and to <a href="http://router1-fmt.linode.com">router1-fmt.linode.com</a> for quite a while and never lost a single packet from my desktop inside Comcast. I don't think I'm hitting the problematic node, though. If I'm reading the results above correctly, in all cases the problem begins when traffic hits <span style="color:rgb(0,0,0);white-space:pre-wrap"><a href="http://po4-20G.ar2.SJC2.gblx.net">po4-20G.ar2.SJC2.gblx.net</a>.</span><div>

<span style="color:rgb(0,0,0);white-space:pre-wrap"><br></span></div><div style><span style="color:rgb(0,0,0);white-space:pre-wrap">Am I misreading that?</span></div><div style><span style="color:rgb(0,0,0);white-space:pre-wrap"><br>

</span></div><div style><span style="color:rgb(0,0,0);white-space:pre-wrap">Regards,</span></div><div style><span style="color:rgb(0,0,0);white-space:pre-wrap">John</span></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">

On Sat, Jan 19, 2013 at 1:20 PM, Constantine A. Murenin <span dir="ltr"><<a href="mailto:mureninc@gmail.com" target="_blank">mureninc@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

On Sat, Jan 19, 2013 at 11:52:04AM -0800, Constantine A. Murenin wrote:<br>
> On Sat, 19 Jan 2013 at 11:04:14 -0800, Dylan N wrote:<br>
> > I get packetloss on <a href="http://te-1-12-0-0-ar01.sfsutro.ca.sfba.comcast.net" target="_blank">te-1-12-0-0-ar01.sfsutro.ca.sfba.comcast.net</a> to my<br>
> > linode @ fmt at weekends and at nights, looks more like just too much<br>
> > load rather than an outage<br>
><br>
> In my case, all packet loss seem to be within <a href="http://gblx.net" target="_blank">gblx.net</a><br>
> (e.g. no packet loss between Comcast and <a href="http://hetzner.de" target="_blank">hetzner.de</a>).<br>
><br>
> What I find strange is that the latency is still very good,<br>
> even when there is a significant packet loss.<br>
><br>
> But my ssh connection between Comcast and Linode/Fremont is completely<br>
> unusable for several seconds at a time during these events.<br>
><br>
><br>
> The loss seems to have continued throughout last night:<br>
><br>
> 2013-01-19T01:50:04-0800<br>
> HOST: li163-###                                          Snt   Rcv Loss%   Best   Avg  Wrst StDev<br>
>   1. <a href="http://router1-fmt.linode.com" target="_blank">router1-fmt.linode.com</a>                             600   600  0.0%    0.5   6.6 268.8  18.5<br>
>   2. <a href="http://10gigabitethernet2-3.core1.fmt1.he.net" target="_blank">10gigabitethernet2-3.core1.fmt1.he.net</a>             600   600  0.0%    0.5  12.8 1385.  66.3<br>
>   3. <a href="http://10gigabitethernet1-2.core1.sjc2.he.net" target="_blank">10gigabitethernet1-2.core1.sjc2.he.net</a>             600   600  0.0%    0.7   4.4  28.9   5.1<br>
>   4. <a href="http://Port-channel100.ar3.SJC2.gblx.net" target="_blank">Port-channel100.ar3.SJC2.gblx.net</a>                  600   600  0.0%    0.8  28.2 234.0  54.8<br>
>   5. <a href="http://po6-20G.ar4.SJC2.gblx.net" target="_blank">po6-20G.ar4.SJC2.gblx.net</a>                          600   579  3.5%    0.9  <a href="tel:32.1%20888.1%2066.0" value="+13218881660">32.1 888.1 66.0</a><br>


>   6. <a href="http://lag8.ar5.SJC2.gblx.net" target="_blank">lag8.ar5.SJC2.gblx.net</a>                             600   570  5.0%    0.9   4.4  20.9   5.1<br>
>   <a href="tel:7.%20208.178.58.2" value="+17208178582">7. 208.178.58.2</a>                                       600   572  4.7%    1.8   4.1  14.4   1.3<br>
>   8. <a href="http://pos-2-7-0-0-cr01.sanjose.ca.ibone.comcast.net" target="_blank">pos-2-7-0-0-cr01.sanjose.ca.ibone.comcast.net</a>      600   575  4.2%    4.8   7.7  43.1   2.9<br>
>   9. <a href="http://pos-1-4-0-0-cr01.sacramento.ca.ibone.comcast.net" target="_blank">pos-1-4-0-0-cr01.sacramento.ca.ibone.comcast.net</a>   600   574  4.3%    7.1   9.3  20.2   1.5<br>
>  10. <a href="http://te-7-3-ar02.saltlakecity.ut.utah.comcast.net" target="_blank">te-7-3-ar02.saltlakecity.ut.utah.comcast.net</a>       600   573  4.5%    7.3  11.9 115.7  17.6<br>
>  11. <a href="http://te-3-1-ur08.sacramento.ca.ccal.comcast.net" target="_blank">te-3-1-ur08.sacramento.ca.ccal.comcast.net</a>         600   574  4.3%    7.5   8.3 155.6   6.6<br>
>  12. <a href="http://te-1-0-0-ten05.sacramento.ca.ccal.comcast.net" target="_blank">te-1-0-0-ten05.sacramento.ca.ccal.comcast.net</a>      600   581  3.2%   14.1  14.3  25.1   1.3<br>
>  13. 74-93-180-##-<a href="http://Sacramento.hfc.comcastbusiness.net" target="_blank">Sacramento.hfc.comcastbusiness.net</a>    600   572  4.7%   14.1  20.5  83.9   8.8<br>
> 2013-01-19T02:00:04-0800<br>
><br>
> 2013-01-19T01:50:44-0800<br>
> HOST: hype.####.##########                                      Snt   Rcv Loss%   Best   Avg  Wrst StDev<br>
>   1. logout.lan                                                 60    60  0.0%    2.1   7.1  35.2   6.5<br>
>   2. 192.168.1.1                                                60    60  0.0%    2.5   8.6  41.3   6.7<br>
>   3. 10.1.10.1                                                  60    60  0.0%    3.1  10.3  49.8   8.4<br>
>   4. 96.120.14.165                                              60    60  0.0%   11.3  22.7  75.3  11.7<br>
>   5. <a href="http://te-6-5-ur08.sacramento.ca.ccal.comcast.net" target="_blank">te-6-5-ur08.sacramento.ca.ccal.comcast.net</a>                 60    60  0.0%   12.3  22.8  66.1  12.1<br>
>   6. <a href="http://te-0-2-0-2-ar03.sacramento.ca.sacra.comcast.net" target="_blank">te-0-2-0-2-ar03.sacramento.ca.sacra.comcast.net</a>            60    60  0.0%   11.8  26.3 101.6  18.3<br>
>   7. <a href="http://pos-0-3-0-0-cr01.sacramento.ca.ibone.comcast.net" target="_blank">pos-0-3-0-0-cr01.sacramento.ca.ibone.comcast.net</a>           60    60  0.0%   14.8  26.8  85.3  14.1<br>
>   8. <a href="http://pos-0-3-0-0-cr01.sanjose.ca.ibone.comcast.net" target="_blank">pos-0-3-0-0-cr01.sanjose.ca.ibone.comcast.net</a>              60    60  0.0%   15.6  28.2  71.6  10.3<br>
>   9. <a href="http://pos-0-1-0-0-pe01.11greatoaks.ca.ibone.comcast.net" target="_blank">pos-0-1-0-0-pe01.11greatoaks.ca.ibone.comcast.net</a>          60    60  0.0%   20.8  30.6  92.6  12.2<br>
>  10. 208.178.58.1                                               60    60  0.0%   18.6  34.8  98.6  16.6<br>
>  11. <a href="http://po4-20G.ar2.SJC2.gblx.net" target="_blank">po4-20G.ar2.SJC2.gblx.net</a>                                  60    60  0.0%   17.5  <a href="tel:61.6%20273.3%20%2066.9" value="+16162733669">61.6 273.3  66.9</a><br>


>  12. <a href="http://po1-20G.ar3.SJC2.gblx.net" target="_blank">po1-20G.ar3.SJC2.gblx.net</a>                                  60    47 21.7%   17.8  48.2 238.7  51.7<br>
>  13. <a href="http://Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net" target="_blank">Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net</a>    60    44 26.7%   17.1  30.5  69.8  11.6<br>
>  14. <a href="http://10gigabitethernet1-1.core1.fmt1.he.net" target="_blank">10gigabitethernet1-1.core1.fmt1.he.net</a>                     60    43 28.3%   <a href="tel:21.5%20%2055.2%20598.8" value="+12155525988">21.5  55.2 598.8</a>  87.9<br>


>  15. <a href="http://router1-fmt.linode.com" target="_blank">router1-fmt.linode.com</a>                                     60    44 26.7%   18.3  44.0 187.1  34.4<br>
>  16. li163-###.<a href="http://members.linode.com" target="_blank">members.linode.com</a>                               60    43 28.3%   17.8  29.0  68.1   8.6<br>
> 2013-01-19T01:51:55-0800<br>
<br>
<br>
It's been a 61% packet loss in the last minute...  Ridiculous.<br>
<br>
2013-01-19T12:15:15-0800<br>
HOST: hype.####.##########                                      Snt   Rcv Loss%   Best   Avg  Wrst StDev<br>
  1. logout.lan                                                 60    60  0.0%    2.1  18.8 222.7  50.1<br>
  2. 192.168.1.1                                                60    60  0.0%    2.3  20.4 421.0  65.5<br>
  3. 10.1.10.1                                                  60    60  0.0%    3.0  22.9 357.1  57.2<br>
  4. 96.120.14.165                                              60    60  0.0%    9.6  29.3 306.7  54.4<br>
  5. <a href="http://te-6-5-ur08.sacramento.ca.ccal.comcast.net" target="_blank">te-6-5-ur08.sacramento.ca.ccal.comcast.net</a>                 60    60  0.0%   10.3  34.2 265.3  51.9<br>
  6. <a href="http://te-0-2-0-2-ar03.sacramento.ca.sacra.comcast.net" target="_blank">te-0-2-0-2-ar03.sacramento.ca.sacra.comcast.net</a>            60    60  0.0%    9.8  33.1 185.6  43.3<br>
  7. <a href="http://pos-0-4-0-0-cr01.sacramento.ca.ibone.comcast.net" target="_blank">pos-0-4-0-0-cr01.sacramento.ca.ibone.comcast.net</a>           60    60  0.0%   11.8  <a href="tel:32.3%20234.3%20%2042.8" value="+13232343428">32.3 234.3  42.8</a><br>


  8. <a href="http://pos-0-3-0-0-cr01.sanjose.ca.ibone.comcast.net" target="_blank">pos-0-3-0-0-cr01.sanjose.ca.ibone.comcast.net</a>              60    60  0.0%   15.6  <a href="tel:31.7%20282.1%20%2041.5" value="+13172821415">31.7 282.1  41.5</a><br>


  9. <a href="http://pos-0-1-0-0-pe01.11greatoaks.ca.ibone.comcast.net" target="_blank">pos-0-1-0-0-pe01.11greatoaks.ca.ibone.comcast.net</a>          60    60  0.0%   18.1  <a href="tel:36.0%20221.3%20%2038.0" value="+13602213380">36.0 221.3  38.0</a><br>


 10. 208.178.58.1                                               60    60  0.0%   17.1  40.8 366.8  51.5<br>
 11. <a href="http://po4-20G.ar2.SJC2.gblx.net" target="_blank">po4-20G.ar2.SJC2.gblx.net</a>                                  60    59  1.7%   16.8  58.3 291.6  68.0<br>
 12. <a href="http://po1-20G.ar3.SJC2.gblx.net" target="_blank">po1-20G.ar3.SJC2.gblx.net</a>                                  60    46 23.3%   16.8  67.3 258.6  66.5<br>
 13. <a href="http://Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net" target="_blank">Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net</a>    60    48 20.0%   17.3  34.9 155.8  32.0<br>
 14. <a href="http://10gigabitethernet1-1.core1.fmt1.he.net" target="_blank">10gigabitethernet1-1.core1.fmt1.he.net</a>                     60    19 68.3%   18.3  50.4 117.8  32.2<br>
 15. <a href="http://router1-fmt.linode.com" target="_blank">router1-fmt.linode.com</a>                                     60    22 63.3%   19.1  66.3 287.3  64.2<br>
 16. li163-###.<a href="http://members.linode.com" target="_blank">members.linode.com</a>                               60    23 61.7%   18.3  <a href="tel:42.5%20213.8%20%2048.7" value="+14252138487">42.5 213.8  48.7</a><br>


2013-01-19T12:16:27-0800<br>
<br>
<br>
Anyone from <a href="http://he.net" target="_blank">he.net</a> / <a href="http://gblx.net" target="_blank">gblx.net</a> / <a href="http://comcast.net" target="_blank">comcast.net</a> to comment?<br>
<br>
Best regards,<br>
Constantine.<br>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</blockquote></div><br></div>