<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">From one of our providers </span></div><div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br></span></div><div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);"><br></span></div><div><span style="-webkit-text-size-adjust: auto; background-color: rgba(255, 255, 255, 0);">On September 17th at 12:27 PDT our network monitoring system notified us that our bgp session went down with our upstream provider, Telia, and restored <a href="x-apple-data-detectors://6" x-apple-data-detectors="true" x-apple-data-detectors-type="calendar-event" x-apple-data-detectors-result="6">at 12:31 PDT</a> in our SJE PNAP location. Customers homed to the location may have noticed routing reconvergence and sub-optimal routing as traffic re-routed over our other available providers at the PNAP.<br><br>We are currently seeing the session up and stable at this time and are investigating the issue with our upstream provider and will update customers if there is any required maintenance.</span><br><br><span style="-webkit-text-size-adjust: auto;">Sent from my iPhone</span></div><div style="-webkit-text-size-adjust: auto; "><br>On Sep 17, 2013, at 18:53, Brandon Ewing <<a href="mailto:nicotine@warningg.com">nicotine@warningg.com</a>> wrote:<br><br></div><blockquote type="cite" style="-webkit-text-size-adjust: auto; "><div><span>Seeing a lot of packet loss from one of my datacenters to Digital Ocean in</span><br><span>San Francisco? Appears the issue is on a Telia link between Chicago and San</span><br><span>San Jose. MTR data below.</span><br><span></span><br><span>From KC to SFO:</span><br><span> Host Loss% Snt Last Avg Best Wrst StDev</span><br><span> 1. 10.253.99.252 0.0% 519 0.4 0.4 0.1 8.2 0.7</span><br><span> 2. 206.55.127.130 0.0% 519 0.5 9.2 0.3 403.3 36.1</span><br><span> 3. 64.57.221.97 0.0% 519 0.8 6.7 0.4 176.6 27.6</span><br><span> 4. 64.57.221.89 0.0% 519 0.4 0.7 0.3 24.8 1.2</span><br><span> 5. 4.53.32.77 44.7% 519 1.4 27.6 1.0 264.7 51.6</span><br><span> 6. 4.69.135.230 0.0% 519 13.8 11.2 10.2 36.8 2.2</span><br><span> 7. 4.69.151.153 0.2% 518 10.4 11.3 10.3 23.1 2.3</span><br><span> 8. 4.69.145.145 33.2% 518 10.4 11.0 10.1 43.2 3.3</span><br><span> 9. 4.68.70.58 5.6% 518 10.6 12.5 10.4 72.5 6.2</span><br><span>10. 213.155.137.44 0.0% 518 35.8 38.5 35.6 108.0 10.5</span><br><span>11. 213.248.80.25 78.7% 518 72.6 64.2 62.1 86.0 3.5</span><br><span>12. 62.115.34.18 76.6% 518 76.9 68.2 64.0 93.5 5.0</span><br><span>13. 198.199.101.129 76.0% 518 64.0 64.5 63.1 75.2 1.3</span><br><span></span><br><span>(Hops 10 and 11 are both Telia)</span><br><span></span><br><span></span><br><span>From SFO to KC:</span><br><span> 1. 198.199.100.253 0.0% 3.9 4.6 0.9 149.6 9.1</span><br><span> 2. 69.22.130.37 0.0% 0.6 3.3 0.3 82.5 9.8</span><br><span> 3. 69.22.143.170 0.0% 1.5 3.5 1.0 67.1 7.3</span><br><span> 4. 69.22.143.165 0.0% 10.9 4.5 1.6 66.8 9.1</span><br><span> 5. 69.22.143.118 1.6% 3.5 4.6 2.3 24.8 2.2</span><br><span> 6. 65.113.42.117 0.0% 1.9 4.1 1.5 65.0 8.3</span><br><span> 7. 67.14.11.214 0.0% 40.6 44.2 40.3 141.6 12.9</span><br><span> 8. 67.128.242.166 84.9% 63.6 63.6 62.7 71.0 1.2</span><br><span> 9. 64.57.221.82 76.7% 65.4 70.0 63.0 243.4 28.1</span><br><span>10. 64.57.221.98 84.2% 63.9 70.9 63.1 228.9 28.0</span><br><span>11. 198.247.174.11 91.6% 63.1 63.8 63.0 66.1 0.7</span><br><span>12. ???</span><br><span></span><br><span>(Hop 7 is Qwest, hop 8 is us)</span><br><span></span><br><span>Unaffected host (Chicago) to SFO:</span><br><span> 1. 69.175.4.253 0.0% 0.5 4.1 0.5 186.5 19.1</span><br><span> 2. 69.175.1.245 2.2% 0.3 9.2 0.3 210.7 30.8</span><br><span> 3. 69.31.110.201 1.8% 1.5 2.4 0.8 15.9 1.4</span><br><span> 4. 69.31.110.253 0.2% 0.8 3.2 0.8 77.3 8.4</span><br><span> 5. 69.22.142.169 0.0% 23.3 25.3 23.0 73.4 5.8</span><br><span> 6. 69.22.142.166 0.5% 35.8 36.5 35.6 87.4 4.6</span><br><span> 7. 69.22.142.59 0.2% 36.3 38.0 36.1 80.4 6.3</span><br><span> 8. 69.22.142.97 0.0% 52.6 54.5 52.6 101.6 6.7</span><br><span> 9. 69.22.130.38 0.0% 59.2 58.4 55.0 172.8 8.1</span><br><span>10. 198.199.101.129 0.0% 54.7 54.8 54.5 96.0 1.8</span><br><span></span><br><span>Anyone else seeing this issue? Not a customer of the SFO side, so I can't open a ticket. :/</span><br><span></span><br><span>-- </span><br><span>Brandon Ewing (<a href="mailto:nicotine@warningg.com">nicotine@warningg.com</a>)</span><br></div></blockquote><blockquote type="cite" style="-webkit-text-size-adjust: auto; "><div><span>_______________________________________________</span><br><span>Outages mailing list</span><br><span><a href="mailto:Outages@outages.org">Outages@outages.org</a></span><br><span><a href="https://puck.nether.net/mailman/listinfo/outages">https://puck.nether.net/mailman/listinfo/outages</a></span><br></div></blockquote></body></html>