<div dir="ltr">I don't think this was TODAYS outage. It was from over a day ago. </div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Feb 13, 2014 at 12:21 PM, Luke Rockwell <span dir="ltr"><<a href="mailto:luke.rockwell@alumni.berkeley.edu" target="_blank">luke.rockwell@alumni.berkeley.edu</a>></span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Offical L3 log<div><br></div><div><div style="margin:0px;padding:3px 0px 3px 5px;list-style-type:none;clear:both;color:rgb(255,255,255);font-size:12px;font-weight:bold;width:inherit;min-height:23px;line-height:2;font-family:Arial;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bg_title.gif)!important;background-color:rgb(60,60,60)!important;background-repeat:repeat no-repeat!important">


<span style="margin:0px;padding:0px 5px 0px 18px;list-style-type:none;border:0px;font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit;vertical-align:baseline;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bullet_redsquare.png);min-height:21px;background-repeat:no-repeat no-repeat">Network Event Detail</span></div>


<div style="clear:both;line-height:17.280000686645508px;list-style-type:none;font-size:12px;font-family:Arial;margin:0px;padding:8px 20px"><table cellpadding="0" cellspacing="5" border="0" width="100%" style="margin:0px;padding:0px;list-style-type:none;border-collapse:collapse;border-spacing:0px">


<tbody style="margin:0px;padding:0px;list-style-type:none"><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" width="30%" style="padding:3px 5px 2px;list-style-type:none">Network Event Summary:</td>

<td style="padding:3px 5px 2px;list-style-type:none">
A suspected Denial of Service (DoS) attack on several links was impacting Voice and IP services in multiple markets.  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">


Event Ticket ID:</td><td style="padding:3px 5px 2px;list-style-type:none">7531588</td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Market Area Affected:</td>


<td style="padding:3px 5px 2px;list-style-type:none">Multiple Markets  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Ticket Create Date:</td>


<td style="padding:3px 5px 2px;list-style-type:none">2/12/14 1:26:49 AM GMT  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Impacted For:</td>


<td style="padding:3px 5px 2px;list-style-type:none"><b style="margin:0px;padding:0px;list-style-type:none">2 hours 32 minutes</b>  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">


Event Status:</td><td style="padding:3px 5px 2px;list-style-type:none">Restored  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Resolve Date:</td>


<td style="padding:3px 5px 2px;list-style-type:none">2/13/14 5:02:13 PM GMT  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Time Since Last Update:</td>


<td style="padding:3px 5px 2px;list-style-type:none"><b style="margin:0px;padding:0px;list-style-type:none">1 day 12 hours 39 minutes</b>  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td colspan="2" valign="top" style="padding:3px 5px 2px;list-style-type:none">


<b style="margin:0px;padding:0px;list-style-type:none">There are currently no reported impacts to your services caused by this network event. If you are experiencing a service disruption, please report the issue to Level 3 by submitting a ticket via the MyLevel3 Portal or calling 877-4LEVEL3.</b><br style="margin:0px;padding:0px;list-style-type:none">


</td></tr></tbody></table></div><div style="margin:0px;padding:3px 0px 3px 5px;list-style-type:none;clear:both;color:rgb(255,255,255);font-size:12px;font-weight:bold;width:inherit;min-height:23px;line-height:2;font-family:Arial;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bg_title.gif)!important;background-color:rgb(60,60,60)!important;background-repeat:repeat no-repeat!important">


<span style="margin:0px;padding:0px 5px 0px 18px;list-style-type:none;border:0px;font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit;vertical-align:baseline;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bullet_redsquare.png);min-height:21px;background-repeat:no-repeat no-repeat">Recent Notes</span></div>


<div style="clear:both;line-height:17.280000686645508px;list-style-type:none;font-size:12px;font-family:Arial;margin:0px;padding:8px 20px"><table cellspacing="1" cellpadding="2" width="99%" style="margin:0px;padding:0px;list-style-type:none;border-collapse:collapse;border-spacing:0px;border:1px solid rgb(0,0,0)">


<tbody style="margin:0px;padding:0px;list-style-type:none"><tr style="margin:0px;padding:0px;list-style-type:none"><td width="27%" style="padding:2px;list-style-type:none;background-color:rgb(60,60,60);color:rgb(255,255,255);font-weight:bold">


Date</td><td width="73%" style="padding:2px;list-style-type:none;background-color:rgb(60,60,60);color:rgb(255,255,255);font-weight:bold">Notes</td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none">


2/12/14 4:41:37 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The IP NOC and Operations Engineering have confirmed that the issue has resolved. It has been advised that monitoring will continue to ensure the links remain stable. Should further issues be experienced, please contact the Technical Service Center at 877-4LEVEL3.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/12/14 4:01:32 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


The IP NOC has advised that the issue is believed to have been mitigated. Operations Engineers are currently working to confirm that no further impact is being experienced at this time.</td></tr><tr style="margin:0px;padding:0px;list-style-type:none">


<td valign="top" style="padding:2px;list-style-type:none">2/12/14 2:57:57 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none">Operations Engineers continue investigating the issue with the IP NOC and Tier III Technical Support.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/12/14 2:25:58 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


Operations Engineering has advised that Tier III Technical Support is being engaged at this time to assist with investigations.</td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none">


2/12/14 2:03:18 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The IP NOC continues working diligently with Operations Engineering to identify the source of the attack.</td></tr><tr style="margin:0px;padding:0px;list-style-type:none">


<td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/12/14 1:41:56 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">It has been confirmed that IP services are also being impacted. The IP NOC has advised that that the issue is suspected to be the result of a Denial of Service (DoS) attack on several links in the United States. Operations Engineering are being engaged at this time to assist with investigations.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none">2/12/14 1:30:01 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The Voice NOC has reported that the Border Gateway Protocol bounced on an IP link, impacting voice services in multiple markets. Investigations are currently ongoing to determine the full impact of the issue.</td>


</tr></tbody></table></div></div><div class="gmail_extra"><br></div><div class="gmail_extra">Here is another event I dont know if it is related</div><div class="gmail_extra"><div style="margin:0px;padding:3px 0px 3px 5px;list-style-type:none;clear:both;color:rgb(255,255,255);font-size:12px;font-weight:bold;width:inherit;min-height:23px;line-height:2;font-family:Arial;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bg_title.gif)!important;background-color:rgb(60,60,60)!important;background-repeat:repeat no-repeat!important">


<span style="margin:0px;padding:0px 5px 0px 18px;list-style-type:none;border:0px;font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit;vertical-align:baseline;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bullet_redsquare.png);min-height:21px;background-repeat:no-repeat no-repeat">Network Event Detail</span></div>


<div style="clear:both;line-height:17.280000686645508px;list-style-type:none;font-size:12px;font-family:Arial;margin:0px;padding:8px 20px"><table cellpadding="0" cellspacing="5" border="0" width="100%" style="margin:0px;padding:0px;list-style-type:none;border-collapse:collapse;border-spacing:0px">


<tbody style="margin:0px;padding:0px;list-style-type:none"><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" width="30%" style="padding:3px 5px 2px;list-style-type:none">Network Event Summary:</td>

<td style="padding:3px 5px 2px;list-style-type:none">
Packet loss across multiple markets in North America was impacting IP services.  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Event Ticket ID:</td>


<td style="padding:3px 5px 2px;list-style-type:none">7524423</td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Market Area Affected:</td><td style="padding:3px 5px 2px;list-style-type:none">


Multiple Markets  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Ticket Create Date:</td><td style="padding:3px 5px 2px;list-style-type:none">


2/10/14 5:06:48 PM GMT  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Impacted For:</td><td style="padding:3px 5px 2px;list-style-type:none">


<b style="margin:0px;padding:0px;list-style-type:none">17 hours 8 minutes</b>  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Event Status:</td>


<td style="padding:3px 5px 2px;list-style-type:none">Restored  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Resolve Date:</td><td style="padding:3px 5px 2px;list-style-type:none">


2/13/14 5:05:39 PM GMT  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:3px 5px 2px;list-style-type:none">Time Since Last Update:</td><td style="padding:3px 5px 2px;list-style-type:none">


<b style="margin:0px;padding:0px;list-style-type:none">2 days 13 hours 45 minutes</b>  </td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td colspan="2" valign="top" style="padding:3px 5px 2px;list-style-type:none">


<b style="margin:0px;padding:0px;list-style-type:none">There are currently no reported impacts to your services caused by this network event. If you are experiencing a service disruption, please report the issue to Level 3 by submitting a ticket via the MyLevel3 Portal or calling 877-4LEVEL3.</b><br style="margin:0px;padding:0px;list-style-type:none">


</td></tr></tbody></table></div><div style="margin:0px;padding:3px 0px 3px 5px;list-style-type:none;clear:both;color:rgb(255,255,255);font-size:12px;font-weight:bold;width:inherit;min-height:23px;line-height:2;font-family:Arial;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bg_title.gif)!important;background-color:rgb(60,60,60)!important;background-repeat:repeat no-repeat!important">


<span style="margin:0px;padding:0px 5px 0px 18px;list-style-type:none;border:0px;font-family:inherit;font-size:inherit;font-style:inherit;font-variant:inherit;font-weight:inherit;line-height:inherit;vertical-align:baseline;background-image:url(https://mylevel3.net/portalWeb/framework/skins/l3enabledportal_nov2008/images/common/bullet_redsquare.png);min-height:21px;background-repeat:no-repeat no-repeat">Recent Notes</span></div>


<div style="clear:both;line-height:17.280000686645508px;list-style-type:none;font-size:12px;font-family:Arial;margin:0px;padding:8px 20px"><table cellspacing="1" cellpadding="2" width="99%" style="margin:0px;padding:0px;list-style-type:none;border-collapse:collapse;border-spacing:0px;border:1px solid rgb(0,0,0)">


<tbody style="margin:0px;padding:0px;list-style-type:none"><tr style="margin:0px;padding:0px;list-style-type:none"><td width="27%" style="padding:2px;list-style-type:none;background-color:rgb(60,60,60);color:rgb(255,255,255);font-weight:bold">


Date</td><td width="73%" style="padding:2px;list-style-type:none;background-color:rgb(60,60,60);color:rgb(255,255,255);font-weight:bold">Notes</td></tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none">


2/11/14 3:34:25 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The Operations Engineering team reported that the script that was developed was successful in resolving the packet loss issue. It has been informed that the issue has resolved and services have restored. If additional issues are experienced, please contact the Level 3 Technical Service Center.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/11/14 2:12:21 AM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


The Operations Engineering team advised that the scripts are currently running at this time in an effort to restore services. An estimated restoral time remains unknown and the next update will be sent as new information is received.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none">2/10/14 11:30:05 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none">At this time, the Technical Service Center is working with the IP NOC to develop a script that can push the filter to a larger group of customers to expedite restoration. After the script is run, teams will validate deployment success to ensure stability. The Operations Engineering team reported that approximately fifty percent of the impact has been mitigated and efforts continue to increase that percentage as quickly as possible. The next update will be provided at approximately 01:00 GMT or as new information is made available.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/10/14 11:10:30 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


The Operation Engineering team is diligently working to restore impacted services. An estimated restoration time is unavailable, but updates will be provided as soon as more information is made available.</td></tr><tr style="margin:0px;padding:0px;list-style-type:none">


<td valign="top" style="padding:2px;list-style-type:none">2/10/14 9:00:58 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The Operation Engineering team has advised that they are investigating a mass deployment to expedite service restoral. Unfortunately, an estimated restoral time is not available as it may vary for impacted customers.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/10/14 7:51:53 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


The Operations Engineering team continues to work to isolate a solution for the packet loss. The investigating group is unable to provide an ETTR for this case at this time.</td></tr><tr style="margin:0px;padding:0px;list-style-type:none">


<td valign="top" style="padding:2px;list-style-type:none">2/10/14 7:10:14 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none">The Operations Engineering team continues to troubleshoot the issue in an effort to restore services.</td>


</tr><tr style="margin:0px;padding:0px;list-style-type:none"><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">2/10/14 5:28:31 PM GMT</td><td valign="top" style="padding:2px;list-style-type:none;background-color:rgb(238,238,238)">


The IP Technical Service Center reported multiple customers that are experiencing an outage to IP services due to heavy packet loss across multiple markets in North America. Numerous managed devices are unresponsive at this time, and the Network Operations Engineering teams are currently working to mitigate the packet loss and restore stability to individual customers. An estimated restoral time is not available as it may vary for impacted customers.</td>


</tr></tbody></table></div></div><div><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Feb 13, 2014 at 4:59 AM, Chris Stone <span dir="ltr"><<a href="mailto:cstone@axint.net" target="_blank">cstone@axint.net</a>></span> wrote:<br>


<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
  
    
  
  <div text="#000000" bgcolor="#FFFFFF">
    <div>Got that from L3 as well. Looks like my
      sessions have been up and stable since 02:23:32 MST.<div><div><br>
      <br>
      <br>
      On 02/13/2014 03:41 AM, Mitch Patterson wrote:<br>
    </div></div></div>
    <blockquote type="cite"><div><div>
      <div dir="ltr">Final notes from them. Any one still seeing issues?
        My direct level 3 circuits look good on a spot check. Still
        having issues with a ISP that has Level 3 as their only major
        upstream
        <div><br>
        </div>
        <div>
          <p>
            *** CASCADED EXTERNAL NOTES 13-Feb-2014 10:32:49 GMT From
            CASE: 7538219 - Event A packet loss issue impacted IP
            Services across multiple
            markets in the North America. The Technical Service Center
            worked with the IP
            NOC to develop a configuration change to a larger group of
            customers to
            expedite restoration. After the configuration change was
            run, teams validated
            the deployment success to ensure stability. The Operations
            Engineering team
            reported that the configuration change that was developed
            was successful in
            resolving the packet loss issue. It was communicated that
            the issue has
            resolved and services have restored. If additional issues
            are experienced,
            please contact the Level 3 Technical Service Center.</p>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <br>
        <div class="gmail_quote">On Thu, Feb 13, 2014 at 4:10 AM, Mitch
          Patterson <span dir="ltr"><<a href="mailto:mitpatterson@gmail.com" target="_blank">mitpatterson@gmail.com</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
            <div dir="ltr">Latest update
              <div><br>
              </div>
              <div>
                <p>*** CASCADED EXTERNAL NOTES 13-Feb-2014 09:07:11 GMT
                  From
                  CASE: 7538219 - Event Security Ops attempted to apply
                  filters on the network
                  routers to reject the IP traffic of the DDoS attacks. 
                  However, the filters were unsuccessful due to
                  the multiple sources of the attack.  Security
                  is attempting another plan to limit the effect of the
                  attack on the targeted
                  destination of the DDoS attack.</p>
              </div>
            </div>
            <div>
              <div>
                <div class="gmail_extra"><br>
                  <br>
                  <div class="gmail_quote">On Thu, Feb 13, 2014 at 3:28
                    AM, Mitch Patterson <span dir="ltr"><<a href="mailto:mitpatterson@gmail.com" target="_blank">mitpatterson@gmail.com</a>></span>
                    wrote:<br>
                    <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                      <p dir="ltr">Same reply they gave me.</p>
                      <div>
                        <div>
                          <div class="gmail_quote">On Feb 13, 2014 3:27
                            AM, "Petter Bruland" <<a href="mailto:Petter.Bruland@allegiantair.com" target="_blank">Petter.Bruland@allegiantair.com</a>>
                            wrote:<br type="attribution">
                            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
                              <div>
                                <div style="direction:ltr;font-size:12pt;font-family:Arial">We
                                  saw similar issues with Level3 at
                                  Switch SuperNAP in Las Vegas.<br>
                                  <br>
                                  Last we heard:<br>
                                  <span style="color:rgb(31,73,125)">Level-3 IP
                                    NOC Team and Security Ops are
                                    applying filters on affected routers
                                    to re-establish routing sessions and
                                    restore normal operations but they
                                    have not provided any ETR as of now.</span><br>
                                  <br>
                                  -P<br>
                                  <div><br>
                                    <div style="font-family:Tahoma;font-size:13px">
                                      <table style="border-color:rgb(0,0,0)" border="0" cellspacing="0">
                                        <tbody>
                                          <tr>
                                            <td style="border-color:rgb(0,0,0);border-width:0pt" valign="center" align="left">
                                              <div align="left"><br>
                                              </div>
                                            </td>
                                            <td style="border-color:rgb(0,0,0);border-width:0pt" valign="center" align="left">
                                              <div align="left"><strong><font>Petter
                                                    Bruland </font></strong><font color="#000000">|
                                                  Network Engineer
                                                </font><font size="1" color="#000000"><br>
                                                  <sub><font>Allegiant
                                                      Travel Company</font></sub><br>
                                                  8360 S. Durango Drive,
                                                  Las Vegas, NV 89113 <br>
                                                  Phone: <a href="tel:%28702%29%20874-3332" value="+17028743332" target="_blank">(702)
                                                    874-3332</a> | Cell:
                                                  <a href="tel:%28702%29%20286-6549" value="+17022866549" target="_blank">(702)
                                                    286-6549</a> <br>
                                                  <a href="mailto:petter.bruland@allegiantair.com" target="_blank">petter.bruland@allegiantair.com</a>
                                                  <br>
                                                  <a href="http://www.allegiantair.com" target="_blank">http://www.allegiantair.com</a></font>
                                              </div>
                                            </td>
                                          </tr>
                                        </tbody>
                                      </table>
                                    </div>
                                  </div>
                                  <div style="font-size:16px;font-family:'Times New Roman'">
                                    <hr>
                                    <div style="direction:ltr"><font color="#000000" face="Tahoma"><b>From:</b>
                                        Outages [<a href="mailto:outages-bounces@outages.org" target="_blank">outages-bounces@outages.org</a>]
                                        on behalf of Mitch Patterson [<a href="mailto:mitpatterson@gmail.com" target="_blank">mitpatterson@gmail.com</a>]<br>
                                        <b>Sent:</b> Wednesday, February
                                        12, 2014 11:38 PM<br>
                                        <b>To:</b> <a href="mailto:outages@outages.org" target="_blank">outages@outages.org</a><br>
                                        <b>Subject:</b> [outages] Level
                                        3 issues....again<br>
                                      </font><br>
                                    </div>
                                    <div>
                                      <div dir="ltr">Massive Level 3
                                        issues again. Got this from
                                        them:
                                        <div><br>
                                        </div>
                                        <div>
                                          <p> </p>
                                          <p>The IP NOC has detected
                                            Denial of Service (DoS)
                                            attacks on various network
                                            routers in Houston, TX. The
                                            IP NOC is analyzing the
                                            routing protocol session
                                            failures to determine the
                                            next course of action.</p>
                                          <p> </p>
                                          <p>IP NOC and Security Ops are
                                            working on resolving the BGP
                                            sessions failures on network
                                            routers affected by the DDoS
                                            attack.</p>
                                        </div>
                                      </div>
                                    </div>
                                  </div>
                                </div>
                              </div>
                            </blockquote>
                          </div>
                        </div>
                      </div>
                    </blockquote>
                  </div>
                  <br>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      </div></div><div><pre>_______________________________________________
Outages mailing list
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a>
</pre>
    </div></blockquote>
    <br>
  </div>

<br>_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br></blockquote></div><br></div></div></div></div>
<br>_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
<br></blockquote></div><br></div>