[Outages-discussion] CenturyLink Outages this morning

[Jay Farrell]

Looks like it'll be all good in less than 4 more hours, according to
this recent tweet:

--quote--

CenturyLink engineers have identified a network element that was
impacting customer services and are addressing the issue in order to
fully restore services. We estimate services will be fully restored
within 4 hours. We apologize for any inconvenience this caused our
customers.
11:47 PM - 27 Dec 2018

https://twitter.com/CenturyLink/status/1078512853664059392


On Fri, Dec 28, 2018 at 12:22 AM Jared Mauch <jared at puck.nether.net> wrote:
>
>
>
> > On Dec 28, 2018, at 12:11 AM, Jay Ashworth <jra at baylink.com> wrote:
> >
> > I got to tell you, reading back through that ticket, it certainly feels like the big ss7 storm from about 10 years ago. The question is, is it a bug or an attack.
> >
> > Or a test.
>
> <tinfoil hat=on>
>
> Given the DNS, BGP and other issues this year that have resulted in the theft of $$$, if I were a bank or an insurance company of a bank in the impacted QWEST territory I would have each ACH/WIRE/SWIFT transaction monitored and reviewed.
>
> </tinfoil hat>
>
> This smells like software upgrade gone wrong, or someone plugged a cable back in to something else and made a network topology loop via their switch or something similar.
>
> I’m not involved other than as a spectator for $dayJob.  I’ve been in the midst of some crazy stuff before, I don’t envy the people looking into this problem right now.  It’s a bad time to be finding people, and most places effectively shut down between Dec25 and Jan2.
>
> I do feel sorry for the consumers who are stuck behind 209 without an alternative.  I feel bad for those 911 centers that had to give out their direct numbers today.
>
> I also hope the involved vendor(s) and their customer solve the problem soon.  It seems to be intermittent as they troubleshoot more things based on the systems at $dayJob.  It’s certainly driving above average call volume.
>
> - Jared
>
> _______________________________________________
> Outages-discussion mailing list
> Outages-discussion at outages.org
> https://puck.nether.net/mailman/listinfo/outages-discussion