[Outages-discussion] [outages] Fwd: RE: FYI Netflix is down

[Frank Bulk]

Here’s AWS’ writeup: http://aws.amazon.com/message/67457/

 

Frank

 

From: outages-discussion-bounces at outages.org [mailto:outages-discussion-bounces at outages.org] On Behalf Of Frank Bulk
Sent: Monday, July 02, 2012 8:26 AM
To: 'Bill Wichers'; blackham at gmail.com; fergdawgster at gmail.com
Cc: outages-discussion at outages.org
Subject: Re: [Outages-discussion] [outages] Fwd: RE: FYI Netflix is down

 

According to a Minnesota Public Radio this morning, “…Amazon worked to restore both its primary power supply and backup generators at its Virginia facility.”

http://www.marketplace.org/topics/tech/storms-hit-amazon-data-center-netflix-and-instagram

 

I have not seen this documented elsewhere, so I wonder if it’s speculation or based on a statement that Amazon provided NPR/MPR or was communicated elsewhere.

 

Frank

 

From: outages-discussion-bounces at outages.org [mailto:outages-discussion-bounces at outages.org] On Behalf Of Bill Wichers
Sent: Saturday, June 30, 2012 9:46 AM
To: blackham at gmail.com; fergdawgster at gmail.com
Cc: outages-discussion at outages.org
Subject: Re: [Outages-discussion] [outages] Fwd: RE: FYI Netflix is down

 

Does anyone know what actually caused the failure? I know there was a "power outage" due to weather, but presumably the physical site would have also had generator backup so that must have also failed?

[Sent using Blackberry Messaging]

----- Original Message -----
From: outages-discussion-bounces at outages.org <outages-discussion-bounces at outages.org>
To: Paul Ferguson <fergdawgster at gmail.com>
Cc: outages-discussion at outages.org <outages-discussion at outages.org>
Sent: Sat Jun 30 01:46:05 2012
Subject: Re: [Outages-discussion] [outages] Fwd: RE: FYI Netflix is down

That is a good point.  Why didn't they survive in an adjacent AZ in
Ashburn?  Reports say only a single AZ lost power.

On Fri, Jun 29, 2012 at 10:15 PM, Paul Ferguson <fergdawgster at gmail.com> wrote:
> I'm looking forward to additional details on this outage -- Netflix
> has previously avoided EC2 outages due to their creative use of Chaos
> Monkey:
>
> http://techblog.netflix.com/2011/07/netflix-simian-army.html
>
> FYI,
>
> - ferg
>
> On Fri, Jun 29, 2012 at 10:07 PM, Kevin Blackham <blackham at gmail.com> wrote:
>
>> On Fri, Jun 29, 2012 at 9:40 PM, Paul Ferguson <fergdawgster at gmail.com> wrote:
>>> http://venturebeat.com/2012/06/29/amazon-outage-netflix-instagram-pinterest/
>>
>> "The outage underscores the vulnerabilities of depending on the public
>> cloud versus using your own data centers."
>>
>> Let me fix that: "The outage underscores the lack of attention to
>> failure tolerance by many affected services." Building my own sites
>> isn't going to keep them from failing. Every datacenter will fail
>> eventually.
>>
>> Granted, when an Amazon AZ fails, history has shown the thrash induced
>> by recovery mechanisms can also take out adjacent AZs (e.g. network
>> overloads vs. EBS), but that doesn't stop an architect from
>> considering regional redundancy.
>> _______________________________________________
>> Outages-discussion mailing list
>> Outages-discussion at outages.org
>> https://puck.nether.net/mailman/listinfo/outages-discussion
>
>
>
> --
> "Fergie", a.k.a. Paul Ferguson
>  fergdawgster(at)gmail.com
_______________________________________________
Outages-discussion mailing list
Outages-discussion at outages.org
https://puck.nether.net/mailman/listinfo/outages-discussion

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20120703/e00a168b/attachment.html>