[Outages-discussion] [outages] Fwd: RE: FYI Netflix is down

virendra rode virendra.rode at outages.org
Tue Jul 3 14:08:19 EDT 2012


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 07/03/2012 10:16 AM, Frank Bulk wrote:
> Here?s AWS? writeup: http://aws.amazon.com/message/67457/
> 
> 
> 
> Frank
- ----------------------
lesson learned section updated.

http://wiki.outages.org/index.php/Lessons_learned


regards,
/virendra

> 
> 
> 
> From: outages-discussion-bounces at outages.org
> [mailto:outages-discussion-bounces at outages.org] On Behalf Of Frank
> Bulk Sent: Monday, July 02, 2012 8:26 AM To: 'Bill Wichers';
> blackham at gmail.com; fergdawgster at gmail.com Cc:
> outages-discussion at outages.org Subject: Re: [Outages-discussion]
> [outages] Fwd: RE: FYI Netflix is down
> 
> 
> 
> According to a Minnesota Public Radio this morning, ??Amazon worked
> to restore both its primary power supply and backup generators at
> its Virginia facility.?
> 
> http://www.marketplace.org/topics/tech/storms-hit-amazon-data-center-netflix-and-instagram
>
> 
> 
> 
> I have not seen this documented elsewhere, so I wonder if it?s
> speculation or based on a statement that Amazon provided NPR/MPR or
> was communicated elsewhere.
> 
> 
> 
> Frank
> 
> 
> 
> From: outages-discussion-bounces at outages.org
> [mailto:outages-discussion-bounces at outages.org] On Behalf Of Bill
> Wichers Sent: Saturday, June 30, 2012 9:46 AM To:
> blackham at gmail.com; fergdawgster at gmail.com Cc:
> outages-discussion at outages.org Subject: Re: [Outages-discussion]
> [outages] Fwd: RE: FYI Netflix is down
> 
> 
> 
> Does anyone know what actually caused the failure? I know there was
> a "power outage" due to weather, but presumably the physical site
> would have also had generator backup so that must have also
> failed?
> 
> [Sent using Blackberry Messaging]
> 
> ----- Original Message ----- From:
> outages-discussion-bounces at outages.org
> <outages-discussion-bounces at outages.org> To: Paul Ferguson
> <fergdawgster at gmail.com> Cc: outages-discussion at outages.org
> <outages-discussion at outages.org> Sent: Sat Jun 30 01:46:05 2012 
> Subject: Re: [Outages-discussion] [outages] Fwd: RE: FYI Netflix is
> down
> 
> That is a good point.  Why didn't they survive in an adjacent AZ
> in Ashburn?  Reports say only a single AZ lost power.
> 
> On Fri, Jun 29, 2012 at 10:15 PM, Paul Ferguson
> <fergdawgster at gmail.com> wrote:
>> I'm looking forward to additional details on this outage --
>> Netflix has previously avoided EC2 outages due to their creative
>> use of Chaos Monkey:
>> 
>> http://techblog.netflix.com/2011/07/netflix-simian-army.html
>> 
>> FYI,
>> 
>> - ferg
>> 
>> On Fri, Jun 29, 2012 at 10:07 PM, Kevin Blackham
>> <blackham at gmail.com> wrote:
>> 
>>> On Fri, Jun 29, 2012 at 9:40 PM, Paul Ferguson
>>> <fergdawgster at gmail.com> wrote:
>>>> http://venturebeat.com/2012/06/29/amazon-outage-netflix-instagram-pinterest/
>>>
>>>
>>>> 
"The outage underscores the vulnerabilities of depending on the public
>>> cloud versus using your own data centers."
>>> 
>>> Let me fix that: "The outage underscores the lack of attention
>>> to failure tolerance by many affected services." Building my
>>> own sites isn't going to keep them from failing. Every
>>> datacenter will fail eventually.
>>> 
>>> Granted, when an Amazon AZ fails, history has shown the thrash
>>> induced by recovery mechanisms can also take out adjacent AZs
>>> (e.g. network overloads vs. EBS), but that doesn't stop an
>>> architect from considering regional redundancy. 
>>> _______________________________________________ 
>>> Outages-discussion mailing list Outages-discussion at outages.org 
>>> https://puck.nether.net/mailman/listinfo/outages-discussion
>> 
>> 
>> 
>> -- "Fergie", a.k.a. Paul Ferguson fergdawgster(at)gmail.com
> _______________________________________________ Outages-discussion
> mailing list Outages-discussion at outages.org 
> https://puck.nether.net/mailman/listinfo/outages-discussion
> 
> 
> 
> 
> _______________________________________________ Outages-discussion
> mailing list Outages-discussion at outages.org 
> https://puck.nether.net/mailman/listinfo/outages-discussion
> 


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iF4EAREIAAYFAk/zNRIACgkQ3HuimOHfh+FdKAD+KHtv7rWpWDWjQkr5Wt+BR5Gg
fyMeyUM2s7XDdBi2REQA/id1LvylY+QEqxshg7F4KUnhtxSo1fgy6d8WsnwqUENB
=79TG
-----END PGP SIGNATURE-----


More information about the Outages-discussion mailing list