<div dir="auto">Getting into to -discussion territory here, but I suspect they had difficulty circulating the air sufficiently. Having cold air isn't enough; you have to swap it out for the hot air pretty often.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jan 14, 2024, 10:22 PM Jay Ashworth <<a href="mailto:jra@baylink.com">jra@baylink.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div dir="auto">Windy.com tells me that the outside temperature in Chicago right now is -8F. I'm not sure why it wouldn't work...</div><br><br><div class="gmail_quote"><div dir="auto">On January 14, 2024 10:20:56 PM EST, Ross Tajvar <<a href="mailto:ross@tajvar.io" target="_blank" rel="noreferrer">ross@tajvar.io</a>> wrote:</div><blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">They tried that:<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span style="font-family:arial,helvetica,sans-serif;font-size:13.3333px">IBX Critical Facility Engineers have deployed all available floor fans, opened all available doors and have engaged local rental company to source additional fans and portable spot coolers.</span><br></blockquote></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Jan 14, 2024 at 10:19 PM Jay Ashworth via Outages <<a href="mailto:outages@outages.org" target="_blank" rel="noreferrer">outages@outages.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div><div dir="auto">Open the doors?</div><br><br><div class="gmail_quote"><div dir="auto">On January 14, 2024 9:52:24 PM EST, Mike Hammett via Outages <<a href="mailto:outages@outages.org" target="_blank" rel="noreferrer">outages@outages.org</a>> wrote:</div><blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="font-family:arial,helvetica,sans-serif;font-size:10pt;color:rgb(0,0,0)"><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">IBX: CH1</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">IBX Address: 350 E Cermak Rd, Chicago, 60616</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">Number: INC0025932</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">Date and Time of Occurrence: 2024-01-14 08:20:49 Site Local Time</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px"><br></span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">To view the incident and its updates, please use Service Insight. </span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">New update on Incident INC0025932: Equinix IBX Site Staff reports that temperatures have stabilized with an average temperature of 120 F degrees. One chiller is now fully operational, and another chiller is online but operating at reduced capacity. Equinix IBX Critical Facility Engineers continue to work on restoring the required 4-out-of-6 chillers to return cooling back to normal operations. Portable chillers are currently enroute with an estimated arrival time of 21:00 Site Local Time. Upon arrival, IBX Critical Facility Engineers and our vendor partner will work diligently to get the portable chillers online as quickly as possible. We will send another update once the portable chillers are operational. </span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px"><br></span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">If not already implemented, Equinix site staff highly recommends that customers power down non-essential loads within the data center and/or transfer those operations to backup sites to assist with efforts at lowering the temperature within the facility. </span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px"><br></span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">The severe weather in the Chicago area, contributing to the initial failure, continues to hamper efforts at resolution, but our teams are working diligently to resolve the issue as quickly as possible. IBX Critical Facility Engineers continue to supply outside air to decrease the collocation area's temperature, and all fans have been deployed to support cooling the IBX.</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">•<span style="white-space:pre-wrap"> </span>Service Offering: CH1 - Location - Floor</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">•<span style="white-space:pre-wrap"> </span>Affected Assets: 05</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">•<span style="white-space:pre-wrap"> </span>Asset Condition: Temperature above operating range</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">•<span style="white-space:pre-wrap"> </span>Situation status: Under investigation</span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px"><br></span></font></div><div><font face="arial, helvetica, sans-serif"><span style="font-size:13.3333px">The next update will be provided in approximately 30 minutes or earlier if available.</span></font></div><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:10pt"><br></div><br><div style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:10pt"><span name="x"></span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">-----</span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Mike Hammett</span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.ics-il.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">Intelligent Computing Solutions</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/ICSIL" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/fbicon.png" style="border:0pt none"></a><a href="https://plus.google.com/+IntelligentComputingSolutionsDeKalb" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/googleicon.png" style="border:0pt none"></a><a href="https://www.linkedin.com/company/intelligent-computing-solutions" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/linkedinicon.png" style="border:0pt none"></a><a href="https://twitter.com/ICSIL" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/twittericon.png" style="border:0pt none"></a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.midwest-ix.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">Midwest Internet Exchange</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/mdwestix" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/fbicon.png" style="border:0pt none"></a><a href="https://www.linkedin.com/company/midwest-internet-exchange" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/linkedinicon.png" style="border:0pt none"></a><a href="https://twitter.com/mdwestix" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/twittericon.png" style="border:0pt none"></a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.thebrotherswisp.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">The Brothers WISP</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/thebrotherswisp" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/fbicon.png" style="border:0pt none"></a><a href="https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img src="http://www.ics-il.com/images/youtubeicon.png" style="border:0pt none"></a><span name="x"></span><br></div><hr id="m_2439812066273505351m_-1762243829776229833zwchr" style="color:rgb(0,0,0);font-family:arial,helvetica,sans-serif;font-size:10pt"><div style="color:rgb(0,0,0);font-family:Helvetica,Arial,sans-serif;font-size:12pt;font-weight:normal;font-style:normal;text-decoration:none"><b>From: </b>"Mike Hammett via Outages" <<a href="mailto:outages@outages.org" target="_blank" rel="noreferrer">outages@outages.org</a>><br><b>To: </b>"outages" <<a href="mailto:outages@outages.org" target="_blank" rel="noreferrer">outages@outages.org</a>><br><b>Sent: </b>Sunday, January 14, 2024 2:04:51 PM<br><b>Subject: </b>[outages] Equinix CH1 Overheating<br><br><div style="font-family:arial,helvetica,sans-serif;font-size:10pt;color:rgb(0,0,0)">Equinix CH1 is overheating due to some chiller failures. The vendor is on-site troubleshooting. Ambient temperature is currently 28 degrees higher than normal.<br><br><div><span></span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">-----</span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline">Mike Hammett</span><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.ics-il.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">Intelligent Computing Solutions</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/ICSIL" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/fbicon.png"></a><a href="https://plus.google.com/+IntelligentComputingSolutionsDeKalb" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/googleicon.png"></a><a href="https://www.linkedin.com/company/intelligent-computing-solutions" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/linkedinicon.png"></a><a href="https://twitter.com/ICSIL" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/twittericon.png"></a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.midwest-ix.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">Midwest Internet Exchange</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/mdwestix" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/fbicon.png"></a><a href="https://www.linkedin.com/company/midwest-internet-exchange" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/linkedinicon.png"></a><a href="https://twitter.com/mdwestix" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/twittericon.png"></a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="http://www.thebrotherswisp.com/" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank">The Brothers WISP</a><br style="color:rgb(0,0,0);font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><a href="https://www.facebook.com/thebrotherswisp" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/fbicon.png"></a><a href="https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg" style="font-family:"times new roman";font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" rel="nofollow noopener noreferrer noreferrer" target="_blank"><img style="border:0pt none" src="http://www.ics-il.com/images/youtubeicon.png"></a><span></span><br></div></div><br>_______________________________________________<br>Outages mailing list<br><a href="mailto:Outages@outages.org" target="_blank" rel="noreferrer">Outages@outages.org</a><br><a href="https://puck.nether.net/mailman/listinfo/outages" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/outages</a><br></div><br></div></blockquote></div><div dir="auto"><div>-- <br>Sent from my Android device with K-9 Mail. Please excuse my brevity.</div></div></div>_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank" rel="noreferrer">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer noreferrer" target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br>
</div></blockquote></div>
</blockquote></div><div dir="auto"><div>-- <br>Sent from my Android device with K-9 Mail. Please excuse my brevity.</div></div></div></blockquote></div>