<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:LucidaGrande;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Thanks for laying it out Ryan.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Ryan Ratliff (rratliff) [mailto:rratliff@cisco.com]
<br>
<b>Sent:</b> Wednesday, November 15, 2017 10:57 AM<br>
<b>To:</b> Lelio Fulgenzi <lelio@uoguelph.ca><br>
<b>Cc:</b> Charles Goldsmith <wokka@justfamily.org>; cisco-voip list <cisco-voip@puck.nether.net><br>
<b>Subject:</b> Re: [cisco-voip] UCS C210 Replace 146 GB Disk in RAID5 with 300 GB Disk<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The 4 arrays on BE7K also have an impact on IOPS for the volume, though the servers are primarily built that way for array rebuild times as has been noted previously in this thread.
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On that server especially while one volume may be fine from a space perspective note that the amount of IOPS for DAS is derived from the number of disk spindles in the array. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">This means it is entirely possible to cause IO starvation problems on a BE7K by putting all the VMs on a single storage volume. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Spreading your VMs across the arrays will provide you protection against multiple disk failures (because they are RAID 5) AND spread the IOPS load across them.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">With respect to rebuilding a TRC’s RAID5 into RAID6 or RAID10 that server is no longer classified as a TRC and thus Cisco cannot guarantee the same level of performance we would otherwise.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">You may be perfectly comfortable with making such a change and willing to take on the risk, but guaranteeing the server meets the IOPS requirements of the apps running on it is your responsibility, not ours.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">If things go sideways you can expect TAC to ask you to rebuild it to a RAID5 (or at least one volume) the way it shipped as part of the troubleshooting process.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">-Ryan <o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Nov 14, 2017, at 11:33 AM, Lelio Fulgenzi <<a href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">Yeah, I hear ya. I mean, it’s not like there are not advantages, but, still, the managing of which array to put things in. ugh.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>From:</b><span class="apple-converted-space"> </span>Charles Goldsmith [<a href="mailto:wokka@justfamily.org">mailto:wokka@justfamily.org</a>]<span class="apple-converted-space"> </span><br>
<b>Sent:</b><span class="apple-converted-space"> </span>Tuesday, November 14, 2017 10:48 AM<br>
<b>To:</b><span class="apple-converted-space"> </span>Lelio Fulgenzi <<a href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>><br>
<b>Cc:</b><span class="apple-converted-space"> </span>Ryan Huff <<a href="mailto:ryanhuff@outlook.com">ryanhuff@outlook.com</a>>;
<a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [cisco-voip] UCS C210 Replace 146 GB Disk in RAID5 with 300 GB Disk<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">Lelio, if you are using those be7k's for UC apps, your limiting factor is always the CPU cores, you won't run out of drive space. Also, the be7K-h is a workhorse of a server, fastest one I've ever built a cluster on. 4 independent arrays
means you can easily do maintenance on one app without affecting the performance of another, assuming you separate your apps between arrays and stagger them out. I did 4 simultaneous installs on one, each app on it's own partition and they were all done in
under 2 hours.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Sadly, the pricepoint on the H isn't there for most customers. the M is nice, but only has 2 of the arrays, but I'll take an H for an install any day!<o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">On Tue, Nov 14, 2017 at 9:34 AM, Lelio Fulgenzi <<a href="mailto:lelio@uoguelph.ca" target="_blank"><span style="color:purple">lelio@uoguelph.ca</span></a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">The idea of RAID drives and managing the different volumes always had me on the fence on how to do things. In a perfect world, I’d stick with one big RAID 6 array with a spare on the shelf.<span class="apple-converted-space"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">The BE7K servers I ordered were delivered with 4 RAID 5 arrays. Personally, while I can appreciate separating the arrays, I don’t like losing that extra space and managing which volume to put images on is a pain.<span class="apple-converted-space"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I’ll admit, I looked at RAID 10 (when I was first reading the TRC specs) and was confused to heck. I did finally understand things after referring to a colleague, but it was a lot of drawing out.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I will say this, RAID isn’t gonna protect you if you don’t have platform monitoring on. You need to know the second a drive fails so you can proceed accordingly.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Also, if the ever do construction in your computer room, do yourself a favour, go to the hardware store, buy a 9.99 loose fibre furnace filter and stick it in front of your air intakes.<span class="apple-converted-space"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>From:</b><span class="apple-converted-space"> </span>cisco-voip [mailto:<a href="mailto:cisco-voip-bounces@puck.nether.net" target="_blank"><span style="color:purple">cisco-voip-bounces@puck.nether.net</span></a>]<span class="apple-converted-space"> </span><b>On
Behalf Of<span class="apple-converted-space"> </span></b>Charles Goldsmith<br>
<b>Sent:</b><span class="apple-converted-space"> </span>Tuesday, November 14, 2017 9:48 AM<br>
<b>To:</b><span class="apple-converted-space"> </span>Ryan Huff <<a href="mailto:ryanhuff@outlook.com" target="_blank"><span style="color:purple">ryanhuff@outlook.com</span></a>><br>
<b>Cc:</b><span class="apple-converted-space"> </span><a href="mailto:cisco-voip@puck.nether.net" target="_blank"><span style="color:purple">cisco-voip@puck.nether.net</span></a><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [cisco-voip] UCS C210 Replace 146 GB Disk in RAID5 with 300 GB Disk<o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">I've seen one URE fail in a raid 5 resilvering process, years ago on a DG system. Had to rebuild and restore from backup, fun times.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">I agree Ryan, on a TRC system and RMA a drive, you stick with it. <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">From my reading on TRC, you can rebuild as a RAID 10 and get faster speeds, but you lose some space in the process.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">On my personal systems, I'm using RAID 10 everywhere.<o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">On Tue, Nov 14, 2017 at 8:17 AM, Ryan Huff <<a href="mailto:ryanhuff@outlook.com" target="_blank"><span style="color:purple">ryanhuff@outlook.com</span></a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal">As I’ve read and understood; it isn’t due to actual functionality though. It is as you say, due mostly to longer rebuild times (indexing a physically larger geometry than the rest of the array members, for a smaller logical geometry) and
the risk (rare IMO) to the rest of the array (as a rebuild will stress the array and could cause other, near-death disks to fail thereby causing the array to fail). It also wastes the extra horsepower of the disk since the existing RAID can’t capitalize on
the resources of the larger disk.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">So in a case of, would you go out and buy a new disk that way .... I’d say no; but if that is the result of a covered RMA, I’d say go for it.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I’m no diskologist though ... just based on my own experiences of what has worked for me for the last couple of decades ... and I’ve never lost a server ... outside of that one time when my pants pocket snagged
the release on the 2nd disk in a R5 on my way out the door ... bad memories.<o:p></o:p></p>
<div id="m_3193799730819117075m_3660877515088355866AppleMailSignature">
<div>
<p class="MsoNormal"><span style="color:#888888">-Ryan</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
On Nov 14, 2017, at 9:03 AM, Charles Goldsmith <<a href="mailto:wokka@justfamily.org" target="_blank"><span style="color:purple">wokka@justfamily.org</span></a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal">Keep in mind, RAID 5 is ok for smaller disks, but larger disks it's no longer recommended, but sadly, the best article about it is from Dell: <a href="http://en.community.dell.com/techcenter/b/techcenter/archive/2012/08/14/new-equallogic-raid-tech-report-considerations-and-best-practices-released" target="_blank"><span style="color:purple">http://en.community.dell.com/techcenter/b/techcenter/archive/2012/08/14/new-equallogic-raid-tech-report-considerations-and-best-practices-released</span></a><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">With bigger disks, it's even said that RAID 6 is no longer good enough, due to large rebuild times in case of a failure. <a href="http://www.zdnet.com/blog/storage/why-raid-6-stops-working-in-2019/805" target="_blank"><span style="color:purple">http://www.zdnet.com/blog/storage/why-raid-6-stops-working-in-2019/805</span></a> <o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">On Tue, Nov 14, 2017 at 7:41 AM, Ryan Huff <<a href="mailto:ryanhuff@outlook.com" target="_blank"><span style="color:purple">ryanhuff@outlook.com</span></a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Reto,<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Seek/rpm speeds and media type (flash, sata ... etc) are usually what matter the most for RAID disks. If your only difference is total storage capacity, the bigger disk will usually work just fine, your just gonna waste the additional 154GB
of space (because the RAID will only provision 146GB of that 300GB disk).<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Just remember on a RAID 5, don’t pull/lose more that 1 disk at a time .... painful lesson long ago I share over beer every now and then.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">-Ryan<o:p></o:p></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
On Nov 14, 2017, at 8:23 AM, Reto Gassmann <<a href="mailto:voip@mrga.ch" target="_blank"><span style="color:purple">voip@mrga.ch</span></a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal">Hallo <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">We have a UCS C210 Server with 10x146 GB Disks. One of the Disks failed and I got a 300 GB replacement Disk from Cisco.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Is that a problem if I replace the defect 146 Disk in the RAID 5 with a 300 GB Disk?<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Thanks for help<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Regards Reto<o:p></o:p></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank"><span style="color:purple">cisco-voip@puck.nether.net</span></a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank"><span style="color:purple">https://puck.nether.net/mailman/listinfo/cisco-voip</span></a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank"><span style="color:purple">cisco-voip@puck.nether.net</span></a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank"><span style="color:purple">https://puck.nether.net/mailman/listinfo/cisco-voip</span></a><o:p></o:p></p>
</blockquote>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"LucidaGrande",serif">_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a></span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>