<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>I had a CPU pegging issue about 4.5 months ago on ESXi 5.0. I turned LRO off (only change I made), and I haven't had an issue with CPU pegging since. <br><br>My issue was due to the TCP throughput being irregular on VMXNET2 and VMXNET3 and it was causing HELLO/ACK issues with the database replication (it would get into a setup loop and never stop). Guest reboots didn't fix it, if a rebooted the UCS box it worked for a little bit and then went right back to the issue<br><br>VMware states that the issue is known in Linux kernel 2.6.24 and later with VMXNET3 (http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1027511)<br><br>There are plenty of reports on the Internet were the LRO/CUC issue has been found beyond esxi 4.1 and cucm 8.6.<br><br>RHEL probably isn't going to get any performance gains from LRO anyhow so if it were me, I'd turn it off. It's broke now, right? Generally, you can't break broke so I would try it, if for no other reason than to say that isn't it.<br><br>Again, I am not saying this IS your issue, just that it COULD BE a contributing factor, it would be worth a shot in my book if you haven't found the issue yet.<br><br><br><div><hr id="stopSpelling">From: wokka@justfamily.org<br>Date: Mon, 17 Nov 2014 23:50:52 -0700<br>Subject: Re: [cisco-voip] VMware 5.5<br>To: ryanhuff@outlook.com<br>CC: ms@bilobit.com; james.buchanan2@gmail.com; cisco-voip@puck.nether.net<br><br><div dir="ltr">This discussion comes up about every 6 months on this list, LRO is no longer affected and was only a 4.1 issue on esxi.<div><br></div><div><a href="http://puck.nether.net/pipermail/cisco-voip/2012-October/029907.html" target="_blank">http://puck.nether.net/pipermail/cisco-voip/2012-October/029907.html</a> <br></div><div><a href="http://docwiki.cisco.com/wiki/Unified_Communications_VMware_Requirements#Supported_Versions.2C_Patches_and_Updates_of_VMware_vSphere_ESXi" target="_blank">http://docwiki.cisco.com/wiki/Unified_Communications_VMware_Requirements#Supported_Versions.2C_Patches_and_Updates_of_VMware_vSphere_ESXi</a> <br></div><div><br></div><div>The latter being definitive for me, they keep that doc updated pretty well and note, it states 4.1, not any other version of esxi.</div><div><br></div><div>Martin has another issue. :)</div><div class="ecxgmail_extra"><br><div class="ecxgmail_quote">On Mon, Nov 17, 2014 at 4:46 PM, Ryan Huff <span dir="ltr"><<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br><blockquote class="ecxgmail_quote" style="border-left:1px #ccc solid;padding-left:1ex;">
<div><div dir="ltr">While that particular DocWiki does suggest that it is no longer needed to disable Large Receive Offset on ESXi 4.1 with CUCUM 8.6 and above; you should also note that one of the specific issues having LRO on can cause is consistent CPU pegging for the UCOS guests (wouldn't be the first time something didn't work the way Cisco's docs say it should).<br><br>Please also review: <a href="https://supportforums.cisco.com/document/95886/disable-lro-ucs-uc-application-deployments" target="_blank">https://supportforums.cisco.com/document/95886/disable-lro-ucs-uc-application-deployments</a> Again, I can't say beyond a shadow of doubt that this is the issue anymore than anyone can say that it isn't.<br><br>I would also look into the RAID drivers as well as all the physical connections on the UCS boxes.<br><br>Thanks,<br><br>rh<br><div><hr>From: <a href="mailto:wokka@justfamily.org" target="_blank">wokka@justfamily.org</a><br>Date: Mon, 17 Nov 2014 14:30:21 -0700<span><br>Subject: Re: [cisco-voip] VMware 5.5<br></span>To: <a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a><br>CC: <a href="mailto:ms@bilobit.com" target="_blank">ms@bilobit.com</a>; <a href="mailto:james.buchanan2@gmail.com" target="_blank">james.buchanan2@gmail.com</a>; <a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br><br><div dir="ltr">That page specifically says you don't have to disable LRO if you are above 4.1 esxi with8.6 CUCM.<div><div><div><br></div><div>Martin, which version of 5.5 are you on? GA, update 1 or 2? I recently ran into an issue with a customer on 5.5 u1 and too new of raid drivers on the card and had to downgrade the drivers. Wasn't causing 100% cpu, but very slow drive access times.</div><div><br></div><div>So checked your vmware version and compatibility on the hardware you are running.</div></div></div></div><div><div><div><br><div>On Mon, Nov 17, 2014 at 11:59 AM, Ryan Huff <span dir="ltr"><<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br><blockquote style="border-left:1px #ccc solid;padding-left:1ex;">
<div><div dir="ltr"><font style="font-size:12pt;" size="3" face="Calibri"><span style="font-size:12pt;"><span dir="ltr">Martin,<br>
<br>
Have you disabled Large Receive Offset (LRO) on all the Elastic Sky hosts? <a href="http://docwiki.cisco.com/wiki/Disable_LRO" target="_blank">http://docwiki.cisco.com/wiki/Disable_LRO</a><span><br>
<br>
Thanks,<br>
<br>
Ryan Huff<br>
CCIE Collaboration (Written), CCNP Voice, CCNA Voice,<br>
CCNA Route & Switch, CCNA Wireless<br>
UCCX Specialist</span></span></span></font><br><br><div><hr>From: <a href="mailto:ms@bilobit.com" target="_blank">ms@bilobit.com</a><br>To: <a href="mailto:james.buchanan2@gmail.com" target="_blank">james.buchanan2@gmail.com</a><br>Date: Mon, 17 Nov 2014 18:06:51 +0000<br>CC: <a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><div><div><br>Subject: Re: [cisco-voip] VMware 5.5<br><br>
<div>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US">So 5.5 is supported with CUCM 9.1.x
</span><br>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US"> </span><br>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US">So the question is: Why do I have CUCM at 100% CPU? Only hard reset helps at this point.</span><br>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US"> </span><br>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US">Thanks, Martin</span><br>
<span style="font-size:11.0pt;font-family:"Calibri","sans-serif";" lang="EN-US"> </span><br>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt;">
<div>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;">
<b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> James Buchanan [mailto:<a href="mailto:james.buchanan2@gmail.com" target="_blank">james.buchanan2@gmail.com</a>]
<br>
<b>Sent:</b> Monday, November 17, 2014 1:10 PM<br>
<b>To:</b> Martin Schmuker<br>
<b>Cc:</b> Cisco VoIP Mailing List<br>
<b>Subject:</b> Re: [cisco-voip] VMware 5.5</span><br>
</div>
</div>
<br>
<div>
Hello,<br>
<br>
Whenever you are looking for answers on UC virtualization, look here: <a href="http://docwiki.cisco.com/wiki/Virtualization_for_Cisco_Unified_Communications_Manager_%28CUCM%29" target="_blank">
http://docwiki.cisco.com/wiki/Virtualization_for_Cisco_Unified_Communications_Manager_%28CUCM%29</a><br>
<br>
Thanks,<br>
James<br>
</div>
<div>
<br>
<div>
On Mon, Nov 17, 2014 at 5:36 AM, Martin Schmuker <<a href="mailto:ms@bilobit.com" target="_blank">ms@bilobit.com</a>> wrote:<br>
<div>
<div>
Guys,<br>
<br>
<span lang="EN-US">since 3 weeks we are running our UC Environment (CUCM, Unity Cxn, IM&P) on ESXi 5.5. At Friday we setup new vCenter 5.5 and added the esx hosts.</span><br>
<span lang="EN-US"> </span><br>
<span lang="EN-US">Since saturday, all machines are stuck in 100% CPU after a few hours. Sometimes all machines at the *<b>same</b>* time! They don’t reply Ping (ICMP Echo), and
CPU is at 100%.</span><br>
<span lang="EN-US"> </span><br>
<span lang="EN-US">CUCM and Cxn are on 9.1(2)SU2a (9.1.2.12901-3).</span><br>
<span lang="EN-US"> </span><br>
<span lang="EN-US">Someone has any idea? Is 9.1.x not supported on vSphere 5.5?</span><br>
<span lang="EN-US"> </span><br>
<span lang="EN-US">Thanks, Martin</span><br>
</div>
</div>
<br>
_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
</div>
<br>
</div>
</div>
</div>
<br>_______________________________________________
cisco-voip mailing list
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a></div></div></div> </div></div>
<br>_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
<br></blockquote></div><br></div></div></div></div> </div></div>
</blockquote></div><br></div></div></div> </div></body>
</html>