<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Just as a note of practice; I wouldn't do anything to a running CCM at the OS level during production, at least not without proper maintenance declaration to the business unit
<img class="EmojiInsert" style="vertical-align: bottom;" alt="😊" src="cid:da6676ae-e9d0-47e5-bb3f-6f30cef2b2ef">. "<em>A maintenance window a day, keeps the resumes away</em>" .... lol.</p>
<p><br>
</p>
<p>If you've got RAID issues; I would get that solved before doing anything else. If DRF services are still working (50/50 chance) I would get a good DRS on that cluster
<u>ASAP</u>. If DRS doesn't work, hopefully BAT still does, I would do a BAT export on everything ASAP.</p>
<p><br>
</p>
<p>An upgrade would be the least of my worries at this point. He is a reference to the particular error message you show in the image.(<a title="http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/upgrade/9_1_1/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91_chapter_0110.html#CUP0_RF_WD01249D_00
Ctrl+Click or tap to follow the link" id="LPlnk612336" href="http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/upgrade/9_1_1/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91_chapter_0110.html#CUP0_RF_WD01249D_00">http://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/upgrade/9_1_1/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91/CUCM_BK_UAEC4331_00_upgrade-guide-cucm-91_chapter_0110.html#CUP0_RF_WD01249D_00</a>).</p>
<p><br>
</p>
<p>-Ryan<br>
<br>
</p>
<div style="color: rgb(0, 0, 0);">
<hr tabindex="-1" style="width: 98%; display: inline-block;">
<div id="divRplyFwdMsg" dir="ltr"><font color="#000000" face="Calibri, sans-serif" style="font-size: 11pt;"><b>From:</b> Jonathan Charles <jonvoip@gmail.com><br>
<b>Sent:</b> Tuesday, November 17, 2015 12:45 PM<br>
<b>To:</b> Dave Goodwin<br>
<b>Cc:</b> Ryan Huff; cisco-voip@puck.nether.net<br>
<b>Subject:</b> Re: [cisco-voip] CUCM Upgrade failure...</font>
<div> </div>
</div>
<div>
<div dir="ltr">I did notice this on the Publisher OS Admin - Install/Upgrade page:
<div><br>
</div>
<div><img width="563" height="54" tabindex="0" alt="Inline image 1" unselectable="on" src="cid:ii_151168cbd36f4b39"><br>
</div>
<div><br>
</div>
<div>I wonder if that's causing it...</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Nov 17, 2015 at 11:40 AM, Jonathan Charles <span dir="ltr">
<<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">Yep, didn't work... same error. Let me check the other nodes...</div>
<div class="HOEnZb">
<div class="h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Nov 17, 2015 at 11:34 AM, Jonathan Charles <span dir="ltr">
<<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">Logged into OS Admin on the pub, and it didn't give me the option to assume control... can I run discovery/migration during production? Just want to make sure I don't pop anything....<span><font color="#888888">
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</font></span></div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Nov 17, 2015 at 11:30 AM, Dave Goodwin <span dir="ltr">
<<a href="mailto:dave.goodwin@december.net" target="_blank">dave.goodwin@december.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">
<div class="gmail_default" style="font-family: tahoma,sans-serif;">I had a similar symptom a couple months ago - discovery timed out on one or more nodes. I found a supportforum post from another individual having that issue, and it appeared that PCD got "stuck"
installing the ciscocm.ucmap_platformconfig.cop file in the middle. The way to work around it was to log into the Software Install/Upgrade page on the affected node(s) and you can see you'll have the option to Assume Control of a currently running install.
Do that, and click through to complete the install. Then try to do the discovery again. Unknown if there was an existing bug causing this problem, but the above workaround steps solved my problem.</div>
</div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Nov 17, 2015 at 12:25 PM, Jonathan Charles <span dir="ltr">
<<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">I just posted the log... I am not sure from reading it...
<div><br>
</div>
<div>discovery node 1617 failed with errorcode 1-3</div>
<span><font color="#888888">
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</font></span></div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Nov 17, 2015 at 11:23 AM, Ryan Huff <span dir="ltr">
<<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div><span>
<div>Jonathan,</div>
<div><br>
</div>
<div>What timesout on the publisher? Are you referencing when PCD tries to do the cluster discovery on the existing cluster?</div>
<div><br>
</div>
<div>-Ryan</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div style="color: rgb(87, 87, 87); font-size: 9px;">Sent from my T-Mobile 4G LTE Device</div>
</div>
<br>
<br>
-------- Original message --------<br>
From: Jonathan Charles <u></u><br>
Date:11/17/2015 12:06 PM (GMT-05:00) <br>
To: Anthony Holloway <u></u><br>
Cc: <a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a>
<br>
Subject: Re: [cisco-voip] CUCM Upgrade failure... <br>
<br>
</span>
<div>
<div>
<div dir="ltr">Nope, not all good... new error... the upgrade failed so I deleted the cluster and re-added... it finds all of the subscribers, but it times out on the publisher....
<div><br>
</div>
<div>I have verified all services are running on the Pub and it looks clean...</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Nov 16, 2015 at 10:20 AM, Anthony Holloway <span dir="ltr">
<<a href="mailto:avholloway+cisco-voip@gmail.com" target="_blank">avholloway+cisco-voip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">Looks like you're all good now, but as a heads up to everyone else, don't stop at checking NTP with "utils ntp status". You will fail to upgrade if your NTP configuration has an FQHN for the NTP server which begins with a digit.
<div><br>
</div>
<div>E.g., <a href="http://0.pool.ntp.org" target="_blank">0.pool.ntp.org</a></div>
<div><br>
</div>
<div>You will not see the hostname in the output of "utils ntp status", as it will only show you the resolved IP address. So, you will also need to issue a "utils ntp config" to see what value was entered by the administrator.</div>
<div><br>
</div>
<div>This is the only defect reference I found, though my upgrade I hit it on was an 8.6 to 10.5 Refresh Upgrade (RU) (Not PCD).</div>
<div><br>
</div>
<div><a href="https://tools.cisco.com/bugsearch/bug/CSCtj07817" target="_blank">https://tools.cisco.com/bugsearch/bug/CSCtj07817</a><br>
</div>
</div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 15, 2015 at 10:43 PM, Jonathan Charles <span dir="ltr">
<<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">OK, a reboot of CPCD got it passed that error...<span><font color="#888888">
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</font></span></div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 15, 2015 at 9:40 PM, Jonathan Charles <span dir="ltr">
<<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="ltr">Yeah, the error I am getting is:
<div><br>
</div>
<div>1 nodes(s) in Export task action ID #1127... on the Publisher...<br>
</div>
<div><br>
</div>
<div>I will try rebooting everything...</div>
<span><font color="#888888">
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Jonathan</div>
</font></span></div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 15, 2015 at 9:35 PM, Ryan Huff <span dir="ltr">
<<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="auto">
<div>Looks healthy ...</div>
<div><br>
</div>
<div>I recall trying PCD once and I hit really strange issues too. For that upgrade, I ultimately abandoned PCD and built new VMs with the Answer File Generator then a DRS backup/restore. </div>
<div><br>
</div>
<div>Not sure where you are in your timeline or if it is that important but it is definitely something I would consider. Sometimes you can spend more time trying to get the silly tools to work, than to just do the work yourself. </div>
<div><br>
</div>
<div>Google is littered with PCD weirdness; great idea of an application, just not there yet IMO.<br>
<br>
-Ryan</div>
<div><br>
<div><br>
<br>
Sent from my iPad</div>
<div>
<div>On Nov 15, 2015, at 10:19 PM, Jonathan Charles <<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>> wrote:<br>
<br>
</div>
</div>
</div>
<div>
<div>
<blockquote type="cite">
<div>
<div dir="ltr">
<div>Everything looks good....</div>
<div><br>
</div>
<div><br>
</div>
<div>admin:utils ntp status</div>
<div>ntpd (pid 19674) is running...</div>
<div><br>
</div>
<div> remote refid st t when poll reach delay offset jitter</div>
<div>==============================================================================</div>
<div> 127.127.1.0 .LOCL. 10 l 21 64 377 0.000 0.000 0.001</div>
<div> 10.0.31.2 10.0.31.3 3 u 175 1024 377 0.635 -5.771 2.042</div>
<div>*10.0.31.3 129.6.15.29 2 u 970 1024 377 0.510 -11.340 0.449</div>
<div> 10.1.31.2 10.0.31.3 3 u 490 1024 377 0.850 -9.114 4.881</div>
<div>+10.1.31.3 129.6.15.29 2 u 184 1024 377 0.817 -4.085 5.355</div>
<div><br>
</div>
<div><br>
</div>
<div>synchronised to NTP server (10.0.31.3) at stratum 3 </div>
<div> time correct to within 68 ms</div>
<div> polling server every 1024 s</div>
<div><br>
</div>
<div>Current time in UTC is : Mon Nov 16 03:16:14 UTC 2015</div>
<div>Current time in America/Chicago is : Sun Nov 15 21:16:14 CST 2015</div>
<div>admin:</div>
<div><br>
</div>
<div>admin:utils diagnose module validate_network</div>
<div><br>
</div>
<div>Log file: platform/log/diag1.log</div>
<div><br>
</div>
<div>Starting diagnostic test(s)</div>
<div>===========================</div>
<div>test - validate_network : Passed </div>
<div><br>
</div>
<div>Diagnostics Completed</div>
<div><br>
</div>
<div>admin:#</div>
<div><br>
</div>
<div>
<div>admin:utils dbreplication runtimestate </div>
<div><br>
</div>
<div>DB and Replication Services: ALL RUNNING</div>
<div><br>
</div>
<div>Cluster Replication State: Replication repair command started at: 2014-06-20-23-22</div>
<div> Replication repair command COMPLETED 541 tables processed out of 541</div>
<div> Errors or Mismatches Were Found: </div>
<div><br>
</div>
<div> Use 'file view activelog cm/trace/dbl/sdi/ReplicationRepair.2014_06_20_23_22_51.out' to see the details</div>
<div><br>
</div>
<div>DB Version: ccm8_6_2_20000_2</div>
<div>Number of replicated tables: 541</div>
<div><br>
</div>
<div>Cluster Detailed View from PUB (5 Servers):</div>
<div><br>
</div>
<div> PING REPLICATION REPL. DBver& REPL. REPLICATION SETUP</div>
<div>SERVER-NAME IP ADDRESS (msec) RPC? STATUS QUEUE TABLES LOOP? (RTMT) & details </div>
<div>----------- ------------ ------ ---- ----------- ----- ------- ----- -----------------</div>
<div>IPTCMS02 10.0.126.12 0.196 Yes Connected 0 match Yes (2) Setup Completed</div>
<div>IPTCMS01 10.0.126.11 0.151 Yes Connected 0 match Yes (2) Setup Completed</div>
<div>IPTCMP 10.0.126.10 0.065 Yes Connected 0 match Yes (2) PUB Setup Completed</div>
<div>IPTCMS03 10.1.126.13 0.545 Yes Connected 0 match Yes (2) Setup Completed</div>
<div>IPTCMS04 10.1.126.14 0.527 Yes Connected 0 match Yes (2) Setup Completed</div>
<div> </div>
<div>admin:</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 15, 2015 at 9:14 PM, Ryan Huff <span dir="ltr">
<<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
<div dir="auto">
<div>Also worth noting that if CCM NTP is synchronized to a Windows server (even if it shows Stratum 3 or better); that is a problem you'll need to correct as SNTP can play hell with UCOS and do some pretty weird stuff.</div>
<div><br>
Thanks,</div>
<div><br>
</div>
<div>Ryan</div>
<div>
<div>
<div><br>
On Nov 15, 2015, at 10:06 PM, Ryan Huff <<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<div>If the FROM CCM version was unrestricted, it would say "<i>Unrestricted</i>" after the version number on the "<i>Active Master Version"</i> line. If it does not say "<i>Unrestricted</i>", then it is the more common restricted version.</div>
<div><br>
</div>
<div>As to your original issue, I would start with all the usual suspects. Is the FROM CCM cluster healthy to start with; dns, ntp, replication ... etc?</div>
<div><br>
</div>
<div>From CCM:</div>
<div><br>
</div>
<div>1.) #utils diagnose module validate_network</div>
<div> (Should see <i>Passed</i>)</div>
<div><br>
</div>
<div>2.) #utils ntp status</div>
<div> (Pub should be synchronized and Strata 3 or better)</div>
<div><br>
</div>
<div>3.) #utils dbreplication runtimestate<br>
(Should see <i>2 - Setup Completed</i> for all nodes)</div>
<div><br>
</div>
<div>If PCD is moving the apps to a new platform/chassis, make sure the <i>target</i> environment can reach all the same network assets as the
<i>from</i> environment.<br>
<br>
</div>
<div>Thanks,</div>
<div><br>
</div>
<div>Ryan</div>
<div><br>
On Nov 15, 2015, at 9:34 PM, Jonathan Charles <<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<div dir="ltr">It just says the version number...
<div><br>
</div>
<div>
<div>admin:show version active</div>
<div>Active Master Version: 8.6.2.20000-2</div>
<div>Active Version Installed Software Options: </div>
<div>cmterm-7942_7962-sccp.9-3-1ES27-rel.cop</div>
<div>cmterm-devicepack8.6.2.24118-1.cop</div>
<div>ciscocm.refresh_upgrade_v1.1.cop</div>
<div>ciscocm.ucmap_platformconfig.cop</div>
<div>ciscocm.migrate-export-v1.12.cop</div>
<div>admin:</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Jonahan</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 15, 2015 at 7:26 PM, Ryan Huff <span dir="ltr">
<<a href="mailto:ryanhuff@outlook.com" target="_blank">ryanhuff@outlook.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;">
Did you actually dump the logs to a serial interface (curious what it shows)?<br>
<br>
On the FROM CCM, goto the CLI of pub (or sub) and do a "show version active"; it will tell you if you have the UNREST.<br>
<br>
Thanks,<br>
<br>
Ryan<br>
<span><br>
> On Nov 15, 2015, at 7:55 PM, Jonathan Charles <<a href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>> wrote:<br>
><br>
> Using PCD on CUCM 10.5.2.11901 got the following error:<br>
><br>
</span>> <image.png><br>
<span>><br>
> It seems to imply I am not matching restricted vs. unrestricted...<br>
><br>
> Any easy way to find out?<br>
><br>
><br>
><br>
> Jonathan<br>
</span>> _______________________________________________<br>
> cisco-voip mailing list<br>
> <a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank" rel="noreferrer">
https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>cisco-voip mailing list</span><br>
<span><a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a></span><br>
<span><a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a></span><br>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank" rel="noreferrer">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>