<p>Bill, compare CallManager.pem under OS admin cert mgmt on the physical servers to the virtual servers.</p>
<p>Also compare TVS.pem on both servers.</p>
<p>If both CallManager.pem and TVS.pem are different between the clusters then I'm afraid there isn't much you can do here besides delete the ITL on the phone.</p>
<p>The intention is that these certs remain the same after backup and restore. We've had cases before about backup and restore failing due to mismatch case, but we've fixed those bugs as they've popped up.</p>
<p>Id recommend opening a TAC case so we can<br>
1. See about fixing this up in the short term.<br>
2. File a bug to prevent someone else from getting into the same jam.</p>
<div class="gmail_quote">On Aug 18, 2011 10:15 AM, "Carter, Bill" <<a href="mailto:bcarter@sentinel.com">bcarter@sentinel.com</a>> wrote:<br type="attribution">> We are having a big problem with this. <br>
> <br>> We have a 2 node cluster. Upgraded servers from 7.1(3) to 8.0 then DRS backup. Installed 8.0 on two virtual servers then DRS restore. Then upgraded cluster to 8.5. <br>> <br>> It looks like the physical server hostnames were in all caps and the VM servers are lower case. <br>
> <br>> Phones won't download ring tones all can't view any of the directories. The phones UCM server shows either a single UCM or the same UCM as #1 and #2.<br>> <br>> Is there anything we can do besides deleting each phones ITL file?<br>
> <br>> -Bill Carter<br>> <br>> <br>> On Aug 13, 2011, at 7:11 AM, "Jason Burns" <<a href="mailto:burns.jason@gmail.com">burns.jason@gmail.com</a>> wrote:<br>> <br>>> I wanted to follow up on this thread. The "show itl" command was a key piece of the troubleshooting process that let us track this down. After this incident though I wanted to take some time to explain how ITL and Security By Default worked, and also document the common troubleshooting steps I used.<br>
>> <br>>> Hopefully this document will help you out in the future!<br>>> <br>>> <a href="https://supportforums.cisco.com/docs/DOC-17679">https://supportforums.cisco.com/docs/DOC-17679</a><br>>> <br>
>> Support Forums mangles pictures in the thumbnail view, but you should be able to click on each diagram to full size it and get a better understanding of what goes on in the background.<br>>> <br>>> -Jason Burns<br>
>> <br>>> On Thu, Jun 30, 2011 at 5:31 PM, Wes Sisk <<a href="mailto:wsisk@cisco.com">wsisk@cisco.com</a>> wrote:<br>>> Summary for the innocent bystanders:<br>>> <br>>> * Phone previously registered to 7.1.5 cluster with no CTL. Phone got ITL file from new cluster successfully.<br>
>> * Phone console logs show:<br>>> 2155: ERR 12:08:23.841097 SECD: EROR:verifyFile: sgn verify file failed</usr/ram/SEP00260BD749E9.cnf.xml>, errclass 8, errcode 19 (signer not in CTL)<br>>> 2156: ERR 12:08:23.841825 SECD: EROR:verifyFile: verify FAILED,</usr/ram/SEP00260BD749E9.cnf.xml><br>
>> 2157: NOT 12:08:23.844821 SECD: sendRespToClient: Sent the response to the TVS client, len : 2056<br>>> 2158: NOT 12:08:23.860569 tftpClient: authorize file = 13, isEncr = 0<br>>> <br>>> * phones show ITL downloading successfully. suspect problem with ITL file. Get TVS logs.<br>
>> <br>>> * This is where things got sketchy. CLI command 'show ITL' shows the TFTP entry for the publisher with a serial number. We checked all certificates in ccmadmin under system->security->certificates. No serial numbers match the current ITL file. We tried regenerating CallManager.pem as that should be the cert TFTP uses. After regenerating, restarting TVS, and restarting TFTP the cli command 'show itl' still shows incorrect serial number for TFTP certificate. This means ITL file is not being updated properly.<br>
>> <br>>> * Checked TVS logs. Many red herrings there but one substantial error:<br>>> 11:45:18.827 | debug ERROR:writeFile () - Unable to open file /usr/local/cm/tftp/ITLFile.tlv for writing (errno - 13)<br>
>> 11:45:18.827 | debug In function : tvsGetPublicKeyFromX509<br>>> 11:45:19.100 |ITLFileRegenerated - New ITL File has been generated. <br>>> <br>>> TVS could not write new ITL file.<br>>> <br>
>> Checked filesystem permissions on Matthew's box:<br>>> [root@server ~]# ls -la /usr/local/cm/tftp/ITLFile.tlv<br>>> -rw-r--r-- 1 ctftp ccmbase 3664 May 25 13:18 /usr/local/cm/tftp/ITLFile.tlv<br>
>> <br>>> On lab box:<br>>> [root@CUCM85Pub sdi]# ls -la /usr/local/cm/tftp/ITLFile.tlv<br>>> -rw-r--r-- 1 certbase ccmbase 4930 Jun 30 15:38 /usr/local/cm/tftp/ITLFile.tlv<br>>> <br>>> Permissions issue. On Matthew's box:<br>
>> [root@server ~]# ps -eaf | grep -iE "TFTP|TVS"<br>>> certbase 31007 17132 0 15:35 ? 00:00:00 /usr/local/cm/bin/tvs<br>>> ctftp 31574 17132 0 15:36 ? 00:00:02 /usr/local/cm/bin/ctftp<br>
>> <br>>> Looks like ctftp service most likely wrote or created ITL file on May 25. The owner of ITLFile.tlv should be certbase not ctftp. We did:<br>>> 1. chown certbase ITLFile.tlv - this set the correct owner<br>
>> 2. restarted TVS service - TVS regenerated ITL file and successfully wrote it to the file system<br>>> 3. restart TFTP service so it could pickup the new ITL file from the file system.<br>>> <br>>> After this phones successfully registered. So far there is at least one new bug out of this:<br>
>> CSCtr27100 TVS inaccurately reports New ITL File has been generated<br>>> <br>>> In CUCM 8.6 ctftp does indeed generate the ITL file. In 8.5.1.11900-21 (aka 8.5.1su1) that Matthew is running ITL file should be generated by TVS.<br>
>> <br>>> Regards,<br>>> Wes<br>>> <br>>> <br>>> On 6/30/2011 4:17 PM, Matthew Loraditch wrote:<br>>>> <br>>>> Well I just finished what amounted to 5 hours on the phone and 6 hours for Cisco. Most of that with Wes and apparently Ryan Ratliff and Jason Burns stopped by for a while as well!<br>
>>> <br>>>> Anyway we got it fixed. Wes said he is going to do a write up but the gist was the ITL cert was written by the wrong service and thus not matching up and they had to go in with root and do something so that right service could properly create it.<br>
>>> <br>>>> <br>>>> <br>>>> Major Kudos to Wes and if we are ever within 50 miles or less of each other drinks are in order!<br>>>> <br>>>> <br>>>> <br>>>> <br>
>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>>>> 1965 Greenspring Drive<br>>>> <br>>>> Timonium, MD 21093 <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>
>>> (p) (410) 252-8830<br>>>> (F) (443) 541-1593<br>>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a> for fast assistance!<br>
>>> <br>>>> <br>>>> <br>>>> From: <a href="mailto:cisco-voip-bounces@puck.nether.net">cisco-voip-bounces@puck.nether.net</a> [mailto:<a href="mailto:cisco-voip-bounces@puck.nether.net">cisco-voip-bounces@puck.nether.net</a>] On Behalf Of Matthew Loraditch<br>
>>> Sent: Thursday, June 30, 2011 11:24 AM<br>>>> To: Lelio Fulgenzi<br>>>> Cc: <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>
>>> <br>>>> <br>>>> <br>>>> Wes is helping out and watching my case so far we have just verified normal settings, regenerated the tomcat certs to no avail and then totally factory defaulted the phone (the 123456789*0#) and now the phone comes up unprovisioned and won’t connect at all!<br>
>>> <br>>>> Engineers seem pretty stumped<br>>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>>>> 1965 Greenspring Drive<br>
>>> <br>>>> Timonium, MD 21093 <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> (p) (410) 252-8830<br>>>> (F) (443) 541-1593<br>
>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a> for fast assistance!<br>
>>> <br>>>> <br>>>> <br>>>> From: Lelio Fulgenzi [mailto:<a href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>] <br>>>> Sent: Thursday, June 30, 2011 11:21 AM<br>>>> To: Matthew Loraditch<br>
>>> Cc: Matthew Loraditch; <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>>>> <br>
>>> <br>>>> <br>>>> Let us know how that goes...<br>>>> <br>>>> Sent from my iPhone<br>>>> <br>>>> <br>>>> On Jun 30, 2011, at 9:09 AM, Matthew Loraditch <<a href="mailto:MLoraditch@heliontechnologies.com">MLoraditch@heliontechnologies.com</a>> wrote:<br>
>>> <br>>>> Well I have done what Lelio suggested, I have rebooted the cluster. I noticed from the phone logs and in security settings that the certs they are getting say the hostname so I changed the CCMs from IP back to hostname. Still no dice…<br>
>>> <br>>>> Time to open a TAC case!<br>>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>>>> 1965 Greenspring Drive<br>
>>> <br>>>> Timonium, MD 21093 <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> (p) (410) 252-8830<br>>>> (F) (443) 541-1593<br>
>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a> for fast assistance!<br>
>>> <br>>>> <br>>>> <br>>>> From: <a href="mailto:cisco-voip-bounces@puck.nether.net">cisco-voip-bounces@puck.nether.net</a> [mailto:<a href="mailto:cisco-voip-bounces@puck.nether.net">cisco-voip-bounces@puck.nether.net</a>] On Behalf Of Matthew Loraditch<br>
>>> Sent: Wednesday, June 29, 2011 9:57 PM<br>>>> To: Lelio Fulgenzi<br>>>> Cc: <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>
>>> <br>>>> <br>>>> <br>>>> Will give it a whirl in the am<br>>>> <br>>>> <br>>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>>>> 1965 Greenspring Drive<br>
>>> <br>>>> Timonium, MD 21093 <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> (p) (410) 252-8830<br>>>> (F) (443) 541-1593<br>
>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a> for fast assistance!<br>
>>> <br>>>> <br>>>> <br>>>> From: Lelio Fulgenzi [mailto:<a href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>] <br>>>> Sent: Wednesday, June 29, 2011 9:43 PM<br>>>> To: Matthew Loraditch<br>
>>> Cc: <a href="mailto:wsisk@cisco.com">wsisk@cisco.com</a>; <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>
>>> <br>>>> <br>>>> <br>>>> Try the service parameter I mentioned. <br>>>> <br>>>> <br>>>> <br>>>> If you do a search on the archives, Wes posted a link to the doc bug. <br>
>>> <br>>>> Sent from my iPhone<br>>>> <br>>>> <br>>>> On Jun 29, 2011, at 9:31 PM, Matthew Loraditch <<a href="mailto:MLoraditch@heliontechnologies.com">MLoraditch@heliontechnologies.com</a>> wrote:<br>
>>> <br>>>> 7942s and 7945s so far, in re someone else’s email have restarted tftp etc already.<br>>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>
>>> 1965 Greenspring Drive<br>>>> <br>>>> Timonium, MD 21093 <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> (p) (410) 252-8830<br>
>>> (F) (443) 541-1593<br>>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a> for fast assistance!<br>
>>> <br>>>> <br>>>> <br>>>> From: Lelio Fulgenzi [mailto:<a href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>] <br>>>> Sent: Wednesday, June 29, 2011 7:50 PM<br>>>> To: Matthew Loraditch<br>
>>> Cc: <a href="mailto:wsisk@cisco.com">wsisk@cisco.com</a>; <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>
>>> <br>>>> <br>>>> <br>>>> Are these 7941/61? I had a problem where I had to change the service provisioning service parameter to external to make this work. <br>>>> <br>>>> Sent from my iPhone<br>
>>> <br>>>> <br>>>> On Jun 29, 2011, at 6:23 PM, Matthew Loraditch <<a href="mailto:MLoraditch@heliontechnologies.com">MLoraditch@heliontechnologies.com</a>> wrote:<br>>>> <br>>>> Googled and found that and it’s not working….<br>
>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> Matthew Loraditch, CCVP, CCNA, CCDA<br>>>> 1965 Greenspring Drive<br>>>> <br>>>> Timonium, MD 21093<br>
>>> <br>>>> <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> (p) (410) 252-8830<br>>>> (F) (443) 541-1593<br>>>> <br>>>> Visit us at <a href="http://www.heliontechnologies.com">www.heliontechnologies.com</a><br>
>>> <br>>>> Support Issue? Email <a href="mailto:support@heliontechnologies.com">support@heliontechnologies.com</a><br>>>> for fast assistance!<br>>>> <br>>>> <br>>>> <br>
>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> From: Wes Sisk<br>>>> [mailto:<a href="mailto:wsisk@cisco.com">wsisk@cisco.com</a>] <br>>>> Sent: Wednesday, June 29, 2011 5:24 PM<br>
>>> To: Matthew Loraditch<br>>>> Cc: <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> Subject: Re: [cisco-voip] Phones Not Getting Auth, Idle, Services URLS, etc<br>
>>> <br>>>> <br>>>> <br>>>> <br>>>> <br>>>> These lines pretty much say it all. verification of the downloaded file failed. Delete the CTL/ITL from the phone and try again.<br>
>>> <a href="https://supportforums.cisco.com/docs/DOC-15799#Manual_ITL_Delete">https://supportforums.cisco.com/docs/DOC-15799#Manual_ITL_Delete</a><br>>>> <br>>>> Regards,<br>>>> Wes<br>
>>> <br>>>> On 6/29/2011 5:03 PM, Matthew Loraditch wrote: <br>>>> <br>>>> 1715: ERR 16:59:35.170584 SECD: EROR:verifyFile: sgn verify file failed </usr/ram/SEP00260BD749E9.cnf.xml>, errclass 8, errcode 19 (signer<br>
>>> not in CTL)<br>>>> <br>>>> 1716: ERR 16:59:35.171327 SECD: EROR:verifyFile: verify FAILED, </usr/ram/SEP00260BD749E9.cnf.xml><br>>>> <br>>>> Sent from my Android phone using TouchDown (<a href="http://www.nitrodesk.com">www.nitrodesk.com</a>)<br>
>>> <br>>>> _______________________________________________<br>>>> cisco-voip mailing list<br>>>> <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>>> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
>>> <br>>>> <br>>>> _______________________________________________<br>>>> cisco-voip mailing list<br>>>> <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>
>>> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>>> <br>>> _______________________________________________<br>>> cisco-voip mailing list<br>
>> <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>>> <br>
>> <br>>> _______________________________________________<br>>> cisco-voip mailing list<br>>> <a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br>>> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
</div>