[cisco-voip] Trace files for CUCM/NTP problem

[Ed Leatherman]

Hi folks,

Our operations team updated the NTP service recently (infoblox), and
right after that happened, I started getting syslog errors per below
on two different CUCM 7 clusters, both of which use that NTP server.

ntpRunningStatus.sh: Primary node NTP server, OWP-PUB, is currently
inaccessible or down. Verify the network between the primary and
secondary nodes.  Check the status of NTP on both the primary and
secondary nodes via CLI 'utils ntp status'.  If the network is fine,
try restarting NTP using CLI 'utils ntp restart'.

Looking at the status on these servers, the pub looks OK but the subs show:
utils ntp status on all secondary nodes comes up with (example):
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
*127.127.1.0     LOCAL(0)        10 l   32   64  377    0.000    0.000   0.004
 10.192.20.10    .STEP.          16 u  488  512  376    0.244   16.553   0.052

Restarting NTP on all nodes fixes the problem temporarily (NTP status
goes back to normal) but only for a short time.

The NTP logs don't show anything other than what appears to be the NTP
service restarting every 30 minutes.. is this normal?
11/16/2010 23:00:02
sd_ntp|*********************************************************|<LVL::Info>
11/16/2010 23:00:02 sd_ntp|          Running sd_ntp. Process Id=12302
               |<LVL::Info>
11/16/2010 23:00:02
sd_ntp|*********************************************************|<LVL::Info>
11/16/2010 23:00:02 sd_ntp||<LVL::Info>
11/16/2010 23:00:02 sd_ntp|[528] Command Line parameters: -list -s|<LVL::Info>
11/16/2010 23:00:02 sd_ntp|[585] The file /etc/ntp.conf exists|<LVL::Debug>
11/16/2010 23:00:02 sd_ntp|[421] /etc/ntp/drift file is not changed|<LVL::Debug>
11/16/2010 23:00:02 sd_ntp|[603] Listing all the servers|<LVL::Debug>
11/16/2010 23:00:02 sd_ntp|sd_ntp exitinng normally.|<LVL::Info>

In both clusters, the pub and most or all of the subs are on the same
VLAN and physical switch.

What other traces can I look at on CM to troubleshoot this? Anyone
know if there is a debug for the process that's generating my syslog
errors?

I want to make sure it's not an error on my end and hopefully have
some better information on whats broke before I go back to the
operations group. All the IOS routers using infoblox for NTP appear to
be working just fine, so they see no problems :)

Thanks in advance!

-- 
Ed Leatherman