<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Verdana; font-size: 10pt; color: #000000'>Well, coincidentally enough, we're using a NetApp. :(<br><br>The log entries from the CDR Repository Manager follow. The CDR Agent just has wakeup statements.<br><br>We currently have two of billing servers configured, but during troubleshooting, we had to delete/recreate, and I think during this time, it was still trying to clean up the deleted one which is why you see the three destinations.<br><br>sending to hiroller succeeds and to blackjack it fails. hiroller is a linux box as well, but it is CIFS mounting a windows server filesystem.<br><br>=====<br>file:cdrrepmgr00094.log<br><br>2013-02-21 14:02:29,578 INFO [Thread-11] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 3<br>2013-02-21 14:02:30,271 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 1<br>2013-02-21 14:02:33,194 INFO [Thread-8] cdrrep.FileMonitor (FileMonitor.java:132) - 2 file(s) found under /var/log/active/cm/cdr_repository/tmp<br>2013-02-21 14:02:33,196 INFO [Thread-8] cdrrep.FileMonitor (FileMonitor.java:274) - Processed file: /var/log/active/cm/cdr_repository/tmp/cmr_iptccm105-Cluster_07_201302211902_60910<br>2013-02-21 14:02:33,197 INFO [Thread-8] cdrrep.FileMonitor (FileMonitor.java:274) - Processed file: /var/log/active/cm/cdr_repository/tmp/cdr_iptccm105-Cluster_07_201302211902_60910<br>2013-02-21 14:02:35,582 INFO [Thread-11] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 3<br>2013-02-21 14:02:36,274 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 1<br>2013-02-21 14:02:36,275 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:345) - CDRREP before sending the file: JVM status: [Max = 227.56MB, Total = 46.44MB, Free = 13.68MB (29.46%), Used = 32.76MB (70.54%)]<br>2013-02-21 14:02:36,705 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 2<br>2013-02-21 14:02:36,705 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:166) - There was file delivery failure for destination 2 in last round, re-connect server now!<br>2013-02-21 14:02:37,302 INFO [Thread-9] cdrrep.FtpManager (FtpManager.java:227) - FTP success: cmr_iptccm105-Cluster_07_201302211902_60910 to hiroller.cs.uoguelph.ca<br>2013-02-21 14:02:37,302 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:352) - CDRREP after sending the file: JVM status: [Max = 227.56MB, Total = 46.44MB, Free = 13.47MB (29.01%), Used = 32.97MB (70.99%)]<br>2013-02-21 14:02:38,788 INFO [Thread-10] cdrrep.FtpManager (FtpManager.java:78) - FtpManager constructor 1: Establish server connection to host [blackjack.cs.uoguelph.ca] successfully!<br>2013-02-21 14:02:38,789 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:345) - CDRREP before sending the file: JVM status: [Max = 227.56MB, Total = 46.00MB, Free = 15.44MB (33.56%), Used = 30.56MB (66.44%)]<br>2013-02-21 14:02:39,903 ERROR [Thread-10] sftpapi.SFTPConnection (SFTPConnection.java:131) - Sftp Status Exception : com.maverick.sftp.SftpStatusException: Permission denied<br>2013-02-21 14:02:39,903 ERROR [Thread-10] sftpapi.ftpClient (ftpClient.java:473) - SFTP error in transferring file to another machine.<br>2013-02-21 14:02:39,903 ERROR [Thread-10] sftpapi.ftpClient (ftpClient.java:474) - com.maverick.sftp.SftpStatusException: Permission denied<br>2013-02-21 14:02:39,903 ERROR [Thread-10] sftpapi.ftpClient (ftpClient.java:493) - Exception while sending files: com.maverick.sftp.SftpStatusException: Permission denied<br>2013-02-21 14:02:39,903 ERROR [Thread-10] cdrrep.FtpManager (FtpManager.java:223) - SFTP/FTP failed: cmr_iptccm105-Cluster_04_201302211900_88292 to blackjack.cs.uoguelph.ca<br>2013-02-21 14:02:39,904 ERROR [Thread-10] cdrrep.LogConfig (LogConfig.java:157) - Java Exception happened in my CDRSender, with Exception: <br>java.lang.Exception: SFTP/FTP failed: cmr_iptccm105-Cluster_04_201302211900_88292 to blackjack.cs.uoguelph.ca<br> at com.cisco.ccm.cdrdlv.cdrrep.FtpManager.sendFile(FtpManager.java:225)<br> at com.cisco.ccm.cdrdlv.cdrrep.CDRSender.run(CDRSender.java:349)<br><br>2013-02-21 14:02:39,904 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:364) - sendSuccess=false, numOfFailure=5<br>2013-02-21 14:02:39,904 ERROR [Thread-10] cdrrep.CDRSender (CDRSender.java:365) - java.lang.Exception: SFTP/FTP failed: cmr_iptccm105-Cluster_04_201302211900_88292 to blackjack.cs.uoguelph.ca<br>2013-02-21 14:02:39,904 ERROR [Thread-10] cdrrep.CDRSender (CDRSender.java:366) - Unable to successfully send file to outside billing server blackjack.cs.uoguelph.ca<br>2013-02-21 14:02:39,904 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:389) - More than two times of failure, raise alarm<br>2013-02-21 14:02:39,904 INFO [Thread-10] alarmutil.AlarmSender (AlarmSender.java:101) - alarmName: CDRFileDeliveryFailureContinues<br>2013-02-21 14:02:39,904 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:403) - resendonfailure flag valuetrue<br>2013-02-21 14:02:39,904 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:406) - resendonfailure flag valuetrue<br>2013-02-21 14:02:39,905 INFO [Thread-10] cdrrep.CDRSender (CDRSender.java:407) - host value blackjack.cs.uoguelph.ca<br>2013-02-21 14:02:41,304 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:345) - CDRREP before sending the file: JVM status: [Max = 227.56MB, Total = 46.00MB, Free = 14.84MB (32.27%), Used = 31.16MB (67.73%)]<br>2013-02-21 14:02:41,585 INFO [Thread-11] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 3<br>2013-02-21 14:02:42,367 INFO [Thread-9] cdrrep.FtpManager (FtpManager.java:227) - FTP success: cdr_iptccm105-Cluster_07_201302211902_60910 to hiroller.cs.uoguelph.ca<br>2013-02-21 14:02:42,367 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:352) - CDRREP after sending the file: JVM status: [Max = 227.56MB, Total = 46.00MB, Free = 14.61MB (31.77%), Used = 31.39MB (68.23%)]<br>2013-02-21 14:02:47,588 INFO [Thread-11] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 3<br>2013-02-21 14:02:48,370 INFO [Thread-9] cdrrep.CDRSender (CDRSender.java:105) - CDRSender wakes up for destination 1<br><br>=====<br><span><br><span name="x"></span>---<br>Lelio Fulgenzi, B.A.<br>Senior Analyst (CCS) * University of Guelph * Guelph, Ontario N1G 2W1<br>(519) 824-4120 x56354 (519) 767-1060 FAX (ANNU)<br>^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>Cooking with unix is easy. You just sed it and forget it. <br> - LFJ (with apologies to Mr. Popeil)<br><span name="x"></span><br></span><br><hr id="zwchr"><b>From: </b>"Erick B." <erickbee@gmail.com><br><b>To: </b>"Lelio Fulgenzi" <lelio@uoguelph.ca><br><b>Cc: </b>"Ryan Ratliff" <rratliff@cisco.com>, "voip puck" <cisco-voip@puck.nether.net><br><b>Sent: </b>Friday, February 22, 2013 2:14:56 PM<br><b>Subject: </b>Re: [cisco-voip] Differences between DRS and CDR SFTP activities<br><br><div dir="ltr">I have noticed a difference to with the DRS and CDR SFTP jobs, going to a NetApp. DRS worked fine but CDR billing job had issues with NetApp and moved CDR to use Windows server with different SFTP server. Something on my to-do list of things to figure out one of these days... </div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Feb 22, 2013 at 1:06 PM, Lelio Fulgenzi <span dir="ltr"><<a href="mailto:lelio@uoguelph.ca" target="_blank">lelio@uoguelph.ca</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div style="font-size:10pt;font-family:Verdana">hmmm, never thought about collecting those. i'll go look right now. but here's what I see from the syslog host we're sending events to:<br><br>Feb 21 13:24:09 <a href="http://iptccm105.cs.uoguelph.ca" target="_blank">iptccm105.cs.uoguelph.ca</a> 2272: : : 697: Feb 21 18:24:09.952 UTC : %CCM_CDR_REP-CDRREP-3-CDRFileDeliveryFailureContinues: (s)FTP delivery of CDR files failed on retries. BillingServerAddress:<a href="http://blackjack.cs.uoguelph.ca" target="_blank">blackjack.cs.uoguelph.ca</a> App ID:Cisco CDR Repository Manager Cluster ID: Node ID:iptccm105<div class="im">
<br><br><span><br><span></span>---<br>Lelio Fulgenzi, B.A.<br>Senior Analyst (CCS) * University of Guelph * Guelph, Ontario N1G 2W1<br>(519) 824-4120 x56354 (519) 767-1060 FAX (ANNU)<br>^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>
Cooking with unix is easy. You just sed it and forget it. <br> - LFJ (with apologies to Mr. Popeil)<br><span></span><br></span><br><hr></div><b>From: </b>"Ryan Ratliff" <<a href="mailto:rratliff@cisco.com" target="_blank">rratliff@cisco.com</a>><br>
<b>To: </b>"Lelio Fulgenzi" <<a href="mailto:lelio@uoguelph.ca" target="_blank">lelio@uoguelph.ca</a>><br><b>Cc: </b><a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<b>Sent: </b>Friday, February 22, 2013 2:01:13 PM<br><b>Subject: </b>Re: [cisco-voip] Differences between DRS and CDR SFTP activities<div><div class="h5"><br><br>What do the logs for CDR Repository Manager (or CDR Agent, I don't recall offhand which one does the sftp) say about why it's failing? The only immediate difference I can think of is the nature of the files being written though that doesn't really explain why filesystem ownership has an impact.<div>
<br><div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px">-Ryan</span>
</div>
<br><div><div>On Feb 22, 2013, at 1:42 PM, Lelio Fulgenzi <<a href="mailto:lelio@uoguelph.ca" target="_blank">lelio@uoguelph.ca</a>> wrote:</div><br><div style="font-family:'Lucida Grande';font-size:medium;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<div style="font-family:Verdana;font-size:10pt"><br>So, we've set up an SFTP server on a linux box and setup a (mounted) filesystem where a user is not the owner, but part of the group that has rw access. WinSCP works fine, user is able to write files. DRS is fine, backups work fine. CDR billing server does not work, transfers fail with partially written files and then others don't go through at all.<br>
<br>The only way we got CDR transfers to work, was when use used a local filesystem where the user was the owner used a user owned the mounted filesystem it worked. Again, DRS works fine without any of these issues.<br><br>
Can anyone speak to the nuances between the DRS SFTP process and the CDR SFTP process and why one would work and one would not?<br><br><br><span><br><span></span>---<br>Lelio Fulgenzi, B.A.<br>Senior Analyst (CCS) * University of Guelph * Guelph, Ontario N1G 2W1<br>
(519) 824-4120 x56354 (519) 767-1060 FAX (ANNU)<br>^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>Cooking with unix is easy. You just sed it and forget it.<span> </span><br> - LFJ (with apologies to Mr. Popeil)<br>
<span></span><br></span><br></div>_______________________________________________<br>cisco-voip mailing list<br><a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br><a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
</div></div><br></div></div></div></div></div><br>_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><br>
<br></blockquote></div><br></div>
</div></body></html>