<div dir="ltr">8.0.3.20000-2</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Apr 5, 2013 at 11:40 AM, Haas, Neal <span dir="ltr"><<a href="mailto:nhaas@co.fresno.ca.us" target="_blank">nhaas@co.fresno.ca.us</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" vlink="purple" link="blue">
<div>
<p class="MsoNormal"><span style="color:rgb(31,73,125);font-family:"Calibri","sans-serif";font-size:11pt">What version are you? 7 or 8<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125);font-family:"Calibri","sans-serif";font-size:11pt"><u></u> <u></u></span></p>
<div>
<div style="border-width:medium medium 1.5pt;border-style:none none solid;border-color:currentColor currentColor windowtext;padding:0in 0in 1pt">
<p style="padding:0in;border:currentColor" class="MsoNormal"><span style="color:rgb(31,73,125);font-family:"Calibri","sans-serif";font-size:11pt"><u></u> <u></u></span></p>
</div>
<p class="MsoNormal"><span style="color:rgb(31,73,125);font-family:"Calibri","sans-serif";font-size:11pt">Neal Haas<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><span style="color:rgb(31,73,125);font-family:"Calibri","sans-serif";font-size:11pt"><u></u> <u></u></span></p>
<div>
<div style="border-width:1pt medium medium;border-style:solid none none;border-color:rgb(181,196,223) currentColor currentColor;padding:3pt 0in 0in">
<p class="MsoNormal"><b><span style="font-family:"Tahoma","sans-serif";font-size:10pt">From:</span></b><span style="font-family:"Tahoma","sans-serif";font-size:10pt"> <a href="mailto:cisco-voip-bounces@puck.nether.net" target="_blank">cisco-voip-bounces@puck.nether.net</a> [mailto:<a href="mailto:cisco-voip-bounces@puck.nether.net" target="_blank">cisco-voip-bounces@puck.nether.net</a>]
<b>On Behalf Of </b>Wes Sisk<br>
<b>Sent:</b> Friday, April 05, 2013 9:09 AM<br>
<b>To:</b> Erick Wellnitz<br>
<b>Cc:</b> cisco-voip<br>
<b>Subject:</b> Re: [cisco-voip] high I/O Wait on one core<u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">cmoninit is one of the informix database processes. There are are several processes that each do different roles. it's not simple to identify the exact role of a specific oninit process.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><quote><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Looks like each of the oninit processes implements a different (or parallel or redundant) part of the overall database server:<br>
<br>
-bash-3.2$ onstat -g sch<br>
<br>
IBM Informix Dynamic Server Version 11.50.UC8X6 -- On-Line -- Up 3 days 16:22:33 -- 230984 Kbytes<br>
<br>
VP Scheduler Statistics:<br>
vp pid class semops busy waits spins/wait<br>
1 24024 cpu 15202292 0 15205721 <br>
2 24066 adm 0 0 0 <br>
3 24067 LIC 18 0 18 <br>
4 24068 DBFNC 1 0 1 <br>
5 24069 lio 136050 0 0 <br>
6 24070 pio 1287 0 0 <br>
7 24071 aio 903428 0 0 <br>
...<br>
<br>
<a href="http://publib.boulder.ibm.com/infocenter/idshelp/v117/index.jsp" target="_blank">http://publib.boulder.ibm.com/infocenter/idshelp/v117/index.jsp</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"></quote><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Generally, yes, you're looking at something in the database generating lots of churn. THis could be CDRs, it could be CAR, it could also be AXL or high rate of change notifications.<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Looks like you would benefit from something like this:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">CLI show tech activesql<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">from:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">CSCsz67357 Need an Informix profiler built into CLI <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Wes<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Apr 5, 2013, at 11:20 AM, Erick Wellnitz <<a href="mailto:ewellnitzvoip@gmail.com" target="_blank">ewellnitzvoip@gmail.com</a>> wrote:<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">caroninit seems to be the biggest offender (by about 50x) in both disk writes and cpu usage. Am I correct in assuming this has something to do with call detail records?<u></u><u></u></p>
</div>
<div>
<p style="margin-bottom:12pt" class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Fri, Apr 5, 2013 at 9:02 AM, Tom Piscitell (tpiscite) <<a href="mailto:tpiscite@cisco.com" target="_blank">tpiscite@cisco.com</a>> wrote:<u></u><u></u></p>
<p style="margin-bottom:12pt" class="MsoNormal">Erick,<br>
<br>
You can use the FIOR utility from the CLI to identify which processes are writing to the disk.<br>
<br>
admin:utils fior<br>
utils fior disable<br>
utils fior enable<br>
utils fior list<br>
utils fior start<br>
utils fior status<br>
utils fior stop<br>
utils fior top<br>
<br>
Here is a typical use case:<br>
<br>
1. Enable the FIOR utility before/during a time of High IO Wait<br>
admin:utils fior enable<br>
File I/O Statistics has been enabled.<br>
admin:utils fior start<br>
Loading fiostats module: ok<br>
Enabling fiostats : ok<br>
File I/O Statistics has been started.<br>
<br>
2. Wait a couple minutes. FIOR will poll for data every 5 seconds I believe. Then use utils fior top to see whats hitting the CPU the hardest:<br>
<br>
admin:utils fior top ?<br>
Syntax:<br>
utils fior top n sort_by [start=date-time] [stop=date-time]<br>
<br>
n: number of processes<br>
sort_by: read, write, read-rate, write-rate<br>
date-time: of the form %H:%M, %H:%M:%S<br>
%a,%H:%M, %a,%H:%M:%S<br>
%Y-%m-%d,%H:%M, %Y-%m-%d %H:%M:%S<br>
Example:<br>
admin:utils fior top 10 write start=2010-04-20 10:00:00 stop=2010-04-20 10:30:00<br>
<br>
This of course won't tell you *why* a process is hitting the disk, but it will at least show you who has the most read/writes. To answer the why question you would need to look at traces for the offending process/service.<br>
<br>
HTH,<br>
-Tom<br>
<br>
On Apr 4, 2013, at 5:43 PM, Erick Wellnitz <<a href="mailto:ewellnitzvoip@gmail.com" target="_blank">ewellnitzvoip@gmail.com</a>> wrote:<br>
<br>
> Hello all!<br>
><br>
> I have a dual 4 core IBM 7835I3 which is my publisher. One one core of the first CPU the I/O Wait is through the roof. RTMT shows that writes to the hard drives are at between 600 and 700 MB/s which is exponentially higher than the subscriber on the same
model of hardware.<br>
><br>
> Short of calling TAC is there any way to figure out what is causing the extremely high volume of writes to the drives? I already stopped most traces and looking at the processes doesn't give any clues.<br>
><br>
> Thanks again!<br>
><br>
><br>
> _______________________________________________<br>
> cisco-voip mailing list<br>
> <a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
> <a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</blockquote></div><br></div>