<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 12 (filtered medium)"><base href="x-msg://734/"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Webdings;
panose-1:5 3 1 2 1 5 9 6 7 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
h6
{mso-style-priority:9;
mso-style-link:"Heading 6 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:7.5pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.apple-style-span
{mso-style-name:apple-style-span;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.Heading6Char
{mso-style-name:"Heading 6 Char";
mso-style-priority:9;
mso-style-link:"Heading 6";
font-family:"Cambria","serif";
color:#243F60;
font-style:italic;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:597906390;
mso-list-type:hybrid;
mso-list-template-ids:1147417984 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="2050" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>hi wes..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>i did contact my cisco account..and we’re going to consult what to do further more..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>what i’m afraid of is that i’m not sure what to expect from my TAC case..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>to be honest, i’m getting terrible support from cisco TAC and IBM, and the bottom line is:<o:p></o:p></span></font></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span style='mso-list:Ignore'>1.<font size=1 face="Times New Roman"><span style='font:7.0pt "Times New Roman"'> </span></font></span></span></font><![endif]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> that IBM thinks they don’t have a problem since RAID works in the terms it reports RAID degradation when one HDD is pulled out..and it’s resynched when disk is back in server..although we have more specific situation that we don’t have bootable device when left HDD is pulled out..<o:p></o:p></span></font></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span style='mso-list:Ignore'>2.<font size=1 face="Times New Roman"><span style='font:7.0pt "Times New Roman"'> </span></font></span></span></font><![endif]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>cisco engineer doesn’t have any clue about almost anything in the case and he just bounces it back to the IBM..i even got a line from him which pretty much tells me about the level of expertise ( </span></font>Sinisa, I’m sorry, but I have not been able to find you an answer.Our group is geared to handle hardware break-fix. We were able to replace the drive, but in terms of failure analysis or RAID configurations, I just don’t have any documentation or materials to properly answer your questions.<font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></font></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span style='mso-list:Ignore'>3.<font size=1 face="Times New Roman"><span style='font:7.0pt "Times New Roman"'> </span></font></span></span></font><![endif]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>from TAC perspective we had operational system when we initially repalaced the failed HDD and all the after work and troubleshooting were result of our efforts to clear this out ( including RMA )..<o:p></o:p></span></font></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><span style='mso-list:Ignore'>4.<font size=1 face="Times New Roman"><span style='font:7.0pt "Times New Roman"'> </span></font></span></span></font><![endif]><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>so having in mind the fact that IBM doesn’t get deep enough, and the fact that i stuck with engineer who “doesn’t know and doesn’t have docs and materials”..i’m in pretty sparkling situation - </span></font><font size=2 color="#1f497d" face=Wingdings><span style='font-size:11.0pt;font-family:Wingdings;color:#1F497D'>J</span></font><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>..i cannot see end to it..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>thanx..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>regards..<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><div><p class=MsoNormal><b><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black;font-weight:bold'>Sinisa Djokic</span></font></b><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'> </span></font><font color=black face=Arial><span style='font-family:"Arial","sans-serif";color:black'><o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>System Engineer</span></font><font color=black face=Arial><span style='font-family:"Arial","sans-serif";color:black'><br></span></font><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>CCIE #25996 Voice</span></font><font color=black face=Arial><span style='font-family:"Arial","sans-serif";color:black'><o:p></o:p></span></font></p><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'> <o:p></o:p></span></font></p></div><table class=MsoNormalTable border=0 cellpadding=0><tr><td style='padding:.75pt .75pt .75pt .75pt'><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'><img width=60 height=94 id="Picture_x0020_1" src="cid:image002.png@01CCEBB2.47A4A3E0"><o:p></o:p></span></font></p></td><td style='padding:.75pt .75pt .75pt .75pt'><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'> <o:p></o:p></span></font></p></td><td style='padding:.75pt .75pt .75pt .75pt'><p class=MsoNormal><font size=1 color=black face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:black'>MDS Informaticki inzenjering<br>Milutina Milankovica 7d<br>11070 Novi Beograd, Serbia<br>Tel: +381 11 2015 200 +381 11 2015 200 , 2015 273<br>Fax: +381 11 3194 954</span></font><font size=1 color="#1f497d"><span style='font-size:9.0pt;color:#1F497D'><br></span></font><font size=1 color="#1f497d" face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:#1F497D'><a href="http://www.mds.rs">www.mds.rs</a></span></font><font size=1 color="#1f497d"><span style='font-size:9.0pt;color:#1F497D'><br></span></font><font size=1 color="#1f497d" face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:#1F497D'><a href="mailto:sdjokic@mds.rs">sdjokic@mds.rs</a></span></font><font size=1 color="#1f497d"><span style='font-size:9.0pt;color:#1F497D'><o:p></o:p></span></font></p></td></tr></table><p class=MsoNormal><font size=1 color="#a6a6a6" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#A6A6A6'>This e-mail message and any attachment are intended exclusively for the named addressee. They may contain confidential information which may also be protected by professional secrecy. Unless you are the named addressee (or authorised to receive for the addressee) you may not copy or use this message or any attachment or disclose the contents to anyone else. If this e-mail was sent to you by mistake please notify the sender immediately and delete this e-mail.<o:p></o:p></span></font></p><p class=MsoNormal style='margin-top:6.0pt'><b><font size=5 color=green face=Webdings><span style='font-size:16.0pt;font-family:Webdings;color:green;font-weight:bold'>P</span></font></b><font size=1 color="#00b050" face=Arial><span style='font-size:8.0pt;font-family:"Arial","sans-serif";color:#00B050'> </span></font><font size=1 color="#00b050" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#00B050'>Save a tree. Don’t print this e-mail unless it’s really necessary.<o:p></o:p></span></font></p><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></font></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";font-weight:bold'>From:</span></font></b><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Wes Sisk [mailto:wsisk@cisco.com] <br><b><span style='font-weight:bold'>Sent:</span></b> Tuesday, February 14, 2012 9:42 PM<br><b><span style='font-weight:bold'>To:</span></b> Sinisa Djokic<br><b><span style='font-weight:bold'>Cc:</span></b> 'Cisco VOIP'<br><b><span style='font-weight:bold'>Subject:</span></b> Re: [cisco-voip] 7825-I4 RAID and HDD strange behaviour or not !!!<o:p></o:p></span></font></p></div></div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Hi Sinisa,<o:p></o:p></span></font></p><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Yes, your account team needs advocate to get CSCtd86222 resolved.<o:p></o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Yes, you are still having hardware issues if drives will not sync or boot. Work with TAC to get additional support from IBM.<o:p></o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Regards,<o:p></o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Wes<o:p></o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>On Feb 14, 2012, at 1:39 PM, Sinisa Djokic wrote:<o:p></o:p></span></font></p></div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><br><br></span></font><span class=apple-style-span><font size=4 face=Helvetica><span style='font-size:13.5pt;font-family:"Helvetica","sans-serif"'><o:p></o:p></span></font></span></p><div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>hi wes..</span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>thanx on your support..</span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>if we’re hitting this bug, then i’m pleased that i’ve passed sanity check regarding RAID1 expected behavior -</span></font><font size=2 color="#1f497d" face=Wingdings><span style='font-size:11.0pt;font-family:Wingdings;color:#1F497D'>J</span></font><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>..although i would like to bu sure we’re hitting this so i can explain it to the customer and to be sure that’s the core issue..</span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>but i’m a little bit confused about two things and it would be great if you can clarify..</span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><p class=MsoNormal><b><font size=3 color="#c00000" face="Times New Roman"><span style='font-size:12.0pt;color:#C00000;font-weight:bold'>W.S.<span class=apple-converted-space> </span></span></font></b>Net result is any missing drive causes "unsupported platform". Let your Cisco account team know this is a problem. Get your TAC case attached to this to provide more evidence of customer impact. This is all a software limitation that could be overcome with sufficient motivation.<o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#00b050" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#00B050'>S.DJ.<span class=apple-converted-space> </span></span></font></b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>do i understand you correctly?..you mean, that we should inform our cisco account so they could push it and ask for enhancement which could be linked to bug<span class=apple-converted-space> </span>CSCtd86222 severity<span class=apple-converted-space> </span><strong><b><font face=Arial><span style='font-family:"Arial","sans-serif";font-weight:normal'>6 – enhancement..</span></font></b></strong></span></font><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><strong><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>we’re going to do that, although i’m not sure how can we describe non-functional RAID just as an enhacement..it looks much more severe to me..since customer who bought servers with more then one HDDs ( all other then 7816 ) don’t have redundancy..in our case we have a failed publisher beacuse of one failed HDD..</span></font></b></strong><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><strong><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>so, in this case i suppose motivation is drive from number of enhancement requests -</span></font></b></strong><span class=apple-converted-space><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></span><strong><b><font size=2 color="#1f497d" face=Wingdings><span style='font-size:10.0pt;font-family:Wingdings;color:#1F497D;font-weight:normal'>J</span></font></b></strong><strong><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>..</span></font></b></strong><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><strong><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b></strong><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color=red face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:red'>W.S.<span class=apple-converted-space> </span></span></font></b><font size=2 face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";font-weight:normal'>Otherwise, the 7825 hardware uses a rather poor implementation of RAID IMHO. Technically it is mirrored but we just do not see the same level of reliability in that platform. You are still facing a hardware failure and we must look to IBM to resolve that</span></font><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#00b050" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#00B050'>S.DJ.<span class=apple-converted-space> </span></span></font></b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>what do you mean by that that we’re still facing HW failure?..since we’re having new server, with new HDDs, and the system is fully operational until we pull out any of HDDs ( while server is shit down )..RAID is in operational state, everything looks fine, until one HDD is pulled out..if the left one is pulled out ( primary one ) we don’t even have bootable device and if right one is pulled out we have unsupported hardware issue..if you think we still have HW issue what should we tell TAC and IBM..it’s new hardware and it’s behaving exactly the same as the old one..then it should issue on all the servers..</span></font><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>so, the bottom line is, do you think we should just ask our cisco account to push it our we should push IBM or TAC for any further troubleshooting?..</span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>thanx..</span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'> </span></font></b><o:p></o:p></h6><h6 style='margin:0in;margin-bottom:.0001pt'><b><font size=2 color="#1f497d" face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D;font-weight:normal'>regards..</span></font></b><o:p></o:p></h6><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><div><p class=MsoNormal><b><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black;font-weight:bold'>Sinisa Djokic</span></font></b><o:p></o:p></p></div><div><p class=MsoNormal><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>System Engineer</span></font><font color=black face=Arial><span style='font-family:"Arial","sans-serif";color:black'><br></span></font><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>CCIE #25996 Voice</span></font><o:p></o:p></p></div><div><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'> </span></font><o:p></o:p></p></div></div><table class=MsoNormalTable border=0 cellpadding=0><tr><td style='padding:.75pt .75pt .75pt .75pt'><div><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'><image003.png></span></font><o:p></o:p></p></div></td><td style='padding:.75pt .75pt .75pt .75pt'><div><p class=MsoNormal><font size=3 color="#1f497d" face="Times New Roman"><span style='font-size:12.0pt;color:#1F497D'> </span></font><o:p></o:p></p></div></td><td style='padding:.75pt .75pt .75pt .75pt'><div><p class=MsoNormal><font size=1 color=black face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:black'>MDS Informaticki inzenjering<br>Milutina Milankovica 7d<br>11070 Novi Beograd, Serbia<br>Tel: +381 11 2015 200 +381 11 2015 200 , 2015 273<br>Fax: +381 11 3194 954</span></font><font size=1 color="#1f497d"><span style='font-size:9.0pt;color:#1F497D'><br></span></font><font size=1 color="#1f497d" face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:#1F497D'><a href="http://www.mds.rs">www.mds.rs</a></span></font><font size=1 color="#1f497d"><span style='font-size:9.0pt;color:#1F497D'><br></span></font><font size=1 color="#1f497d" face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:#1F497D'><a href="mailto:sdjokic@mds.rs">sdjokic@mds.rs</a></span></font><o:p></o:p></p></div></td></tr></table><div><p class=MsoNormal><font size=1 color="#a6a6a6" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#A6A6A6'>This e-mail message and any attachment are intended exclusively for the named addressee. They may contain confidential information which may also be protected by professional secrecy. Unless you are the named addressee (or authorised to receive for the addressee) you may not copy or use this message or any attachment or disclose the contents to anyone else. If this e-mail was sent to you by mistake please notify the sender immediately and delete this e-mail.</span></font><o:p></o:p></p></div><p class=MsoNormal style='margin-top:6.0pt'><b><font size=5 color=green face=Webdings><span style='font-size:16.0pt;font-family:Webdings;color:green;font-weight:bold'>P</span></font></b><span class=apple-converted-space><font size=1 color="#00b050" face=Arial><span style='font-size:8.0pt;font-family:"Arial","sans-serif";color:#00B050'> </span></font></span><font size=1 color="#00b050" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#00B050'>Save a tree. Don’t print this e-mail unless it’s really necessary.</span></font><o:p></o:p></p><div><p class=MsoNormal><font size=2 color="#1f497d" face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></font><o:p></o:p></p></div><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in;border-width:initial;border-color:initial'><div><p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";font-weight:bold'>From:</span></font></b><span class=apple-converted-space><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> </span></font></span><font size=2 face=Tahoma><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>Wes Sisk [<a href="mailto:wsisk@cisco.com">mailto:wsisk@cisco.com</a>]<span class=apple-converted-space> </span><br><b><span style='font-weight:bold'>Sent:</span></b><span class=apple-converted-space> </span>Tuesday, February 14, 2012 5:09 PM<br><b><span style='font-weight:bold'>To:</span></b><span class=apple-converted-space> </span>Sinisa Djokic<br><b><span style='font-weight:bold'>Cc:</span></b><span class=apple-converted-space> </span>'Cisco VOIP'<br><b><span style='font-weight:bold'>Subject:</span></b><span class=apple-converted-space> </span>Re: [cisco-voip] 7825-I4 RAID and HDD strange behaviour or not !!!</span></font><o:p></o:p></p></div></div></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Sinisa,<o:p></o:p></span></font></p></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>CallManager hot issues RSS feed is your friend:<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><a href="https://supportforums.cisco.com/docs/DOC-5727">https://supportforums.cisco.com/docs/DOC-5727</a><o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>In the CallManager feed there is this well known defect:<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Absence of a single physical disk is preventing License Manager to start, Open CSCtd86222Symptom:<br><br>License Manager doesn't startup after rebooting a server.<br><br><br>Conditions:<br><br>CUCM Server will prompt about a Hardware Configuration Failure if one of the drives from either logical drive arrays are missing. If the customer chooses to continue License Manager service will never startup. Lack of License Manager on the Publisher node prevents any administrative changes being performed like adding a new phone or deleting.<br><br><br>Workaround:<br><br>Ensure all 4 drives are plugged in to the server even if they are failed/defunct drives.<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Net result is any missing drive causes "unsupported platform". Let your Cisco account team know this is a problem. Get your TAC case attached to this to provide more evidence of customer impact. This is all a software limitation that could be overcome with sufficient motivation.<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>Otherwise, the 7825 hardware uses a rather poor implementation of RAID IMHO. Technically it is mirrored but we just do not see the same level of reliability in that platform. You are still facing a hardware failure and we must look to IBM to resolve that.<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>/wes<o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div><div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>On Feb 14, 2012, at 10:43 AM, Sinisa Djokic wrote:<o:p></o:p></span></font></p></div></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div><div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>hi group..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>does anybody have expertise on this matter..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>maybe wes or ryan have inside info..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>we had a TAC case with failed HDD and problematic RAID controller in MCS-7825-I4 server running CUCM 7.1.5..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>the symptom happend when we shutdown the server in order to check what IBR FRU is on memory inside the server..we checked it and after that we powered up the server.. RAID controller reports DEGRADED state..cisco OS started to boot and in certain point it reported something like “ unsupported hardware......not for the production..without TAC support..bla..bla..bla )”..we opened the case..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>during the case we upgraded all kinds of firmware on server and also find out that one HDD failed..we replaced it and troubleshooted more..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>finally we got RMA for the server but have spotted very strange behavior on the new server as well ( we put in into lab to test it )..so, we’re thinking , is the following expected behaviour or there is a serious problem in cisco OS or IBM HW..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div style='margin-left:.5in'><div><p class=MsoNormal style='text-indent:-.25in'><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>1.</span></font><font size=1><span style='font-size:7.0pt'> <span class=apple-converted-space> </span></span></font><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>first of all we upgraded the HDD firmware on the new server we got from RMA to 3B06 ( it was with 3B05 ) having in mind<b><span style='font-weight:bold'>CSCti52867<span class=apple-converted-space> </span></span></b>which we hitted earlier..after that we’installed CUCM 7.1.5..</span></font><o:p></o:p></p></div></div><div style='margin-left:.5in'><div><p class=MsoNormal style='text-indent:-.25in'><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>2.</span></font><font size=1><span style='font-size:7.0pt'> <span class=apple-converted-space> </span></span></font><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>when server is shut down and we pull out the right hard drive ( the one in BAY 1)..we power up the server..RAID controller detects one drive missing and reports DEGRADED state..cisco OS starts to boot and in certain point it reports again something like “ unsupported hardware......not for the production..without TAC support..bla..bla..bla )..</span></font><o:p></o:p></p></div></div><div style='margin-left:.5in'><div><p class=MsoNormal style='text-indent:-.25in'><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>3.</span></font><font size=1><span style='font-size:7.0pt'> <span class=apple-converted-space> </span></span></font><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>when we shut down the server again..and switch the scenario..we get back the right HDD in server ( BAY 1 ) and pull out the left HDD out ( BAY 0 )..when we power up the server..it doesn’t even detect bootable device like there is no HDDs inside..</span></font><o:p></o:p></p></div></div><div style='margin-left:.5in'><div><p class=MsoNormal style='text-indent:-.25in'><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>4.</span></font><font size=1><span style='font-size:7.0pt'> <span class=apple-converted-space> </span></span></font><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>so, when we shut down the server again..and get back both HDDs where they belong..power up the server..everythings works fine..of course, RAID is resynching..</span></font><o:p></o:p></p></div></div><div style='margin-left:.5in'><div><p class=MsoNormal style='text-indent:-.25in'><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>5.</span></font><font size=1><span style='font-size:7.0pt'> <span class=apple-converted-space> </span></span></font><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>of course both HDDs used in server are in correct state and aren’t failed..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>so, i’m a little bit confused, since it’s happening on 2 different servers..identical scenario..my RAID1 perception is in serious doubt..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>does this mean that if HDD failed during regular maintenance shutdown ( which we had in the first place ), RAID shouldn’t provide operational system?..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>to be honest , we didn’t have failed disk while server was up and online so we couldn’t notice what’s going on in that situation..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>but the fact is, with the old server and with the new server, when we pull out one of the HDDs the system wouldn’t boot up properly..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>is this expected behaviour?..what’s the purpose of RAID1 then?..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>is RAID1 expected to cover just online HDD failure ( if so ) or it should work in every scenario?..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>any thoughts?..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>thanx..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'>regards..</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><b><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black;font-weight:bold'>Sinisa Djokic</span></font></b><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>System Engineer</span></font><font color=black face=Arial><span style='font-family:"Arial","sans-serif";color:black'><br></span></font><font size=2 color=black face=Arial><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>CCIE #25996 Voice</span></font><o:p></o:p></p></div></div><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div><table class=MsoNormalTable border=0 cellpadding=0><tr><td style='padding:.75pt .75pt .75pt .75pt'><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><image002.png><o:p></o:p></span></font></p></div></div></td><td style='padding:.75pt .75pt .75pt .75pt'><div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div></td><td style='padding:.75pt .75pt .75pt .75pt'><div><div><p class=MsoNormal><font size=1 color=black face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif";color:black'>MDS Informaticki inzenjering<br>Milutina Milankovica 7d<br>11070 Novi Beograd, Serbia<br>Tel: +381 11 2015 200 +381 11 2015 200 , 2015 273<br>Fax: +381 11 3194 954</span></font><font size=1><span style='font-size:9.0pt'><br></span></font><font size=1 face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif"'><a href="http://www.mds.rs">www.mds.rs</a></span></font><font size=1><span style='font-size:9.0pt'><br></span></font><font size=1 face=Arial><span style='font-size:9.0pt;font-family:"Arial","sans-serif"'><a href="mailto:sdjokic@mds.rs">sdjokic@mds.rs</a></span></font><o:p></o:p></p></div></div></td></tr></table><div><div><p class=MsoNormal><font size=1 color="#a6a6a6" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#A6A6A6'>This e-mail message and any attachment are intended exclusively for the named addressee. They may contain confidential information which may also be protected by professional secrecy. Unless you are the named addressee (or authorised to receive for the addressee) you may not copy or use this message or any attachment or disclose the contents to anyone else. If this e-mail was sent to you by mistake please notify the sender immediately and delete this e-mail.</span></font><o:p></o:p></p></div></div><p class=MsoNormal style='margin-top:6.0pt'><b><font size=5 color=green face=Webdings><span style='font-size:16.0pt;font-family:Webdings;color:green;font-weight:bold'>P</span></font></b><span class=apple-converted-space><font size=1 color="#00b050" face=Arial><span style='font-size:8.0pt;font-family:"Arial","sans-serif";color:#00B050'> </span></font></span><font size=1 color="#00b050" face=Arial><span style='font-size:7.0pt;font-family:"Arial","sans-serif";color:#00B050'>Save a tree. Don’t print this e-mail unless it’s really necessary.</span></font><o:p></o:p></p><div><div><p class=MsoNormal><font size=2 face=Calibri><span style='font-size:11.0pt;font-family:"Calibri","sans-serif"'> </span></font><o:p></o:p></p></div></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'>_______________________________________________<br>cisco-voip mailing list<br><a href="mailto:cisco-voip@puck.nether.net">cisco-voip@puck.nether.net</a><br><a href="https://puck.nether.net/mailman/listinfo/cisco-voip">https://puck.nether.net/mailman/listinfo/cisco-voip</a><o:p></o:p></span></font></p></div></div></div><div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'> <o:p></o:p></span></font></p></div></div></div></div><p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p></div></div></body></html>