<div dir="ltr"><div>Hey James,</div><div><br></div><div>If you have flex subscription (even on premise) - then you'll be able to activate Control Hub and Serviceability Connector and Connected UC.</div><div>Perfect to help investigate and quantify the voice side of things.</div><div>You can just keep using everything on prem and Teams etc - no problems - but you'll get the management features in CH - which are good, and getting better - definitely worth having (especially since you are on 14).</div><div>Your partner should be able to spin you up a trial (even if not on flex).</div><div><br></div><div>That definitely requires a diagram / whiteboard (and a fair amount of brainpower) :)</div><div><br></div><div>Maybe someone can chime in with some specifics on the QoS side of things.</div><div><br></div><div>My next thoughts would be:</div><div>- If you suspect capacity / QoS etc.. maybe schedule some testing to try reproduce it during busy time - if you have it available to you - I would leverage Cisco and Extreme support (even seeing if you can generate some traffic)<br></div><div>- Maybe something else can be done ingress before the X440's on Enterasys or Extreme</div><div>- Maybe check out latest SRND / CVD's on Cisco - and also latest Cisco Live sessions (potentially from a few years back now) - there is gold in there often</div><div><br></div><div>Cheers,</div><div><br></div><div>Tim</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 24 Jun 2022 at 18:13, James Andrewartha <<a href="mailto:jandrewartha@ccgs.wa.edu.au">jandrewartha@ccgs.wa.edu.au</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-AU" style="overflow-wrap: break-word;">
<div class="gmail-m_-1289957433500193594WordSection1">
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">Hi Tim,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">CUCM 14.0.1.11900-132, upgraded from 12.5 in January, it was happening before the upgrade as well. No Webex Control hub, we’re strictly on-prem (and use MS Teams for chat/VC etc), but I’ll
ask my partner about it. Happens on both 7975 and 8841 (at first we thought it was the 8841 I put in so I swapped it back but it still happens).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">My money is on QoS because the path is 2921 1Gb -> Enterasys B5 1Gb -> Extreme VSP7400 10Gb -> Extreme X440-G2 port 1:48 1Gb -> Extreme X440-G2 1Gb -> phones. The packet buffers on the X440-G2
are 1.5MB per 24 ports, so fairly easily overloaded going from 10Gb to 1Gb, and there’s plenty of client devices (largely iPads) hanging off the second switch (via APs), which could easily be doing large downloads and causing microburst packet drops. Plus
I definitely see congestion drops on that port:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Slot-1 dblockr1x.5 # show ports 1:48 buffer<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Packet Buffer Allocation for ports in range 1:25-48,49,50<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Total Packet Buffer Size: 1572864 bytes, Not Overcommitted<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Total Shared Buffer Size: 957824<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Port 1:48 Max Shared Buffer Usage: 239360 bytes (25%)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> QP1: Reserved Buffer: 4096 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> QP5: Reserved Buffer: 4096 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> QP8: Reserved Buffer: 4096 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Slot-1 dblockr1x.14 # show ports 1:48 qosmonitor congestion port-number no-refresh<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Port Qos Monitor<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Port QP1 QP2 QP3 QP4 QP5 QP6 QP7 QP8<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Pkt Pkt Pkt Pkt Pkt Pkt Pkt Pkt<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Cong Cong Cong Cong Cong Cong Cong Cong<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">================================================================================<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">1:48 1266064 0 0 0 0 0 0 0<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Slot-1 dblockr1x.13 # show ports 1:48 qosmonitor no-refresh port-number<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Port Qos Monitor<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Port QP1 QP2 QP3 QP4 QP5 QP6 QP7 QP8<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Pkt Pkt Pkt Pkt Pkt Pkt Pkt Pkt<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Xmts Xmts Xmts Xmts Xmts Xmts Xmts Xmts<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">========================================================================================================<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">1:48 11521231822 0 0 0 12196455 0 0 179452595<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">802.1p priority 5 is mapped to QP5, the phones on VLAN100 do mark it correctly which is why you can see some packets in that queue. Most other buildings on campus don’t have an extra switch
between them and the core, so they are probably better buffered at the core (which I believe is a Trident 3 with 32MB of packet buffers) and don’t have packet drops (not that I can find the show command for those statistics). We are a pretty simple
network, single campus with a star network (ie everything goes direct to the core), and this is the only location reporting this particularly problem. While I agree there could be plenty of places to look for the problem, this one is standing out to me and
the obvious one to attack first.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">(We also have another problem which has persisted for a decade where we sometimes get one-way audio at the start of a call, which fixes itself after a certain amount of time. Also hard to reproduce,
double-pressing ? shows no packets in one direction, and in this case the 8841 is better than 7965/75, so the solution is probably to replace all of them, but I can’t commit to that until I get this other issue sorted).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">So that’s why I want to make the 2921 (or 4331) map DSCP to 802.1p when routing. I see mls qos which has what I want, but apparently that’s for switches? I couldn’t work out how to apply it
to an interface anyway.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">voip1#show mls qos maps dscp-cos<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Dscp-cos map:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> dscp: 0 8 10 16 18 24 26 32 34 40 46 48 56<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> -----------------------------------------------<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> cos: 0 1 1 2 2 3 3 4 4 5 5 6 7<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">There’s plenty of documentation on matching traffic and then applying it, but I just want the DSCP value to be mapped to cos using that table. I’ve tried some things in the past, I can see
currently I’ve got a policy applying cos 2 to all packets going out GigabitEthernet0/0.100 but last I checked with Wireshark I couldn’t see it on the wire:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">voip1#show policy-map interface gigabitEthernet 0/0.100<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">GigabitEthernet0/0.100<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Service-policy output: default-policy<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Class-map: class-default (match-any)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> 173595101 packets, 21932583198 bytes<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> 5 minute offered rate 26000 bps, drop rate 0000 bps<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Match: any<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> QoS Set<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> cos 2<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> Packets marked 173595102<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">I’ll have to go back and test it again, it’s been a few months since I last had a good go at it (complaints have worsened this week), but any pointers as to where to start with the configuration
would be greatly appreciated.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">Thanks,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">-- <u></u>
<u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">James Andrewartha<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Network & Projects Engineer<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Christ Church Grammar School<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Claremont, Western Australia<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Ph. (08) 9442 1757<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Mob. 0424 160 877<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"><u></u> <u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> Tim Smith <<a href="mailto:tim.smith@enject.com.au" target="_blank">tim.smith@enject.com.au</a>>
<br>
<b>Sent:</b> Friday, 24 June 2022 1:32 PM<br>
<b>To:</b> James Andrewartha <<a href="mailto:jandrewartha@ccgs.wa.edu.au" target="_blank">jandrewartha@ccgs.wa.edu.au</a>><br>
<b>Cc:</b> voyp list, cisco-voip (<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a>) <<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a>><br>
<b>Subject:</b> Re: [cisco-voip] Getting IOS to translate from DSCP to 802.1p<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">Hi James,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">It might be worth tidying up, but I'd be surprised if that was the cause of this issue.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">What version of CUCM are you running?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Do you have a Webex Control Hub and Connected UC setup yet?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">(If you don't have Flex and Control Hub - a partner could spin up a trial to use temporarily).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">This integration is really useful.. especially for intermittent issues.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">It's going to give you a read on all the calls that go through and their quality.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">So you can pin-point issues, and then dive into them.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">You can also then get TAC to work these things directly (they can actually pull traces as well).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">But having the consolidated list of calls and quality is a game changer (especially spotting patterns etc).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">And of course it is really quick and easy to set up if you have some spare VM space.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Otherwise, old school, I'd be looking at the media flows (is there anything else in the path - i.e. an MTP, DSP etc that could be introducing an issue on some calls) - where are the problematic calls traversing etc.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">When you have some more info on the paths - you can always look at the old Wiresharks.. rotating capture buffers.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Unless you have a nice network with some built in capture capability - like Meraki!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Cheers,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Tim<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Fri, 24 Jun 2022 at 14:29, James Andrewartha <<a href="mailto:jandrewartha@ccgs.wa.edu.au" target="_blank">jandrewartha@ccgs.wa.edu.au</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">Hi voipers,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">We have persistent reports of garbled voice quality (like when a mobile phone call glitches briefly) in one location on our campus,
of course never when I’m there to observe it and get a capture. One thing I’ve noticed is the 802.1p priority isn’t being set on the packets. The setup is CUCM on VMware connected to a portgroup of VLAN 101. There’s also a 4331 which handles SIP termination
on VLAN101. These are then routed by a (HSRP redundant pair of) 2921 to VLAN100 where the phones live. The 2921 doesn’t map the DSCP set by CUCM or 4331 to an 802.1p priority after routing, and for the life of me I can’t work out how to do it. I can’t work
out how to do it on the 4331 either, I could move routing of the subnets to it but I was waiting until I got the second one which I ordered months ago arrives.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">Googling is useless, I end up with results for different variants of IOS or switches, none of which work on IOS 15 on the 2921. Surely
it’s not that hard to just say “trust DSCP and map it to 802.1p”?</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif">Thanks,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:Verdana,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">--
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">James Andrewartha</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Network & Projects Engineer</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Christ Church Grammar School</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Claremont, Western Australia</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Ph. (08) 9442 1757</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Courier New"">Mob. 0424 160 877</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
cisco-voip mailing list<br>
<a href="mailto:cisco-voip@puck.nether.net" target="_blank">cisco-voip@puck.nether.net</a><br>
<a href="https://puck.nether.net/mailman/listinfo/cisco-voip" target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a></p></blockquote></div></div></div></div></blockquote></div><div dir="ltr" class="gmail_signature"><div dir="ltr"><div style="margin:0px;padding:0px;border:0px;font-stretch:inherit;font-size:12pt;line-height:inherit;font-family:Calibri,Arial,Helvetica,sans-serif;vertical-align:baseline;color:rgb(0,0,0)"></div></div></div></div>