[c-nsp] Cheap BGP router for ~20k prefixes

[Pshem Kowalczyk]

Further results - It looks like in our current configuration we can't get
past about 2.8Gb/s. We've reached that at about 600k PPS at about 97% of
CPU usage as reported by ESX (might be partially caused our traffic mix -
residential broadband, with a skew towards gaming).  In theory we should be
able to get about 800k PPS, but I suspect that's on basic image (i.e.
without MPLS).

kind regards
Pshem

On Mon, 11 May 2015 at 07:48 Pshem Kowalczyk <pshem.k at gmail.com> wrote:

> Hi,
>
> We've changed the following settings:
>
> 1. Set Latency Sensitve to High  (
> http://www.vmware.com/files/pdf/techpaper/latency-sensitive-perf-vsphere55.pdf
> )
> 2. ethernetX.coalescingScheme = "disable" (for all interfaces, but
> management on the VM)
> 3. Pin down memory and CPU (we run a 4 vCPU setup with 4G of RAM)
>
> That gave us a significant boost in PPS - about 80% increase under the
> same CPU load.
> I have noticed though, that the BFD sessions (there is about 15 of them on
> the device) have flapped a few times in the last 2 weeks, so something
> still requires tuning (the BFD is at 200ms x 3).
> I think the next step will be to try VM-FEX (which can't be ran on the
> same hardware that has already a N1000V, which is a pain). If we find the
> time we'll also test this under KVM.
>
> kind regards
> Pshem
>
>
> On Fri, 8 May 2015 at 19:50 Mark Tinka <mark.tinka at seacom.mu> wrote:
>
>>
>>
>> On 8/May/15 02:17, Robert Hass wrote:
>> > Hi
>> > Can you give some URL to recommended ESXi tweaking ?
>> > Or just write some recommendations here. I'm happy to test CSR on my
>> > configuration
>> > but I also would like apply tweaking tips first.
>>
>> The ESXi tweaking I recall doing was disabling power management to
>> ensure high performance against the hardware.
>>
>> The other bit was building a vSwitch for each port, as the default for
>> ESXi is to put all of the server's ports in the same vSwitch. But this
>> is less of a performance tweak than just good security.
>>
>> It would be nice to hear what else Pshem did to his VM.
>>
>> Mark.
>> _______________________________________________
>> cisco-nsp mailing list  cisco-nsp at puck.nether.net
>> https://puck.nether.net/mailman/listinfo/cisco-nsp
>> archive at http://puck.nether.net/pipermail/cisco-nsp/
>>
>