[Openstack-operators] improve perfomance Neutron VXLAN
Sławek Kapłoński
slawek at kaplonski.pl
Thu Jan 22 21:36:25 UTC 2015
As I wrote earlier, for me it is best to have 9000 on hosts and 8950 on
instances. Then I have full speed between instances. With lower mtu on
instances I have about 2-2.5 Gbps and I saw that vhost-net process on
host is using 100 of 1 cpu core. I'm using libvirt with kvm - maybe You
are using something else and it will be different on Your hosts.
Slawek Kaplonski
W dniu 22.01.2015 o 20:45, Pedro Sousa pisze:
> Hi Slawek,
>
> I've tried several options but that one that seems to work better is MTU
> 1450 on VM and MTU 1600 on the host. With MTU 1400 on the VM I would get
> freezes and timeouts.
>
> Still I get about 2.2Gbit/Sec while in the host I get 9 Gbit/Sec, do you
> think is normal?
>
> Thanks,
> Pedro Sousa
>
>
>
>
> On Thu, Jan 22, 2015 at 7:32 PM, Sławek Kapłoński <slawek at kaplonski.pl
> <mailto:slawek at kaplonski.pl>> wrote:
>
> Hello,
>
> In dnsmasq file in neutron will be ok. It will then force option 26
> on vm.
> You can also manually change it on vms to tests.
>
> Slawek Kaplonski
>
> W dniu 22.01.2015 o 17:06, Pedro Sousa pisze:
>
> Hi Slawek,
>
> I'll test this, did you change the mtu on dnsmasq file in
> /etc/neutron/?
> Or do you need to change on other places too?
>
> Thanks,
> Pedro Sousa
>
> On Wed, Jan 21, 2015 at 4:26 PM, Sławek Kapłoński
> <slawek at kaplonski.pl <mailto:slawek at kaplonski.pl>
> <mailto:slawek at kaplonski.pl <mailto:slawek at kaplonski.pl>>> wrote:
>
> I have similar and I also got something like 2-2,5Gbps
> between vms.
> When I
> change it to 8950 on vms (so in neutron conf) (50 less then on
> hosts) then it
> is much better.
> You can check that probably when You make test between vms
> on host
> there is
> process called "vhost-net" (or something like that) and it
> uses 100%
> of one cpu
> core and that is imho bottleneck
>
> Slawek Kaplonski
>
> On Wed, Jan 21, 2015 at 04:12:02PM +0000, Pedro Sousa wrote:
> > Hi Slawek,
> >
> > I have dhcp-option-force=26,1400 in neutron-dnsmasq.conf and
> MTU=9000 on
> > network-interfaces in the operating system.
> >
> > Do I need to change somewhere else?
> >
> > Thanks,
> > Pedro Sousa
> >
> > On Wed, Jan 21, 2015 at 4:07 PM, Sławek Kapłoński
> <slawek at kaplonski.pl <mailto:slawek at kaplonski.pl>
> <mailto:slawek at kaplonski.pl <mailto:slawek at kaplonski.pl>>>
>
> > wrote:
> >
> > > Hello,
> > >
> > > Try to set bigger jumbo framse on hosts and vms. For
> example on
> hosts You
> > > can
> > > set 9000 and then 8950 and check then. It helps me
> with similar
> problem.
> > >
> > > Slawek Kaplonski
> > >
> > > On Wed, Jan 21, 2015 at 03:22:50PM +0000, Pedro Sousa
> wrote:
> > > > Hi all,
> > > >
> > > > is there a way to improve network performance on my
> instances
> with
> > > VXLAN? I
> > > > changed the MTU on physical interfaces to 1600, still
> performance it's
> > > > lower than in baremetal hosts:
> > > >
> > > > *On Instance:*
> > > >
> > > > [root at vms6-149a71e8-1f2a-4d6e-__bba4-e70dfa42b289
> ~]# iperf3 -s
> > > >
> ------------------------------__-----------------------------
> > > > Server listening on 5201
> > > >
> ------------------------------__-----------------------------
> > > > Accepted connection from 10.0.66.35, port 42900
> > > > [ 5] local 10.0.66.38 port 5201 connected to
> 10.0.66.35 port
> 42901
> > > > [ ID] Interval Transfer Bandwidth
> > > > [ 5] 0.00-1.00 sec 189 MBytes 1.59 Gbits/sec
> > > > [ 5] 1.00-2.00 sec 245 MBytes 2.06 Gbits/sec
> > > > [ 5] 2.00-3.00 sec 213 MBytes 1.78 Gbits/sec
> > > > [ 5] 3.00-4.00 sec 227 MBytes 1.91 Gbits/sec
> > > > [ 5] 4.00-5.00 sec 235 MBytes 1.97 Gbits/sec
> > > > [ 5] 5.00-6.00 sec 235 MBytes 1.97 Gbits/sec
> > > > [ 5] 6.00-7.00 sec 234 MBytes 1.96 Gbits/sec
> > > > [ 5] 7.00-8.00 sec 235 MBytes 1.97 Gbits/sec
> > > > [ 5] 8.00-9.00 sec 244 MBytes 2.05 Gbits/sec
> > > > [ 5] 9.00-10.00 sec 234 MBytes 1.97 Gbits/sec
> > > > [ 5] 10.00-10.04 sec 9.30 MBytes 1.97 Gbits/sec
> > > > - - - - - - - - - - - - - - - - - - - - - - - - -
> > > > [ ID] Interval Transfer Bandwidth
> Retr
> > > > [ 5] 0.00-10.04 sec 2.25 GBytes 1.92
> Gbits/sec 43
> > > sender
> > > > [ 5] 0.00-10.04 sec 2.25 GBytes 1.92 Gbits/sec
> > > > receiver
> > > >
> > > >
> > > > *On baremetal:*
> > > > iperf3 -s
> > > > warning: this system does not seem to support IPv6 -
> trying IPv4
> > > >
> ------------------------------__-----------------------------
> > > > Server listening on 5201
> > > >
> ------------------------------__-----------------------------
> > > > Accepted connection from 172.16.21.4, port 51408
> > > > [ 5] local 172.16.21.5 port 5201 connected to
> 172.16.21.4
> port 51409
> > > > [ ID] Interval Transfer Bandwidth
> > > > [ 5] 0.00-1.00 sec 1.02 GBytes 8.76 Gbits/sec
> > > > [ 5] 1.00-2.00 sec 1.07 GBytes 9.23 Gbits/sec
> > > > [ 5] 2.00-3.00 sec 1.08 GBytes 9.29 Gbits/sec
> > > > [ 5] 3.00-4.00 sec 1.08 GBytes 9.27 Gbits/sec
> > > > [ 5] 4.00-5.00 sec 1.08 GBytes 9.27 Gbits/sec
> > > > [ 5] 5.00-6.00 sec 1.08 GBytes 9.28 Gbits/sec
> > > > [ 5] 6.00-7.00 sec 1.08 GBytes 9.28 Gbits/sec
> > > > [ 5] 7.00-8.00 sec 1.08 GBytes 9.29 Gbits/sec
> > > > [ 5] 8.00-9.00 sec 1.08 GBytes 9.28 Gbits/sec
> > > > [ 5] 9.00-10.00 sec 1.08 GBytes 9.29 Gbits/sec
> > > > [ 5] 10.00-10.04 sec 42.8 MBytes 9.31 Gbits/sec
> > > > - - - - - - - - - - - - - - - - - - - - - - - - -
> > > > [ ID] Interval Transfer Bandwidth
> Retr
> > > > [ 5] 0.00-10.04 sec 10.8 GBytes 9.23
> Gbits/sec 95
> > > sender
> > > > [ 5] 0.00-10.04 sec 10.8 GBytes 9.22 Gbits/sec
> > > > receiver
> > > >
> > > >
> > > > Thanks,
> > > > Pedro Sousa
> > >
> > > > _________________________________________________
> > > > OpenStack-operators mailing list
> > > > OpenStack-operators at lists.__openstack.org
> <mailto:OpenStack-operators at lists.openstack.org>
> <mailto:OpenStack-operators at __lists.openstack.org
> <mailto:OpenStack-operators at lists.openstack.org>>
> > > >
> http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators
> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators>
> > >
> > >
>
>
>
> --
> Pozdrawiam
> Sławek Kapłonski
> slawek at kaplonski.pl <mailto:slawek at kaplonski.pl>
>
>
--
Pozdrawiam
Sławek Kapłonski
slawek at kaplonski.pl
More information about the OpenStack-operators
mailing list