[openstack-dev] FW: [Bug 1257788] Re: nova-network doesn't handle large amount of concurrent booting instances well

Joe Gordon joe.gordon0 at gmail.com
Tue Dec 10 22:05:49 UTC 2013


On Dec 10, 2013 7:38 PM, "Joshua Harlow" <harlowja at yahoo-inc.com> wrote:
>
> Yup, IMHO this is where the rally[1] project, and others that attempt to
> push the boundaries are really helping openstack become much better around
> these types of issues. At yahoo! in a short-time it will not be that
> uncommon to boot 100+ VMs concurrently (traffic spikes, other random QA
> testing that requires more than 10 instances...). So the earlier these
> issues get solved then the better it will be for everyone (and they likely
> are not simple issues to solve, sadly).

I don't think this issue in particular is very hard to fix for
nova-networking but I don't know enough about neutron to speak for it as
well. I included a possible route to fixing this in the bug itself.

>
> [1] https://wiki.openstack.org/wiki/Rally
>
> On 12/10/13 10:17 AM, "Edgar Magana" <emagana at plumgrid.com> wrote:
>
> >FYI. Concurrent calls are a problem all around in OpenStack!
> >
> >Edgar
> >
> >On 12/10/13 8:47 AM, "Abhishek Chanda" <abhishek at cloudscaling.com> wrote:
> >
> >>** Changed in: nova
> >>       Status: New => Triaged
> >>
> >>--
> >>You received this bug notification because you are subscribed to
> >>neutron.
> >>https://bugs.launchpad.net/bugs/1257788
> >>
> >>Title:
> >>  nova-network doesn't handle large amount of concurrent booting
> >>  instances well
> >>
> >>Status in OpenStack Neutron (virtual network service):
> >>  Triaged
> >>Status in OpenStack Compute (Nova):
> >>  Triaged
> >>
> >>Bug description:
> >>  As seen by the large-ops test nova-network has trouble booting 150 VMs
> >>  concurrently. Part of the problem is that setting up the network for
> >>  each instance is relatively expensive with many locks and root-wrapped
> >>  calls. Both of which significantly hurt performance.  One possible fix
> >>  would be to do more bulk network operations when possible, so instead
> >>  of 100 separate calls to a root-wrapped tool call it once.
> >>
> >>To manage notifications about this bug go to:
> >>https://bugs.launchpad.net/neutron/+bug/1257788/+subscriptions
> >
> >
> >
> >_______________________________________________
> >OpenStack-dev mailing list
> >OpenStack-dev at lists.openstack.org
> >http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20131210/16728e7d/attachment.html>


More information about the OpenStack-dev mailing list