[openstack-dev] [neutron] possible race condition with nova instance and neutron ports

Sławomir Kapłoński slawek at kaplonski.pl
Wed Aug 9 07:23:48 UTC 2017


Hello,

Do You have configured in nova-compute: vif_plugging_timeout and vif_plugging_is_fatal options?
With those options nova should pause VM until port will be set to ACTIVE in Neutron.

-- 
Slawek

> Wiadomość napisana przez Saverio Proto <saverio.proto at switch.ch> w dniu 09.08.2017, o godz. 09:06:
> 
> Hello,
> 
> I see this in Openstack Newton
> 
> I start 200 instances with a oneliner.
> 
> openstack server create \
> --image "Ubuntu Xenial 16.04 (SWITCHengines)" \
> --flavor c1.small \
> --network demonetwork \
> --user-data cloud-init.txt \
> --key-name macsp \
> --min 200 \
> --max 200 test
> 
> When I do this I see a problem where all the instances boot and are in
> Running state, before all neutron ports are ACTIVE.
> 
> I see with `openstack port list` neutron ports still in BUILD state. It
> takes a longer time to make them all ACTIVE, the instances that use
> those ports boot up much faster.
> 
> In rabbitmq queues I see growing the dhcp_agent.<hostname> queues.
> 
> At the very end all neutron ports will be ACTIVE and rabbitmq queues
> back to normal. But many VMs failed getting an address via DHCP because
> at the time they were trying the dnsmasq process did not have a
> corresponding entry for the instance in the `host` file. Unfortunately
> the instance gives up trying obtaining an address via DHCP after 5 minutes.
> 
> When I start 200 instances I always end up with 15 to 30 instances
> without IP address. I check carefully using cloud-init: I make them
> phone-home to check if they are alive.
> 
> Should I open a bug for this ?? It looks like a race condition where
> nova boots the instance before the neutron port is really ready.
> 
> thank you for your feedback.
> 
> Saverio
> 
> 
> 
> 
> 
> -- 
> SWITCH
> Saverio Proto, Peta Solutions
> Werdstrasse 2, P.O. Box, 8021 Zurich, Switzerland
> phone +41 44 268 15 15, direct +41 44 268 1573
> saverio.proto at switch.ch, http://www.switch.ch
> 
> http://www.switch.ch/stories
> 
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




More information about the OpenStack-dev mailing list