[Openstack] Fail to reboot VM with Nova + Quantum/OVS

Dan Wendlandt dan at nicira.com
Thu Mar 1 17:41:20 UTC 2012


Hi Doude,

At a glance, it seems that unplug() being called twice, with the second
call failing because the first call successfully unplugged the vif already.


The unplug() action on the bridge does nothing, so there's no harm in
calling it twice, which may explain why this is only seen with OVS.

A quick workaround would be to remove the "raise" line at the end of the
unplug() method for LibvirtOpenVswitchDriver, in which case you will see
the log message still, but it should not disrupt the reboot (this is
probably better behavior as well, regardless of the true cause of the bug).


We'll look into this.  I created this bug to track discussion on the fix:
https://bugs.launchpad.net/nova/+bug/944168

Dan


On Thu, Mar 1, 2012 at 9:18 AM, Doude <doudouyam at gmail.com> wrote:

> When I try reboot a VM, the nova-compute fails and the daemon stop.
> It fails on unpluging VIF interface of the rebooted VM. I use Nova
> with Quantum and OVS.
>
> 2012-03-01 18:12:31 DEBUG nova.rpc.common [-] Making asynchronous call
> on network ... from (pid=21485) multicall
> /usr/local/src/nova/nova/rpc/amqp.py:318
> 2012-03-01 18:12:31 DEBUG nova.rpc.common [-] MSG_ID is
> b77f0f284af045f396b90fddd16f724e from (pid=21485) multicall
> /usr/local/src/nova/nova/rpc/amqp.py:321
> 2012-03-01 18:12:33 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap ovs-vsctl del-port br-int tap9f5ef54c-38 from
> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:33 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap ip link delete tap9f5ef54c-38 from (pid=21485)
> execute /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap ovs-vsctl del-port br-int tap285c8465-dd from
> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap ip link delete tap285c8465-dd from (pid=21485)
> execute /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Attempting to grab semaphore
> "iptables" for method "apply"... from (pid=21485) inner
> /usr/local/src/nova/nova/utils.py:824
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Got semaphore "iptables" for
> method "apply"... from (pid=21485) inner
> /usr/local/src/nova/nova/utils.py:828
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Attempting to grab file lock
> "iptables" for method "apply"... from (pid=21485) inner
> /usr/local/src/nova/nova/utils.py:832
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Got file lock "iptables" for
> method "apply"... from (pid=21485) inner
> /usr/local/src/nova/nova/utils.py:839
> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap iptables-save -t filter from (pid=21485) execute
> /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:35 INFO nova.virt.libvirt.connection [-] [instance:
> 9300df8d-1a47-40ce-b90e-28f1a84f064d] Instance destroyed successfully.
> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap iptables-restore from (pid=21485) execute
> /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap iptables-save -t nat from (pid=21485) execute
> /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap iptables-restore from (pid=21485) execute
> /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:35 DEBUG nova.network.linux_net [-]
> IPTablesManager.apply completed with success from (pid=21485) apply
> /usr/local/src/nova/nova/network/linux_net.py:336
> 2012-03-01 18:12:37 DEBUG nova.utils [-] Running cmd (subprocess):
> sudo nova-rootwrap ovs-vsctl del-port br-int tap9f5ef54c-38 from
> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
> 2012-03-01 18:12:37 DEBUG nova.utils [-] Result was 1 from (pid=21485)
> execute /usr/local/src/nova/nova/utils.py:224
> 2012-03-01 18:12:37 WARNING nova.virt.libvirt.vif [-] Failed while
> unplugging vif of instance 'instance-00000002'
>
> Do you have this problem ?
>
> Regards,
> Doude.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>



-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~
Dan Wendlandt
Nicira Networks: www.nicira.com
twitter: danwendlandt
~~~~~~~~~~~~~~~~~~~~~~~~~~~
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20120301/dc238312/attachment.html>


More information about the Openstack mailing list