[Openstack] Issue in KVM block migration

Kei.masumoto kei.masumoto at gmail.com
Tue Apr 17 23:45:50 UTC 2012


/etc/hosts must be exactly same between src and dest compute node. that 
is your problem.
Kei

(2012/04/13 21:46), Gurjar, Unmesh wrote:
>
> The user running the compute server is a member of libvirt group.
>
> I tried the migration via virsh, however that too returns the same 
> result. I get similar logs in the qemu log file.
>
> Thanks & Regards,
>
> *Unmesh Gurjar*| Lead Engineer | Vertex Software Private Ltd.| *w.* 
> +91.20.6604.1500 x 379 | *m.* +91.982.324.7631 
> |unmesh.gurjar at nttdata.com <mailto:unmesh.gurjar at nttdata.com> | Follow 
> us on Twitter at NTTDATAAmericas**
>
> *From:*Razique Mahroua [mailto:razique.mahroua at gmail.com]
> *Sent:* Friday, April 13, 2012 2:22 PM
> *To:* Gurjar, Unmesh
> *Cc:* openstack at lists.launchpad.net
> *Subject:* Re: [Openstack] Issue in KVM block migration
>
> Hi,
>
> sorry for the late reply.
>
> Does the user nova belong to the libvirt group ?
>
> Can you try manually the migration via virsh ?
>
> $ virsh --migrate --live --copy-storage-all $domain 
> qemu+tcp://user@server/sytem
>
> thanks
>
> *Nuage & Co - Razique Mahroua *
>
> razique.mahroua at gmail.com <mailto:razique.mahroua at gmail.com>
>
>
> Le 11 avr. 2012 à 16:44, Gurjar, Unmesh a écrit :
>
>
>
> Thanks Razique for taking up this one.
>
> Libvirt version on both Compute hosts:
>
> $ libvirtd --version
>
> libvirtd (libvirt) 0.9.2
>
> $ virsh --version
>
> 0.9.2
>
> Here are my libvirtd.conf details:
>
> listen_tls = 0
>
> listen_tcp = 1
>
> unix_sock_group = "libvirtd"
>
> unix_sock_rw_perms = "0770"
>
> auth_unix_ro = "none"
>
> auth_unix_rw = "none"
>
> auth_tcp = "none"
>
> Thanks & Regards,
>
> *Unmesh Gurjar*| Lead Engineer | Vertex Software Private Ltd. 
> |*w.*+91.20.6604.1500 x 379 
> |*m.*+91.982.324.7631|unmesh.gurjar at nttdata.com 
> <mailto:unmesh.gurjar at nttdata.com>|Follow us on Twitter at NTTDATAAmericas
>
> *From:*Razique Mahroua [mailto:razique.mahroua at gmail.com] 
> <mailto:[mailto:razique.mahroua at gmail.com]>
> *Sent:*Wednesday, April 11, 2012 7:33 PM
> *To:*Gurjar, Unmesh
> *Cc:*openstack at lists.launchpad.net <mailto:openstack at lists.launchpad.net>
> *Subject:*Re: [Openstack] Issue in KVM block migration
>
> Hi,
>
> it looks like the user under which libvirt is running doesn't have the 
> rights to manage server's IF.
>
> What version of libvirt are you using ?
>
> Can I see the file /etc/libvirt/libvirtd.com ? (cat 
> /etc/libvirt/libvirtd.conf | grep -v -e "#" -e "^$
>
> Raz
>
> *Nuage & Co - Razique Mahroua *
>
> razique.mahroua at gmail.com <mailto:razique.mahroua at gmail.com>
>
>
> <image001.jpg>
>
> Le 11 avr. 2012 à 14:48, Gurjar, Unmesh a écrit :
>
>
>
>
> Hi,
>
> I have setup two Compute nodes (using Openstack master branch) and 
> configured libvirt for block migration (by  following step #1 and #4 
> mentionedhere 
> <http://docs.openstack.org/diablo/openstack-compute/admin/content/configuring-live-migrations.html>). 
> In addition, I have also disabled apparmor for libvirtd profile and 
> have an entry in '/etc/hosts' of both the Compute hosts.
>
> From both the Compute hosts, I am able to connect and fetch the list 
> of running instances on the other host (using the hostname), as follows:
>
> virsh # connectqemu+tcp://ubuntu-dev-001/system
>
> virsh # list
>
> The issue is block migrating an instance between these hosts fails 
> with the following error in the source Compute host console:
>
> libvir: QEMU error : operation failed: migration job: unexpectedly failed
>
> 2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous call 
> on network ... from (pid=18487) multicall 
> /opt/stack/nova/nova/rpc/amqp.py:318
>
> 2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] MSG_ID is 
> 8d91158236ae4de0bd8b89533f060892 from (pid=18487) multicall 
> /opt/stack/nova/nova/rpc/amqp.py:321
>
> 2012-04-11 03:15:54 DEBUG nova.rpc.amqp [-] Making asynchronous cast 
> on compute.ubuntu-dev-001... from (pid=18487) cast 
> /opt/stack/nova/nova/rpc/amqp.py:343
>
> Traceback (most recent call last):
>
>   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 
> 97, in wait
>
>     readers.get(fileno, noop).cb(fileno)
>
>   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", 
> line 192, in main
>
>     result = function(*args, **kwargs)
>
>   File "/opt/stack/nova/nova/virt/libvirt/connection.py", line 2179, 
> in _live_migration
>
>     recover_method(ctxt, instance_ref, dest, block_migration)
>
>   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>
>     self.gen.next()
>
>   File "/opt/stack/nova/nova/virt/libvirt/connection.py", line 2175, 
> in _live_migration
>
>     FLAGS.live_migration_bandwidth)
>
>   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 689, in 
> migrateToURI
>
>     if ret == -1: raise libvirtError ('virDomainMigrateToURI() 
> failed', dom=self)
>
> libvirtError: operation failed: migration job: unexpectedly failed
>
> Removing descriptor: 12
>
> I find the following in the qemu log file 
> (/var/log/libvirt/qemu/instance-00000003.log ) on the destination 
> Compute host:
>
> 2012-04-11 04:14:25.971: starting up
>
> LC_ALL=C 
> PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin 
> QEMU_AUDIO_DRV=none /usr/bin/kvm -S -M pc-0.14 -enable-kvm -m 512 -smp 
> 1,sockets=1,cores=1,threads=1 -name instance-00000003 -uuid 
> f58d5f32-6d55-43fb-89ed-c33ebf72d1ed -nodefconfig -nodefaults -chardev 
> socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-00000003.monitor,server,nowait 
> -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot 
> c -kernel /opt/stack/nova/instances/instance-00000003/kernel -initrd 
> /opt/stack/nova/instances/instance-00000003/ramdisk -append 
> root=/dev/vda console=ttyS0 -drive 
> file=/opt/stack/nova/instances/instance-00000003/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none 
> -device 
> virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0 
> -netdev tap,ifname=tapfcfa2a6c-35,script=,id=hostnet0 -device 
> rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:7d:32:27,bus=pci.0,addr=0x3 
> -chardev 
> file,id=charserial0,path=/opt/stack/nova/instances/instance-00000003/console.log 
> -device isa-serial,chardev=charserial0,id=serial0 -chardev 
> pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 
> -usb -device usb-tablet,id=input0 -vnc 127.0.0.1:0 -k en-us -vga 
> cirrus -incoming tcp:0.0.0.0:49166 -device 
> virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
>
> Domain id=15 is tainted: high-privileges
>
> Domain id=15 is tainted: shell-scripts
>
> char device redirected to /dev/pts/17
>
> 2012-04-11 04:14:26.406: shutting down
>
> can't delete tapfcfa2a6c-35 from eth1: Operation not supported
>
> SIOCSIFADDR: Permission denied
>
> SIOCSIFFLAGS: Permission denied
>
> SIOCSIFFLAGS: Permission denied
>
> /etc/qemu-ifdown: could not launch network script
>
> Would be great if someone can point anything that I am missing here or 
> any configuration changes required to resolve this issue.
>
> Thanks & Regards,
>
> *Unmesh Gurjar*| Lead Engineer |Vertex Software Private Ltd. 
> |*w.*+91.20.6604.1500 x 379 |*m.*+91.982.324.7631 
> |unmesh.gurjar at nttdata.com <mailto:unmesh.gurjar at nttdata.com>|Follow 
> us on Twitter at NTTDATAAmericas
>
>
> ______________________________________________________________________
> Disclaimer:This email and any attachments are sent in strictest 
> confidence for the sole use of the addressee and may contain legally 
> privileged, confidential, and proprietary data. If you are not the 
> intended recipient, please advise the sender by replying promptly to 
> this email and then delete and destroy this email and any attachments 
> without any further use, copying or forwarding
> _______________________________________________
> Mailing list:https://launchpad.net/~openstack 
> <https://launchpad.net/%7Eopenstack>
> Post to     :openstack at lists.launchpad.net 
> <mailto:openstack at lists.launchpad.net>
> Unsubscribe :https://launchpad.net/~openstack 
> <https://launchpad.net/%7Eopenstack>
> More help   :https://help.launchpad.net/ListHelp
>
>
> ______________________________________________________________________
> Disclaimer:This email and any attachments are sent in strictest 
> confidence for the sole use of the addressee and may contain legally 
> privileged, confidential, and proprietary data. If you are not the 
> intended recipient, please advise the sender by replying promptly to 
> this email and then delete and destroy this email and any attachments 
> without any further use, copying or forwarding
>
>
> ______________________________________________________________________
> Disclaimer:This email and any attachments are sent in strictest 
> confidence for the sole use of the addressee and may contain legally 
> privileged, confidential, and proprietary data. If you are not the 
> intended recipient, please advise the sender by replying promptly to 
> this email and then delete and destroy this email and any attachments 
> without any further use, copying or forwarding
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20120418/1d029ec2/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20120418/1d029ec2/attachment.jpe>


More information about the Openstack mailing list