[Openstack] Live Migration of VMs without shared storage

Remo Mattei remo at italy1.com
Mon Mar 2 17:11:32 UTC 2015


Make sure nova can not root. 

Remo

Inviato da iPhone ()

> Il giorno 02/mar/2015, alle ore 08:21, somshekar kadam <som_kadam at yahoo.co.in> ha scritto:
> 
> Hello John, 
> Thanks for all your valuable inputs. 
> I had missed these configuration. Hope these configs mentioned below will be useful for others who are trying out live migration. 
> 
> 1. force_config_drive = none , otherwise it was giving error. 
> 2. allow_migrate_to_same_host = False
> allow_resize_to_same_host = False
> 
> 3. set proper cpu mode as below 
> cpu_mode = custom
> cpu_model = Nehalem
> virt_type = kvm
> 
> Now I am able to make normal migration working fine, from one host to another. 
> 
> When I try with live migration with block-migration, its failing for not getting proper host key verification ,, 
> I am looking into it. I have shared keys proper I am able to ssh to-fro host nodes using passwordless ssh. 
> no clue right now. 
> 
> error log 
> ------------------
> [[01;31mLive Migration fa       ilure: operation failed: Failed to connect to remote libvirt URI qemu+ssh://stack@celestial8/
> system: Cannot recv data: Host key verifica       tion failed.: Connection reset by peer^[[00m
> 
> 
>       on thread notification^[[00m ^[[00;33mfrom (pid=8953) thread_finished /opt/stack/nova/nova/virt/ libvirt/driver.py:5638^[[00m
> 270370 Traceback (most recent call last):
> 270371   File "/usr/local/lib/python2.7/ dist-packages/eventlet/hubs/ hub.py", line 457, in fire_timers
> 270372     timer()
> 270373   File "/usr/local/lib/python2.7/ dist-packages/eventlet/hubs/ timer.py", line 58, in __call__
> 270374     cb(*args, **kw)
> 270375   File "/usr/local/lib/python2.7/ dist-packages/eventlet/event. py", line 168, in _do_send
> 270376     waiter.switch(result)
> 270377   File "/usr/local/lib/python2.7/ dist-packages/eventlet/ greenthread.py", line 214, in main
> 270378     result = function(*args, **kwargs)
> 270379   File "/opt/stack/nova/nova/virt/ libvirt/driver.py", line 5435, in _live_migration_operation
> 270380     instance=instance)
> 270381   File "/usr/local/lib/python2.7/ dist-packages/oslo_utils/ excutils.py", line 82, in __exit__
> 270382     six.reraise(self.type_, self.value, self.tb)
> 270383   File "/opt/stack/nova/nova/virt/ libvirt/driver.py", line 5404, in _live_migration_operation
> 270384     CONF.libvirt.live_migration_ bandwidth)
> 270385   File "/usr/local/lib/python2.7/ dist-packages/eventlet/tpool. py", line 183, in doit
> 270386     result = proxy_call(self._autowrap, f, *args, **kwargs)
> 270387   File "/usr/local/lib/python2.7/ dist-packages/eventlet/tpool. py", line 141, in proxy_call
> 270388     rv = execute(f, *args, **kwargs)
> 270389   File "/usr/local/lib/python2.7/ dist-packages/eventlet/tpool. py", line 122, in execute
> 270390     six.reraise(c, e, tb)
> 270391   File "/usr/local/lib/python2.7/ dist-packages/eventlet/tpool. py", line 80, in tworker
> 270392     rv = meth(*args, **kwargs)
> 270393   File "/usr/lib/python2.7/dist- packages/libvirt.py", line 1582, in migrateToURI2
> 270394     if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', dom=self)
> 270395 libvirtError: operation failed: Failed to connect to remote libvirt URI qemu+ssh://stack@celestial8/ system: Cannot recv data: Host key v       erification failed.: Connection reset by peer
> @                                                                   
> -----
> 
> 
>  
> 
> Regards 
> Neelu
> 
> 
> On Friday, 27 February 2015 8:09 PM, somshekar kadam <som_kadam at yahoo.co.in> wrote:
> 
> 
> Have done the same configs as mentioned in above thread links for libvirt and nova.conf. 
>  
> 
> Regards 
> Neelu
> 
> 
> On Friday, 27 February 2015 8:07 PM, somshekar kadam <som_kadam at yahoo.co.in> wrote:
> 
> 
> John, your patch is in the mainline now. I have tested it. Not sure what is the thing I am missing
> I have specified cpu model none and even tried setting cpu mode custom also and model kvm64. 
> 
> I am getting below error on live migration. 
> 
> error log
> ----
> Remote error: libvirtError Requested operation is not valid: no CPU model specified [u’Traceback (most recent call last):\n’, u’ File “/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py”, line 142, in _dispatch_and_reply\n executo
> Code
> 500
> Details
> File “/opt/stack/nova/nova/conductor/manager.py”, line 606, in _live_migrate block_migration, disk_over_commit) File “/opt/stack/nova/nova/conductor/tasks/live_migrate.py”, line 194, in execute return task.execute() File “/opt/stack/nova/nova/conductor/tasks/live_migrate.py”, line 62, in execute self._check_requested_destination() File “/opt/stack/nova/nova/conductor/tasks/live_migrate.py”, line 100, in _check_requested_destination self._call_livem_checks_on_host(self.destination) File “/opt/stack/nova/nova/conductor/tasks/live_migrate.py”, line 142, in _call_livem_checks_on_host destination, self.block_migration, self.disk_over_commit) File “/opt/stack/nova/nova/compute/rpcapi.py”, line 391, in check_can_live_migrate_destination disk_over_commit=disk_over_commit) File “/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py”, line 156, in call retry=self.retry) File “/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py”, line 90, in _send timeout=timeout, retry=retry) File “/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py”, line 417, in send retry=retry) File “/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py”, line 408, in _send raise result
> Created
> --------------------
> 
> debug log 
> ---------------
> DEBUG (shell:803) Live migration of instance 477e8963-aadf-4dc7-b26f-
> f6e9332dd33b to host celestial5 failed (HTTP 500) (Request-ID: req-7973edbc-8844-41c5-926a- 9f5e7cee62f2)
> Traceback (most recent call last):
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ shell.py", line 800, in main
>     OpenStackComputeShell().main( argv)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ shell.py", line 730, in main
>     args.func(self.cs, args)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/v1_1/ shell.py", line 3001, in do_live_migration
>     args.disk_over_commit)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/v1_1/ servers.py", line 344, in live_migrate
>     disk_over_commit)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/v1_1/ servers.py", line 1124, in live_migrate
>     'disk_over_commit': disk_over_commit})
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/v1_1/ servers.py", line 1240, in _action
>     return self.api.client.post(url, body=body)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ client.py", line 490, in post
>     return self._cs_request(url, 'POST', **kwargs)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ client.py", line 465, in _cs_request
>     resp, body = self._time_request(url, method, **kwargs)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ client.py", line 439, in _time_request
>     resp, body = self.request(url, method, **kwargs)
>   File "/usr/local/lib/python2.7/ dist-packages/novaclient/ client.py", line 433, in request
>     raise exceptions.from_response(resp, body, url, method)
> ClientException: Live migration of instance 477e8963-aadf-4dc7-b26f- f6e9332dd33b to host celestial5 failed (HTTP 500) (Request-ID: req-7973edbc-8844-41c5-926a- 9f5e7cee62f2)
> ERROR (ClientException): Live migration of instance 477e8963-aadf-4dc7-b26f- f6e9332dd33b to host celestial5 failed (HTTP 500) (Request-ID: req-7973edbc-8844-41c5-926a- 9f5e7cee62f2)
> ----------------------
> 
> Regards 
> Neelu
> 
> 
> On Thursday, 26 February 2015 8:21 PM, John Griffith <john.griffith at solidfire.com> wrote:
> 
> 
> 
> 
> On Thu, Feb 26, 2015 at 7:07 AM, somshekar kadam <som_kadam at yahoo.co.in> wrote:
> First of all thanks for quick reply. 
> Documentation does not mention much about Volume-backed live migration. 
> Is it tested, I mean supported and working. 
> I will try Block live migration as no storage is required. 
>  
> 
> Regards 
> Neelu
> 
> 
> On Thursday, 26 February 2015 7:13 PM, Robert van Leeuwen <Robert.vanLeeuwen at spilgames.com> wrote:
> 
> 
> > Is the Live Migration of VMs even without shared storage supported in Openstack now.
> > If yes is there any document for the same.
> 
> 
> Wel, depends on what you call "supported".
> Yes, it is possible. 
> Will it always work? Probably not until you look at the bugs below.
> They have been fixed recently but they might not be merged with the version you are running: 
> https://bugs.launchpad.net/nova/+bug/1270825
> https://bugs.launchpad.net/nova/+bug/1082414
> 
> There might be more issues but I hit the ones mentioned above.
> Have a look at the docs to configure it:
> http://docs.openstack.org/admin-guide-cloud/content/section_configuring-compute-migrations.html
> 
> Cheers,
> Robert van Leeuwen
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> 
> 
> It's dated and getting the patches backported has proven to take forever, but I did a write up and testing on this a while back [1].  Should still be accurate.
> 
> Thanks,
> John
> 
> [1]: https://griffithscorner.wordpress.com/2014/12/08/openstack-live-migration-with-cinder-backed-instances/
> 
> 
> 
> 
> 
> 
> !DSPAM:1,54f49242220001279316228!
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> 
> 
> !DSPAM:1,54f49242220001279316228!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150302/cfbc4c66/attachment.html>


More information about the Openstack mailing list