[Openstack] Error during live migration

Razique Mahroua razique.mahroua at gmail.com
Thu Aug 15 07:47:40 UTC 2013


I was so convinced we resolved your issue Guilherme
but maybe it was someone else :)
the error simply means the user "nova" from the first CN cannot connect as the user "nova" to the second CN it needs to send the image to
Here are few checks : 
#1 - Exchange all nova's public keys between all compute nodes
#2 - Make sure the connection with/ from that user is allowed (that you don't have directive such as "AllowUsers" in /etc/ssh/sshd_config)
#3 - Make sure in /etc/passwd, the nova user has a shell


Razique Mahroua - Nuage & Co
razique.mahroua at gmail.com
Tel : +33 9 72 37 94 15



Le 15 août 2013 à 09:39, james <jshaw90 at gmail.com> a écrit :

> Pigging backing on the answer before me but yes, i had the same problem. Following the setup of ssh keys for the user 'Nova' between nodes will resolve the problem for you.
> 
> 
> Kind Regards,
> 
> James Shaw
> 
> 
> On 15 August 2013 02:10, Md. Maruful Hassan <mrf.mnm at gmail.com> wrote:
> I have not done the live-migration setup before but looking at the log it seems like you don't have ssh setup right between your compute nodes.
> 
> 013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.52 mkdir -p /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit code: 255
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Stdout: ''
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Stderr: 'Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n'
> 
> Setup ssh-key based passwordless access for user 'nova' (or whatever user nova process is running as ) between nodes. Then try again. 
> 
> 
> 
> --
> m at ruf
> 
> 
> On Thu, Aug 15, 2013 at 4:52 AM, Guilherme Russi <luisguilherme.cr at gmail.com> wrote:
> Hello guys,
> 
>  I've been facing an error with live migration since last week and I wonder why I can't migrate my instances. I'm using the Grizzly release and I got this error in my both compute nodes:
> 
> 
> 2013-08-14 15:49:47.788 ERROR nova.compute.manager [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: e04986a1-8f56-4dd9-9995-419e05430da3] Unexpected error while running command.
> Stderr: 'Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n'. Setting instance vm_state to ERROR
> 2013-08-14 15:49:48.294 ERROR nova.openstack.common.rpc.amqp [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling
> 
> 
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     rval = self.proxy.dispatch(ctxt, version, method, **args)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     return getattr(proxyobj, method)(ctxt, **kwargs)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     temp_level, payload)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     pass
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     block_device_info)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     inst_base_resize)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     utils.execute('ssh', dest, 'mkdir', '-p', inst_base)
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp     cmd=' '.join(cmd))
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.52 mkdir -p /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit code: 255
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Stdout: ''
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Stderr: 'Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n'
> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
> 
> Can anybody help me?
> 
> Regards.
> 
> Guilherme.
> 
> 
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> 
> 
> 
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> 
> 
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/46dda2a8/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/46dda2a8/attachment.jpg>


More information about the Openstack mailing list