[Openstack] Error during live migration

Guilherme Russi luisguilherme.cr at gmail.com
Thu Aug 15 14:21:16 UTC 2013


Right, I've done all again, and now things starting change but, I'm getting
this now:

2013-08-15 11:18:05.705 ERROR nova.compute.manager
[req-dbbe3889-acd0-4c99-b22d-68c7005901a3 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
53f0a8ff-cd3b-4ddc-be9c-76655e8b8354] Unexpected error while running
command.
Stderr: 'Bad owner or permissions on /var/lib/nova/.ssh/config\r\n'.
Setting instance vm_state to ERROR
2013-08-15 11:18:06.198 ERROR nova.openstack.common.rpc.amqp
[req-dbbe3889-acd0-4c99-b22d-68c7005901a3 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling


My config file content:

StrictHostKeyChecking no

and its properties:

-rw-rw----  1 nova nova  25 Ago 15 10:39 config

What Am I missing?

Regards.

Guilherme.




2013/8/15 Guilherme Russi <luisguilherme.cr at gmail.com>

> Ok, let me write down what I've done:
>
> #1 - Logged with nova's user at my first CN and generate a key with
> ssh-keygen -t dsa at the /var/lib/nova/.ssh location;
> #2 - Copied the id_dsa.pub from my first CN to my second CN at the
> /var/lib/nova/.ssh location;
> #3 - I'm sure I don't have te directive "AllowUsers" in my
> /etc/ssh/sshd_config
> #4 - At my two CN I have inside my /etc/passwd,
> nova:x:123:131::/var/lib/nova:/bin/sh
>
> Another questions, do* *I need to copy the .pub key to my controller node
> too? And, do I need to create one key to each compute node and copy the
> .pub to another one, or just create one key and copy the .pub?
>
> I'm making some mass with the key's thing :(
>
> Thank you all.
>
> Guilherme.
>
>
> 2013/8/15 Razique Mahroua <razique.mahroua at gmail.com>
>
>> I was so convinced we resolved your issue Guilherme
>> but maybe it was someone else :)
>> the error simply means the user "nova" from the first CN cannot connect
>> as the user "nova" to the second CN it needs to send the image to
>> Here are few checks :
>> #1 - Exchange all nova's public keys between all compute nodes
>> #2 - Make sure the connection with/ from that user is allowed (that you
>> don't have directive such as "AllowUsers" in /etc/ssh/sshd_config)
>> #3 - Make sure in /etc/passwd, the nova user has a shell
>>
>>
>> *Razique Mahroua** - **Nuage & Co*
>> razique.mahroua at gmail.com
>> Tel : +33 9 72 37 94 15
>>
>>
>> Le 15 août 2013 à 09:39, james <jshaw90 at gmail.com> a écrit :
>>
>> Pigging backing on the answer before me but yes, i had the same problem.
>> Following the setup of ssh keys for the user 'Nova' between nodes will
>> resolve the problem for you.
>>
>>
>> Kind Regards,
>>
>> James Shaw
>>
>>
>> On 15 August 2013 02:10, Md. Maruful Hassan <mrf.mnm at gmail.com> wrote:
>>
>>> I have not done the live-migration setup before but looking at the log
>>> it seems like you don't have ssh setup right between your compute nodes.
>>>
>>> 013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Command:
>>> * ssh 10.3.77.52 mkdir -p
>>> /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3*
>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit
>>> code: 255
>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>> Stdout: ''
>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp S*tderr:
>>> 'Permission denied, please try again.\r\nPermission denied, please try
>>> again.\r\nPermission denied (publickey,password).\r\n'*
>>> *
>>> *
>>> Setup ssh-key based passwordless access for user 'nova' (or whatever
>>> user nova process is running as ) between nodes. Then try again.
>>>
>>>
>>>
>>> --
>>> m at ruf
>>>
>>>
>>> On Thu, Aug 15, 2013 at 4:52 AM, Guilherme Russi <
>>> luisguilherme.cr at gmail.com> wrote:
>>>
>>>> Hello guys,
>>>>
>>>>  I've been facing an error with live migration since last week and I
>>>> wonder why I can't migrate my instances. I'm using the Grizzly release and
>>>> I got this error in my both compute nodes:
>>>>
>>>>
>>>> 2013-08-14 15:49:47.788 ERROR nova.compute.manager
>>>> [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2
>>>> d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
>>>> e04986a1-8f56-4dd9-9995-419e05430da3] Unexpected error while running
>>>> command.
>>>> Stderr: 'Permission denied, please try again.\r\nPermission denied,
>>>> please try again.\r\nPermission denied (publickey,password).\r\n'. Setting
>>>> instance vm_state to ERROR
>>>> 2013-08-14 15:49:48.294 ERROR nova.openstack.common.rpc.amqp
>>>> [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2
>>>> d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling
>>>>
>>>>
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Traceback (most recent call last):
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py",
>>>> line 430, in _process_data
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> rval = self.proxy.dispatch(ctxt, version, method, **args)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File
>>>> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py",
>>>> line 133, in dispatch
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> return getattr(proxyobj, method)(ctxt, **kwargs)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in
>>>> wrapped
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> temp_level, payload)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> self.gen.next()
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in
>>>> wrapped
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> return f(self, context, *args, **kw)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209,
>>>> in decorated_function
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> pass
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> self.gen.next()
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195,
>>>> in decorated_function
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> return function(self, context, *args, **kwargs)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260,
>>>> in decorated_function
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> function(self, context, *args, **kwargs)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237,
>>>> in decorated_function
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> e, sys.exc_info())
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> self.gen.next()
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224,
>>>> in decorated_function
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> return function(self, context, *args, **kwargs)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354,
>>>> in resize_instance
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> block_device_info)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>> 3467, in migrate_disk_and_power_off
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> inst_base_resize)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> self.gen.next()
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>> 3444, in migrate_disk_and_power_off
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> utils.execute('ssh', dest, 'mkdir', '-p', inst_base)
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> cmd=' '.join(cmd))
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> ProcessExecutionError: Unexpected error while running command.
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Command: ssh 10.3.77.52 mkdir -p
>>>> /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit
>>>> code: 255
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Stdout: ''
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Stderr: 'Permission denied, please try again.\r\nPermission denied, please
>>>> try again.\r\nPermission denied (publickey,password).\r\n'
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>
>>>> Can anybody help me?
>>>>
>>>> Regards.
>>>>
>>>> Guilherme.
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list:
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>> Post to     : openstack at lists.openstack.org
>>>> Unsubscribe :
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to     : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/666ab9a1/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/666ab9a1/attachment.jpg>


More information about the Openstack mailing list