[Openstack] Error during live migration
Guilherme Russi
luisguilherme.cr at gmail.com
Thu Aug 15 15:28:00 UTC 2013
And then I execute chmod 755 config but I got the first error again :(
2013-08-15 12:25:11.309 ERROR nova.compute.manager
[req-38d58bbf-370b-4b1d-9d41-b057641e8147 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
b8592ab7-39fe-49db-9bbe-196fa8fc60a1] Unexpected error while running
command.
Stderr: "Warning: Permanently added '10.3.77.52' (ECDSA) to the list of
known hosts.\r\nPermission denied, please try again.\r\nPermission denied,
please try again.\r\nPermission denied (publickey,password).\r\n". Setting
instance vm_state to ERROR
2013-08-15 12:25:11.935 ERROR nova.openstack.common.rpc.amqp
[req-38d58bbf-370b-4b1d-9d41-b057641e8147 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling
I don't know what is going on.
2013/8/15 Guilherme Russi <luisguilherme.cr at gmail.com>
> Right, I've done all again, and now things starting change but, I'm
> getting this now:
>
> 2013-08-15 11:18:05.705 ERROR nova.compute.manager
> [req-dbbe3889-acd0-4c99-b22d-68c7005901a3 c402785616534f2096b34ce132b7d3f2
> d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
> 53f0a8ff-cd3b-4ddc-be9c-76655e8b8354] Unexpected error while running
> command.
> Stderr: 'Bad owner or permissions on /var/lib/nova/.ssh/config\r\n'.
> Setting instance vm_state to ERROR
> 2013-08-15 11:18:06.198 ERROR nova.openstack.common.rpc.amqp
> [req-dbbe3889-acd0-4c99-b22d-68c7005901a3 c402785616534f2096b34ce132b7d3f2
> d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling
>
>
> My config file content:
>
> StrictHostKeyChecking no
>
> and its properties:
>
> -rw-rw---- 1 nova nova 25 Ago 15 10:39 config
>
> What Am I missing?
>
> Regards.
>
> Guilherme.
>
>
>
>
> 2013/8/15 Guilherme Russi <luisguilherme.cr at gmail.com>
>
>> Ok, let me write down what I've done:
>>
>> #1 - Logged with nova's user at my first CN and generate a key with
>> ssh-keygen -t dsa at the /var/lib/nova/.ssh location;
>> #2 - Copied the id_dsa.pub from my first CN to my second CN at the
>> /var/lib/nova/.ssh location;
>> #3 - I'm sure I don't have te directive "AllowUsers" in my
>> /etc/ssh/sshd_config
>> #4 - At my two CN I have inside my /etc/passwd,
>> nova:x:123:131::/var/lib/nova:/bin/sh
>>
>> Another questions, do* *I need to copy the .pub key to my controller
>> node too? And, do I need to create one key to each compute node and copy
>> the .pub to another one, or just create one key and copy the .pub?
>>
>> I'm making some mass with the key's thing :(
>>
>> Thank you all.
>>
>> Guilherme.
>>
>>
>> 2013/8/15 Razique Mahroua <razique.mahroua at gmail.com>
>>
>>> I was so convinced we resolved your issue Guilherme
>>> but maybe it was someone else :)
>>> the error simply means the user "nova" from the first CN cannot connect
>>> as the user "nova" to the second CN it needs to send the image to
>>> Here are few checks :
>>> #1 - Exchange all nova's public keys between all compute nodes
>>> #2 - Make sure the connection with/ from that user is allowed (that you
>>> don't have directive such as "AllowUsers" in /etc/ssh/sshd_config)
>>> #3 - Make sure in /etc/passwd, the nova user has a shell
>>>
>>>
>>> *Razique Mahroua** - **Nuage & Co*
>>> razique.mahroua at gmail.com
>>> Tel : +33 9 72 37 94 15
>>>
>>>
>>> Le 15 août 2013 à 09:39, james <jshaw90 at gmail.com> a écrit :
>>>
>>> Pigging backing on the answer before me but yes, i had the same problem.
>>> Following the setup of ssh keys for the user 'Nova' between nodes will
>>> resolve the problem for you.
>>>
>>>
>>> Kind Regards,
>>>
>>> James Shaw
>>>
>>>
>>> On 15 August 2013 02:10, Md. Maruful Hassan <mrf.mnm at gmail.com> wrote:
>>>
>>>> I have not done the live-migration setup before but looking at the log
>>>> it seems like you don't have ssh setup right between your compute nodes.
>>>>
>>>> 013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Command:* ssh 10.3.77.52 mkdir -p
>>>> /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3*
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit
>>>> code: 255
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>> Stdout: ''
>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp S*tderr:
>>>> 'Permission denied, please try again.\r\nPermission denied, please try
>>>> again.\r\nPermission denied (publickey,password).\r\n'*
>>>> *
>>>> *
>>>> Setup ssh-key based passwordless access for user 'nova' (or whatever
>>>> user nova process is running as ) between nodes. Then try again.
>>>>
>>>>
>>>>
>>>> --
>>>> m at ruf
>>>>
>>>>
>>>> On Thu, Aug 15, 2013 at 4:52 AM, Guilherme Russi <
>>>> luisguilherme.cr at gmail.com> wrote:
>>>>
>>>>> Hello guys,
>>>>>
>>>>> I've been facing an error with live migration since last week and I
>>>>> wonder why I can't migrate my instances. I'm using the Grizzly release and
>>>>> I got this error in my both compute nodes:
>>>>>
>>>>>
>>>>> 2013-08-14 15:49:47.788 ERROR nova.compute.manager
>>>>> [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2
>>>>> d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
>>>>> e04986a1-8f56-4dd9-9995-419e05430da3] Unexpected error while running
>>>>> command.
>>>>> Stderr: 'Permission denied, please try again.\r\nPermission denied,
>>>>> please try again.\r\nPermission denied (publickey,password).\r\n'. Setting
>>>>> instance vm_state to ERROR
>>>>> 2013-08-14 15:49:48.294 ERROR nova.openstack.common.rpc.amqp
>>>>> [req-1fad8da2-2682-48a4-a390-64cb00036568 c402785616534f2096b34ce132b7d3f2
>>>>> d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling
>>>>>
>>>>>
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> Traceback (most recent call last):
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py",
>>>>> line 430, in _process_data
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> rval = self.proxy.dispatch(ctxt, version, method, **args)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File
>>>>> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py",
>>>>> line 133, in dispatch
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> return getattr(proxyobj, method)(ctxt, **kwargs)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in
>>>>> wrapped
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> temp_level, payload)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> self.gen.next()
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in
>>>>> wrapped
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> return f(self, context, *args, **kw)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209,
>>>>> in decorated_function
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> pass
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> self.gen.next()
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195,
>>>>> in decorated_function
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> return function(self, context, *args, **kwargs)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260,
>>>>> in decorated_function
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> function(self, context, *args, **kwargs)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237,
>>>>> in decorated_function
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> e, sys.exc_info())
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> self.gen.next()
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224,
>>>>> in decorated_function
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> return function(self, context, *args, **kwargs)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354,
>>>>> in resize_instance
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> block_device_info)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>>> 3467, in migrate_disk_and_power_off
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> inst_base_resize)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> self.gen.next()
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
>>>>> 3444, in migrate_disk_and_power_off
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> utils.execute('ssh', dest, 'mkdir', '-p', inst_base)
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> cmd=' '.join(cmd))
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> ProcessExecutionError: Unexpected error while running command.
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> Command: ssh 10.3.77.52 mkdir -p
>>>>> /var/lib/nova/instances/e04986a1-8f56-4dd9-9995-419e05430da3
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp Exit
>>>>> code: 255
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> Stdout: ''
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>> Stderr: 'Permission denied, please try again.\r\nPermission denied, please
>>>>> try again.\r\nPermission denied (publickey,password).\r\n'
>>>>> 2013-08-14 15:49:48.294 1700 TRACE nova.openstack.common.rpc.amqp
>>>>>
>>>>> Can anybody help me?
>>>>>
>>>>> Regards.
>>>>>
>>>>> Guilherme.
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list:
>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>> Post to : openstack at lists.openstack.org
>>>>> Unsubscribe :
>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list:
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>> Post to : openstack at lists.openstack.org
>>>> Unsubscribe :
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>
>>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/cca7c209/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130815/cca7c209/attachment.jpg>
More information about the Openstack
mailing list