<div dir="ltr">Hello guys, I recovered from my problem when I was starting a VM, I made all the configs to set the permissions, but I'm still getting an error:<div><br></div><div><div>2013-08-05 14:27:19.013 ERROR nova.compute.manager [req-784c7b22-7dec-4b9a-99ac-63f106120b49 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 701b57a3-2eab-45ef-b6b9-506bccbf5203] Unexpected error while running command.</div>
<div>Stderr: "Warning: Permanently added '10.3.77.52' (ECDSA) to the list of known hosts.\r\nPermission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n". Setting instance vm_state to ERROR</div>
<div>2013-08-05 14:27:19.492 ERROR nova.openstack.common.rpc.amqp [req-784c7b22-7dec-4b9a-99ac-63f106120b49 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div></div>
<div>
<br></div><div>Any idea?</div><div><br></div><div>Regards.</div><div><br></div><div>Guilherme.</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/8/5 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello guys,<div><br></div><div> I've been trying to solve my problem with live migration, but a this moment I'm getting problems when I'll create my VMs, does anybody know what am I doing wrong? Here is my compute node log:</div>
<div><br></div><div><div>cat /var/log/nova/nova-*.log | grep -E ERROR</div><div>2013-08-05 08:14:39.808 1708 ERROR nova.manager [-] Error during ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-08-05 08:54:40.026 1708 ERROR nova.manager [-] Error during ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div><div>2013-08-05 09:34:40.110 1708 ERROR nova.manager [-] Error during ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-08-05 10:14:40.449 1708 ERROR nova.manager [-] Error during ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div><div>2013-08-05 10:42:25.911 ERROR nova.network.quantumv2 [req-2b29363e-a281-490e-a1c3-d624ce292d55 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] _get_auth_token() failed</div>
<div>2013-08-05 10:42:25.912 ERROR nova.compute.manager [req-2b29363e-a281-490e-a1c3-d624ce292d55 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 483f98e3-8ef5-43e2-8c3a-def55abdabcd] Instance failed network setup</div>
<div>2013-08-05 10:42:41.422 1708 ERROR nova.network.quantumv2 [-] _get_auth_token() failed</div><div>2013-08-05 10:43:24.559 1708 ERROR nova.virt.libvirt.driver [-] [instance: 483f98e3-8ef5-43e2-8c3a-def55abdabcd] During wait destroy, instance disappeared.</div>
<div>2013-08-05 10:43:24.655 ERROR nova.compute.manager [req-2b29363e-a281-490e-a1c3-d624ce292d55 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 483f98e3-8ef5-43e2-8c3a-def55abdabcd] Error: ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 817, in _run_instance\n requested_networks, macs, security_groups)\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1061, in _allocate_network\n instance=instance)\n', ' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1057, in _allocate_network\n security_groups=security_groups)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 46, in wrapper\n res = f(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py", line 280, in allocate_for_instance\n \'exception\': ex})\n', ' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py", line 261, in allocate_for_instance\n port_req_body)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py", line 307, in _populate_quantum_extension_values\n self._refresh_quantum_extensions_cache()\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py", line 299, in _refresh_quantum_extensions_cache\n quantum = quantumv2.get_client(context.get_admin_context())\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/__init__.py", line 67, in get_client\n return _get_client(token=token)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/__init__.py", line 49, in _get_client\n token = _get_auth_token()\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/__init__.py", line 43, in _get_auth_token\n LOG.exception(_("_get_auth_token() failed"))\n', ' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/quantumv2/__init__.py", line 40, in _get_auth_token\n httpclient.authenticate()\n', ' File "/usr/lib/python2.7/dist-packages/quantumclient/client.py", line 198, in authenticate\n raise exceptions.Unauthorized(message=body)\n', 'Unauthorized: Request Timeout\n']</div>
</div><div><br></div><div>I've followed this steps to change the uid and gid <a href="http://docs.openstack.org/trunk/openstack-compute/admin/content/nova-uid-mismatch.html" target="_blank">http://docs.openstack.org/trunk/openstack-compute/admin/content/nova-uid-mismatch.html</a> but now I can't create a VM.</div>
<div><br></div><div>Thank you all.</div><div><br></div><div>Guilherme.</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello again Filipe, I've tried to change my compute nodes' UID and GID to match those from my controller node, but when I restart the services, the nova-compute service keep on stop/waiting, I tried to reboot the compute node, but it keeps the same way. I've been checking if UID or GID was in conflict, but they are not.<div>
The UID and GID from my compute nodes are matching, but I need to match them with ones from my controller node, right?</div><div><br></div><div>Thank you.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">
2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Confirming the UIDs and GIDs, I had one of them that didn't match, then I choose another ID to match, is it right?<div><br></div><div>Thank you.</div><div><br></div><div>Regards.</div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/7/31 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Answers inline.<br><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Right, just to check, is it known_hosts or know_hosts like you write?</div></blockquote><div><br></div><div>known_hosts you're right</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">And another thing, I made the test sudo -u nova ssh my_compute_node and it stops in a password screen, is it right?</div></blockquote><div><br></div><div>No. It should be able to ssh without password. Check all files have permissions 700 and belong to nova.</div>
<div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>And the last one, after making chown -R nova /var/lib/nova/ I'm getting error to create new VMs.</div>
</div></blockquote><div><br></div><div>Do you follow the guide about changing nova ids? Make sure that /etc/passwd and /etc/passwd- (notice the -) match. The same for /etc/group and /etc/group- or reboot your compute nodes.</div>
<div><br></div><div>And don't forget to restart all your services including libvirt-bin.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">
<div><br></div><div>Thank you again.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">This is getting a little bit confusing so here are a recipe:<div><br></div><div>1. Delete everythin under <b><font face="courier new, monospace">/var/lib/nova/.ssh/</font></b></div>
<div>2. Run <font face="courier new, monospace"><b>ssh-keygen -N '' -f /var/lib/nova/.ssh/id_rsa</b></font></div>
<div>3. Run <font face="courier new, monospace"><b>cp </b></font><b><font face="courier new, monospace">/var/lib/nova/.ssh/id_rsa.pub /var/lib/nova/.ssh/authorized_keys</font><br></b>4. For every compute node execute <font face="courier new, monospace"><b>ssh-keyscan [node_fqdn],[node_ip_address] >> /var/lib/nova/.ssh/know_hosts</b></font></div>
<div>5. Copy the contents of <font face="courier new, monospace"><b>/var/lib/nova/.ssh</b></font> to all your compute nodes</div><div><br></div><div>Test it by running <font face="courier new, monospace"><b>sudo -u nova ssh [compute_node]</b></font></div>
</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I did the chown -R nova /var/lib/nova/ but still the error, any idea? I put the chown permission in my two compute nodes and in my controller node.<div><br></div><div><div>2013-07-31 15:40:55.720 ERROR nova.compute.manager [req-86d4ddd9-8c85-4ee7-ba0a-d83e81f26818 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: f4af662d-ae55-4346-82cf-a997192706b5] Unexpected error while running command.</div>
<div>Stderr: 'Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n'. Setting instance vm_state to ERROR</div><div>2013-07-31 15:40:56.298 ERROR nova.openstack.common.rpc.amqp [req-86d4ddd9-8c85-4ee7-ba0a-d83e81f26818 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div>
</div><div><br></div><div><br></div><div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp temp_level, payload)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp pass</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp block_device_info)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp inst_base_resize)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp utils.execute('ssh', dest, 'mkdir', '-p', inst_base)</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp cmd=' '.join(cmd))</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.48 mkdir -p /var/lib/nova/instances/f4af662d-ae55-4346-82cf-a997192706b5</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp Exit code: 255</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp Stdout: ''</div><div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp Stderr: 'Permission denied, please try again.\r\nPermission denied, please try again.\r\nPermission denied (publickey,password).\r\n'</div>
<div>2013-07-31 15:40:56.298 19528 TRACE nova.openstack.common.rpc.amqp </div></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">chown -r nova. /var/lib/nova <div>:)</div><div><br><div>
<span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:'Lucida Grande';word-spacing:0px"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Razique Mahroua</b></span><span style="font-weight:normal;font-family:Helvetica;color:rgb(19,112,138)"><b> - </b></span><span style="font-family:Helvetica"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Nuage & Co</b></span><span style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px;font-size:medium"><span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px"><div style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal">
<font color="#13708a"><a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a></font></div><div style="font-style:normal;font-size:medium;font-family:Helvetica"><font color="#13708a">Tel : <a href="tel:%2B33%209%2072%2037%2094%2015" value="+33972379415" target="_blank">+33 9 72 37 94 15</a></font></div>
</span></span></span></span></span><br style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;text-transform:none;font-size:medium;white-space:normal;font-family:Arial;word-spacing:0px">
<span><img height="125" width="125" src="cid:0A2450C8-6A0D-42D0-8035-743CAD564432@fabrique.lan"></span>
</div>
<br><div><div>Le 31 juil. 2013 à 19:36, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div><br><blockquote type="cite"><div dir="ltr">My config file is like that:<div>
<br></div><div><div>ls -la /var/lib/nova/.ssh/config </div><div>-rw-r--r-- 1 nova root 25 Jul 31 10:49 /var/lib/nova/.ssh/config</div></div></div><div class="gmail_extra"><br>
<br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">ok make sure the file 'config' belongs to the user nova and it'll be good :)<div><br><div>
<span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:'Lucida Grande';word-spacing:0px"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Razique Mahroua</b></span><span style="font-weight:normal;font-family:Helvetica;color:rgb(19,112,138)"><b> - </b></span><span style="font-family:Helvetica"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Nuage & Co</b></span><span style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px;font-size:medium"><span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px"><div style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal">
<font color="#13708a"><a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a></font></div><div style="font-style:normal;font-size:medium;font-family:Helvetica"><font color="#13708a">Tel : <a href="tel:%2B33%209%2072%2037%2094%2015" value="+33972379415" target="_blank">+33 9 72 37 94 15</a></font></div>
</span></span></span></span></span><br style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;text-transform:none;font-size:medium;white-space:normal;font-family:Arial;word-spacing:0px">
<span><NUAGECO-LOGO-Fblan_petit.jpg></span>
</div>
<br><div><div>Le 31 juil. 2013 à 18:11, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div><br><blockquote type="cite"><div dir="ltr">here is what happened:<div>
<br></div><div><div> ssh <a href="mailto:nova@10.3.77.48" target="_blank">nova@10.3.77.48</a></div><div>The authenticity of host '10.3.77.48 (10.3.77.48)' can't be established.</div><div>
ECDSA key fingerprint is e3:ca:f7:dd:1e:1f:e3:e3:17:f8:52:09:a4:41:e1:40.</div><div>Are you sure you want to continue connecting (yes/no)? yes</div><div>Failed to add the host to the list of known hosts (/var/lib/nova/.ssh/known_hosts).</div>
<div><a href="mailto:nova@10.3.77.48" target="_blank">nova@10.3.77.48</a>'s password: </div></div><div><br></div><div>I don't remember if I set up a password for nova user, I don't know which is it.</div><div>
<br></div><div>
Regards.</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">ok can you update the file /etc/passwd<div>and use /bin/sh as a shell for the nova user</div><div>then log as nova : </div><div># su - nova</div><div><br></div><div>after that, try to ssh into the other node : </div>
<div># ssh <a href="mailto:nova@10.3.77.48" target="_blank">nova@10.3.77.48</a></div><div><br></div><div>You shouldn't be asked for anything, you should just be connected to the host</div><div><br></div><div><br><div>
<div>Le 31 juil. 2013 à 17:07, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div><br><blockquote type="cite"><div dir="ltr">This is the nova-compute.log's content from my Compute node "Caos" where the VM is first created.<div>
<br></div><div><div>cat /var/log/nova/nova-compute.log | grep -E ERROR</div><div>2013-07-31 11:18:49.606 ERROR nova.compute.manager [req-017b4047-9ec0-4412-9f9b-6660625f2221 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 96afb354-a6f8-49a8-9136-3fb2ef8bd321] Unexpected error while running command.</div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to ERROR</div><div>2013-07-31 11:18:50.245 ERROR nova.openstack.common.rpc.amqp [req-017b4047-9ec0-4412-9f9b-6660625f2221 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div>
<div>2013-07-31 11:50:47.134 ERROR nova.compute.manager [req-91960dc0-9f6d-44cf-8abb-5b23c95f9850 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 0c729d3b-4e5a-45b8-9e68-1382b321d77e] Unexpected error while running command.</div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to ERROR</div><div>2013-07-31 11:50:47.909 ERROR nova.openstack.common.rpc.amqp [req-91960dc0-9f6d-44cf-8abb-5b23c95f9850 c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div>
</div><div><br></div><div><br></div><div><div>cat /var/log/nova/nova-compute.log | grep -E TRACE</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp temp_level, payload)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp pass</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp block_device_info)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp inst_base_resize)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp utils.execute('ssh', dest, 'mkdir', '-p', inst_base)</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp cmd=' '.join(cmd))</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.48 mkdir -p /var/lib/nova/instances/96afb354-a6f8-49a8-9136-3fb2ef8bd321</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp Exit code: 255</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp Stdout: ''</div><div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp Stderr: 'Host key verification failed.\r\n'</div>
<div>2013-07-31 11:18:50.245 19528 TRACE nova.openstack.common.rpc.amqp </div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp temp_level, payload)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp pass</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp block_device_info)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp inst_base_resize)</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp utils.execute('ssh', dest, 'mkdir', '-p', inst_base)</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp cmd=' '.join(cmd))</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.48 mkdir -p /var/lib/nova/instances/0c729d3b-4e5a-45b8-9e68-1382b321d77e</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp Exit code: 255</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp Stdout: ''</div><div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp Stderr: 'Host key verification failed.\r\n'</div>
<div>2013-07-31 11:50:<a href="tel:47.909%2019528" value="+554790919528" target="_blank">47.909 19528</a> TRACE nova.openstack.common.rpc.amqp</div></div><div><br></div><div><br></div><div><br><br></div><div class="gmail_extra">
<br><div class="gmail_quote">2013/7/31 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">What's your error know when you try to migrate?</div><div class="gmail_extra"><br clear="all"><div>
<div dir="ltr">
Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div>
</div></div>
<br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I still don't know what to do, I've checked again my nova.conf from my compute nodes, checked the public key from authorized_keys, checked the folder /var/lib/nova/instances mapped from my controller to my compute nodes, and checked the uid/gid from nova and libvirt-qemu.<div>
<br></div><div>Am I missing anything?</div><div><br></div><div>Thank you all.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Yes, I was doing right so.</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Pub, always the <b>public key</b>, the private key is…well private and should NEVER be shared :)<div>
<br><div><div>Le 31 juil. 2013 à 16:01, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div><br><blockquote type="cite"><div dir="ltr">Just to check, the file to copy and insert into the authorized_keys is from the id_rsa or id_rsa.pub?<div>
<br></div><div>Thank you.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Just make a correction on my path, it is in /var/lib/nova/.ssh not in /var/lib/.ssh like I sad before :)</div>
<div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><br><div><div>Le 31 juil. 2013 à 15:40, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div>
<br><blockquote type="cite"><div dir="ltr">Hello friends,<div><br></div><div> First from JuanFra: I've alrealdy checked it, they are the same.</div><div> Second from Razique: Could you give me a strictly explanation, I already have the folder in /var/lib/.ssh with the file authorized_keys inside. This file config must have only <span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68);font-weight:bold">StrictHostKeyChecking</span><span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68)"> no inside it?</span></div>
</div></blockquote>yup that prevents the user nova from being prompted to type "yes" if it's an unknown server</div><div> <br><blockquote type="cite"><div dir="ltr">
<div><span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68)"><br></span></div><div><span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68)">Thank you all.</span></div><div><span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68)"><br>
</span></div><div><span style="font-family:arial,sans-serif;line-height:16px;color:rgb(68,68,68)">Guilherme.</span></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/31 Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hey Guilherme :)<div>make sure : </div><div>• To exchange pubkey of nova users amongst all nodes</div>
<div>• Add in /var/lib a directory .ssh/ and create a "config" file with into : <em style="line-height:16px;text-align:left;color:rgb(68,68,68);font-size:small;font-style:normal;font-family:arial,sans-serif;font-weight:bold">StrictHostKeyChecking</em><span style="line-height:16px;text-align:left;color:rgb(68,68,68);font-size:small;font-family:arial,sans-serif"> no</span></div>
<div style="text-align:left"><br></div><div><div style="text-align:left"><font color="#444444" face="arial, sans-serif"><span style="line-height:16px"><br></span></font></div><br><br><div>
<span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:'Lucida Grande';word-spacing:0px"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Razique Mahroua</b></span><span style="font-weight:normal;font-family:Helvetica;color:rgb(19,112,138)"><b> - </b></span><span style="font-family:Helvetica"><span style="font-weight:normal;font-family:Helvetica"><b style="color:rgb(19,112,138)">Nuage & Co</b></span><span style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px;font-size:medium"><span style="border-spacing:0px;text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;border-spacing:0px"><div style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal">
<font color="#13708a"><a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a></font></div><div style="font-style:normal;font-size:medium;font-family:Helvetica"><font color="#13708a">Tel : <a href="tel:%2B33%209%2072%2037%2094%2015" value="+33972379415" target="_blank">+33 9 72 37 94 15</a></font></div>
</span></span></span></span></span><br style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;text-transform:none;font-size:medium;white-space:normal;font-family:Arial;word-spacing:0px">
<span><NUAGECO-LOGO-Fblan_petit.jpg></span>
</div>
<br><div><div>Le 30 juil. 2013 à 19:08, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> a écrit :</div><br><blockquote type="cite"><div dir="ltr"><div><div>
Sure, thank you.</div><div><br></div><div>cat /var/log/nova/nova-compute.log | grep -E ERROR</div></div><div>2013-07-30 13:48:08.074 ERROR nova.compute.manager [req-bb59c9e8-8ef3-4461-8a51-01166ccc758d c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: 5061e7a6-2482-4af2-97cf-0074326fb940] Unexpected error while running command.</div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to ERROR</div><div>2013-07-30 13:48:08.747 ERROR nova.openstack.common.rpc.amqp [req-bb59c9e8-8ef3-4461-8a51-01166ccc758d c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div>
<div><br></div><div>cat /var/log/nova/nova-compute.log | grep -E TRACE<br></div><div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp temp_level, payload)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp pass</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp block_device_info)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp inst_base_resize)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp utils.execute('ssh', dest, 'mkdir', '-p', inst_base)</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp cmd=' '.join(cmd))</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.48 mkdir -p /var/lib/nova/instances/5061e7a6-2482-4af2-97cf-0074326fb940</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp Exit code: 255</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp Stdout: ''</div><div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp Stderr: 'Host key verification failed.\r\n'</div>
<div>2013-07-30 13:48:08.747 6254 TRACE nova.openstack.common.rpc.amqp </div></div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/30 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Can you provide more information (errors and/or logs)?</div><div class="gmail_extra"><br clear="all"><div>
<div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div>
</div></div>
<br><br><div class="gmail_quote">2013/7/30 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">It didn't work :(</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/30 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Ok, testing it.</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/30 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Basically edit the /etc/passwd and /etc/passwd- files and change /bin/false to /bin/bash on the nova user entry.<div>
<br></div><div>I'm having another problem after this related to libvirt but I have no time to fix it know. Basically the migration ends but then libvirt isn't able to boot the machine again. Let me know about your results.</div>
<div><br></div><div>Regards</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/30 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Ok, on my scenario I have 2 Compute nodes and 1 Controller + Network node, how did you change your configs, I can try your idea.</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/30 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">No I just wanted to know what is your scenario. About the mkdir I spend a couple of time looking at it and managed to fix it by changing the shell of the nova user to /bin/bash instead of /bin/false on all the compute nodes. You can try it.</div>
<div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/30 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hello Filipe, I followed the manual on the openstack documentation, I shared the /var/lib/nova/instances on my controller, do I need to share another folders?<div><br></div><div>Regards.</div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/7/30 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi<div><br></div><div>A couple of messages ago you shown an error where the mkdir command failed. At that time the keys were properly configured. Can you revert your changes?</div><div><br></div><div>About the mkdir error, I had a similar one but I wasn't able to fix it yet. Do you have shared storage for your instances?</div>
<div><br></div><div>I never used virsh directly because, AFAIK, openstack will not be informed of the changes and will not work correctly (but I may be wrong in this one).</div>
</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/30 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div>I created the new key, but still getting error: here are the logs:</div><div><br></div><div>cat /var/log/nova/nova-compute.log | grep -E ERROR</div><div>2013-07-30 11:37:51.097 ERROR nova.compute.manager [req-c3441bfc-dcd7-4625-b701-716f152a4bfe c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] [instance: bed3c3be-31d6-42c3-9a7f-e40ef9c1c764] Unexpected error while running command.</div>
<div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to ERROR</div></div><div>2013-07-30 11:37:52.463 ERROR nova.openstack.common.rpc.amqp [req-c3441bfc-dcd7-4625-b701-716f152a4bfe c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message handling</div>
<div><br></div><div><br></div><div><div>cat /var/log/nova/nova-compute.log | grep -E TRACE</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp temp_level, payload)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209, in decorated_function</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp pass</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195, in decorated_function</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2354, in resize_instance</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp block_device_info)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3467, in migrate_disk_and_power_off</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp inst_base_resize)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp self.gen.next()</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3444, in migrate_disk_and_power_off</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp utils.execute('ssh', dest, 'mkdir', '-p', inst_base)</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp cmd=' '.join(cmd))</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp ProcessExecutionError: Unexpected error while running command.</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp Command: ssh 10.3.77.48 mkdir -p /var/lib/nova/instances/bed3c3be-31d6-42c3-9a7f-e40ef9c1c764</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp Exit code: 255</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp Stdout: ''</div><div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp Stderr: 'Host key verification failed.\r\n'</div>
<div>2013-07-30 11:37:52.463 6254 TRACE nova.openstack.common.rpc.amqp </div></div><div><br></div><div>I've been trying to migrate directly with virsh, but I got this error and the solutions through the web don't help.</div>
<div><br></div><div><div>virsh migrate --live instance-00000063 qemu+ssh://<a href="http://192.168.3.3/system" target="_blank">192.168.3.3/system</a></div><div><a href="mailto:root@192.168.3.3" target="_blank">root@192.168.3.3</a>'s password: </div>
<div>erro: internal error cannot load AppArmor profile 'libvirt-bed3c3be-31d6-42c3-9a7f-e40ef9c1c764'</div></div><div><br></div><div><br></div><div>Thank you all.</div><div><br></div><div><br></div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/7/29 <span dir="ltr"><<a href="mailto:yongiman@gmail.com" target="_blank">yongiman@gmail.com</a>></span><div><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="auto"><div>Hi Guilherme,</div><div><br></div><div>I suugest making new ssh key and put the public key in the host</div><div><br></div><div># ssh-keygen (you will find id_rsa.pub in your .ssh directory)</div><div>
<br></div><div>Copy the contents of this file and paste at the last line of authorized_keys in the host.</div><div><br></div><div><br></div><div><br>On 2013. 7. 29., at 오후 10:40, Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>> wrote:<br>
<br></div><blockquote type="cite"><div dir="ltr">Hello Filipe, I created the /var/lib/nova/.ssh/authorized_keys and its content is the keys from the know_hosts, is it right? I'm still getting the same error when I try to migrate a VM.<div>
<br></div><div>
Thank you.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/26 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">About the keys it's up to you. You can use the same or create a new one. Using the same is easier.<div><br></div><div>But the nova user public key should go into /var/lib/nova/.ssh/authorized_keys not into the know_hosts file. The easier way (as you only have two compute nodes) to add the keys to the know_hosts is to manually ssh and accept the key.</div>
</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/26 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Ok, Must I create another ssh key to communicate both compute nodes or the current key can work? I've put the plublic key from both compute node in the know_hosts. Which permission should I apply? 644?<div>
<br></div><div>Thank you.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/26 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">First you need to check why this "<span style="font-family:arial,sans-serif;font-size:13px">Failed to add the host to the list of known hosts (/var/lib/nova/.ssh/known_</span><span style="font-family:arial,sans-serif;font-size:13px">hosts)." happens. It maybe file permissions or so. Then you need to generate an ssh key for the user nova and add it to the other compute nodes on the authorized_keys file (the password is not really necessary as soon as you have the keys in place).</span></div>
<div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/26 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div>sudo -u nova ssh 192.168.3.3</div><div>The authenticity of host '192.168.3.3 (192.168.3.3)' can't be established.</div><div>ECDSA key fingerprint is e3:ca:f7:dd:1e:1f:e3:e3:17:f8:52:09:a4:41:e1:40.</div>
<div>Are you sure you want to continue connecting (yes/no)? yes</div><div>Failed to add the host to the list of known hosts (/var/lib/nova/.ssh/known_hosts).</div><div><a href="mailto:nova@192.168.3.3" target="_blank">nova@192.168.3.3</a>'s password: </div>
<div><br></div><div>But I don't know the user nova's password.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/7/26 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Can you try <font face="courier new, monospace"><b>sudo -u nova ssh <remote-compute-node></b></font> form the compute node currently running the VM and check if it works?</div>
<div class="gmail_extra">
<br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/26 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hello Filipe,<div><br></div><div> I made the copy from my .ssh/know_hosts to places you told me, but I'm still getting the same error. Any other ideas?</div><div><br></div><div>Thank you.</div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/7/26 Filipe Manco <span dir="ltr"><<a href="mailto:filipe.manco@gmail.com" target="_blank">filipe.manco@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi<div><br>This error means that you cannot ssh into the new compute node because it's public key cannot be verified. Add the public keys of the compute nodes to /etc/ssh/know_hosts file (or the nova one, usually under /var/lib/nova/.ssh/) and the problem should be gone.</div>
<div><br></div><div>Regards</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">Filipe Manco<br><div><a href="http://about.me/fmanco" target="_blank">http://about.me/fmanco</a></div></div></div>
<br><br><div class="gmail_quote">2013/7/26 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Ok, I'll look more carefully the log and it's cool this command from libvirt, I didn't know it, I'll try it and return to you.<div><br></div><div>Thank you again.</div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/7/25 Wangpan <span dir="ltr"><<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<u></u>
<div style="BORDER-LEFT-WIDTH:0px;BORDER-RIGHT-WIDTH:0px;BORDER-BOTTOM-WIDTH:0px;MARGIN:12px;LINE-HEIGHT:1.3;BORDER-TOP-WIDTH:0px" marginheight="0" marginwidth="0">
<div><font size="3" face="宋体">That's confused me,
"Unexpected error while running command" will give us what command is
running when this error occured, you may check the log more
carefully.</font></div>
<div>and you also can migrate the VM directly by libvirt command line like
below:</div>
<div><font size="3" face="宋体">virsh migrate --live --persistent
--undefinesource --verbose --domain ${instance-uuid} --desturi
<a>qemu+tcp://${the-dest-host-ip}/system</a></font></div>
<div>then see the output result.</div>
<div> </div>
<div align="left"><font color="#c0c0c0" face="Verdana">2013-07-26</font></div>
<div align="left"><font face="Verdana">
<hr style="min-height:2px;WIDTH:122px" align="left" size="2">
</font></div>
<div align="left"><font color="#c0c0c0" face="Verdana">Wangpan</font></div>
<div><font face="Verdana">
<hr>
</font></div>
<div><font face="Verdana"><strong>发件人:</strong>Guilherme Russi
<<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></font></div>
<div><font face="Verdana"><strong>发送时间:</strong>2013-07-26 09:30</font></div>
<div><font face="Verdana"><strong>主题:</strong>Re: Re: Re: Re: Re:
[Openstack] Configuring Live Migration</font></div>
<div><font face="Verdana"><strong>收件人:</strong>"Wangpan"<<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></font></div>
<div><font face="Verdana"><strong>抄送:</strong>"<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>"<<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>></font></div>
<div><font face="Verdana"></font> </div>
<div><font face="Verdana">
<div dir="ltr">When I enter the action to migrate, the only two errors showen at
this period are these two.</div>
<div class="gmail_extra"><br><br>
<div class="gmail_quote">2013/7/25 Wangpan <span dir="ltr"><<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></span><br>
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid"><u></u>
<div style="BORDER-LEFT-WIDTH:0px;BORDER-RIGHT-WIDTH:0px;BORDER-BOTTOM-WIDTH:0px;MARGIN:12px;LINE-HEIGHT:1.3;BORDER-TOP-WIDTH:0px" marginheight="0" marginwidth="0">
<div><font size="3" face="宋体">There may have more error logs at this
minute 2013-07-25 17:28,</font></div>
<div>you can get the backtrace near the error log you post.</div>
<div> </div>
<div align="left"><font color="#c0c0c0" face="Verdana">2013-07-26</font></div>
<div align="left"><font face="Verdana">
<hr style="MIN-HEIGHT:2px;WIDTH:122px" align="left" size="2">
</font></div>
<div align="left"><font color="#c0c0c0" face="Verdana"><span>Wangpan</span></font></div>
<div><font face="Verdana">
<hr>
</font></div>
<div><font face="Verdana"><strong>发件人:</strong>Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></font></div>
<div><font face="Verdana"><strong>发送时间:</strong>2013-07-26 04:48</font></div>
<div><font face="Verdana"><strong>主题:</strong>Re: Re: Re: Re: [Openstack]
Configuring Live Migration</font></div>
<div><font face="Verdana"><strong>收件人:</strong>"Wangpan"<<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>>,"<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>"<<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>></font></div>
<div><font face="Verdana"><strong>抄送:</strong></font></div>
<div><font face="Verdana"></font> </div>
<div><font face="Verdana">
<div dir="ltr">Hello guys, I'm getting problems when trying to migrate a VM.
<div><br></div>
<div>I'm getting this error on my log:</div>
<div><br></div>
<div>
<div>2013-07-25 17:28:31.582 ERROR nova.compute.manager
[req-07d2c8b0-80c3-4ae8-8faf-226a099500e4 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
919f13d2-8116-4714-b2ec-d2e0f3d3c910] Unexpected error while running
command.</div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state to
ERROR</div>
<div>2013-07-25 17:28:32.212 ERROR nova.openstack.common.rpc.amqp
[req-07d2c8b0-80c3-4ae8-8faf-226a099500e4 c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message
handling</div></div>
<div><br></div>
<div><br></div>
<div>The user Wangpan was helping me, but I guess his hour is different from
mine, can anybody five me an idea?</div>
<div><br></div>
<div>Thank you.</div>
<div><br></div>
<div>Guilherme.</div></div>
<div class="gmail_extra"><br><br>
<div class="gmail_quote">2013/7/25 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid">
<div dir="ltr">Hello Wangpan, I've looking at the logs and I saw one error
with my ssh port, and then I fixed the port, but now I'm getting this
error:
<div><br></div>
<div>
<div>
<div>2013-07-25 14:09:50.388 ERROR nova.compute.manager
[req-6930a2e2-60e7-421f-a560-26a626ecebcb c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] [instance:
d268d24b-96fc-4450-88d4-19ba83cd8892] Unexpected error while running
command.</div>
<div>Stderr: 'Host key verification failed.\r\n'. Setting instance vm_state
to ERROR</div>
<div>2013-07-25 14:09:51.005 ERROR nova.openstack.common.rpc.amqp
[req-6930a2e2-60e7-421f-a560-26a626ecebcb c402785616534f2096b34ce132b7d3f2
d532a4fc2e9e4b5f83b6dec7085237e5] Exception during message
handling</div></div></div>
<div><br></div>
<div>What "host key verification"? Where should I put this key?</div>
<div><br></div>
<div>Thank you.</div>
<div><br></div>
<div>Guilherme.</div></div>
<div class="gmail_extra"><br><br>
<div class="gmail_quote">2013/7/25 Guilherme Russi <span dir="ltr"><<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid"><p dir="ltr">Typed wrong here </p>
<div class="gmail_quote">Em 25/07/2013 00:42, "Wangpan" <<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>> escreveu:<br type="attribution">
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid"><u></u>
<div style="BORDER-LEFT-WIDTH:0px;BORDER-RIGHT-WIDTH:0px;BORDER-BOTTOM-WIDTH:0px;MARGIN:12px;LINE-HEIGHT:1.3;BORDER-TOP-WIDTH:0px" marginheight="0" marginwidth="0">chmod 777 -R /var/<font color="#ff0000">lib</font>/nova/instances
<div><font size="3" face="宋体">not the /var/<font style="BACKGROUND-COLOR:#ffcc00">log</font>/nova/instances</font></div>
<div> </div>
<div align="left"><font color="#c0c0c0" face="Verdana">2013-07-25</font></div>
<div align="left"><font face="Verdana">
<hr style="MIN-HEIGHT:2px;WIDTH:122px" align="left" size="2">
</font></div>
<div align="left"><font color="#c0c0c0" face="Verdana"><span>Wangpan</span></font></div>
<div><font face="Verdana">
<hr>
</font></div>
<div><font face="Verdana"><strong>发件人:</strong>Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></font></div>
<div><font face="Verdana"><strong>发送时间:</strong>2013-07-25 10:39</font></div>
<div><font face="Verdana"><strong>主题:</strong>Re: Re: Re: [Openstack]
Configuring Live Migration</font></div>
<div><font face="Verdana"><strong>收件人:</strong>"Wangpan"<<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></font></div>
<div><font face="Verdana"><strong>抄送:</strong></font></div>
<div><font face="Verdana"></font> </div>
<div><font face="Verdana">
<div dir="ltr">I've done chmod 777 -R /var/log/nova/instances
<div><br></div>
<div>Does it work?</div></div>
<div class="gmail_extra"><br><br>
<div class="gmail_quote">2013/7/24 Wangpan <span dir="ltr"><<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></span><br>
<blockquote class="gmail_quote" style="PADDING-LEFT:1ex;MARGIN:0px 0px 0px 0.8ex;BORDER-LEFT:#ccc 1px solid"><u></u>
<div style="BORDER-LEFT-WIDTH:0px;BORDER-RIGHT-WIDTH:0px;BORDER-BOTTOM-WIDTH:0px;MARGIN:12px;LINE-HEIGHT:1.3;BORDER-TOP-WIDTH:0px" marginheight="0" marginwidth="0">
<div><font size="3" face="宋体">I saw this
error "Permission denied: '/var/lib/nova/instances/'" in your
logs.</font></div>
<div>you may need to chown the instances
path '/var/lib/nova/instances/'</div>
<div> </div>
<div align="left"><font color="#c0c0c0" face="Verdana">2013-07-25</font></div>
<div align="left"><font face="Verdana">
<hr style="MIN-HEIGHT:2px;WIDTH:122px" align="left" size="2">
</font></div>
<div align="left"><font color="#c0c0c0" face="Verdana"><span>Wangpan</span></font></div>
<div><font face="Verdana">
<hr>
</font></div>
<div><font face="Verdana"><strong>发件人:</strong>Guilherme Russi <<a href="mailto:luisguilherme.cr@gmail.com" target="_blank">luisguilherme.cr@gmail.com</a>></font></div>
<div><font face="Verdana"><strong>发送时间:</strong>2013-07-25 10:08</font></div>
<div><font face="Verdana"><strong>主题:</strong>Re: Re: [Openstack]
Configuring Live Migration</font></div>
<div><font face="Verdana"><strong>收件人:</strong>"Wangpan"<<a href="mailto:hzwangpan@corp.netease.com" target="_blank">hzwangpan@corp.netease.com</a>></font></div>
<div><font face="Verdana"><strong>抄送:</strong></font></div>
<div><font face="Verdana"></font> </div>
<div><font face="Verdana">
<div dir="ltr">Compute Node 01:
<div><br></div>
<div>
<div>cat /var/log/nova/nova-*.log | grep -E ERROR</div>
<div>2013-07-24 08:03:57.262 1820 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 08:43:57.655 1820 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 09:23:57.816 1820 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 10:03:57.993 1820 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 10:20:21.767 ERROR nova.compute.manager
[req-c4b2d1db-676c-4398-a5b8-582a76ec6c35
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] Instance failed to
spawn</div>
<div>2013-07-24 10:20:29.326 1820 ERROR nova.virt.libvirt.driver [-]
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 10:20:29.511 ERROR nova.compute.manager
[req-c4b2d1db-676c-4398-a5b8-582a76ec6c35
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/55215431-0a42-4fc8-a642-c08d3cc5e2bc/'\n"]</div>
<div>2013-07-24 10:33:17.279 ERROR nova.compute.manager
[req-f10c5f14-b3ad-4c13-b20f-c53f57379163
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] Instance failed to
spawn</div>
<div>2013-07-24 10:33:36.673 1820 ERROR nova.virt.libvirt.driver [-]
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 10:33:36.837 ERROR nova.compute.manager
[req-f10c5f14-b3ad-4c13-b20f-c53f57379163
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/ca733a02-766e-46e1-9a15-bd2a12b10ebd/'\n"]</div>
<div>2013-07-24 10:40:26.722 ERROR nova.compute.manager
[req-5d0289b3-36d7-4046-996c-a1decb922066
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] Instance failed to
spawn</div>
<div>2013-07-24 10:40:39.402 1820 ERROR nova.virt.libvirt.driver [-]
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 10:40:39.530 ERROR nova.compute.manager
[req-5d0289b3-36d7-4046-996c-a1decb922066
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/3b15a4e9-fb2c-452a-8045-16d1f58ebf73/'\n"]</div>
<div>2013-07-24 10:43:58.194 1820 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 11:03:19.657 ERROR nova.virt.libvirt.driver
[req-5441aa83-cc8a-4d25-a17e-9e4f63448451
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
Error on '/var/lib/nova/instances' while checking direct I/O: '[Errno
13] Permission denied: '/var/lib/nova/instances/.directio.test''</div>
<div>2013-07-24 11:03:19.658 ERROR nova.compute.manager
[req-5441aa83-cc8a-4d25-a17e-9e4f63448451
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] Instance failed to
spawn</div>
<div>2013-07-24 11:03:32.036 1685 ERROR nova.virt.libvirt.driver [-]
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 11:03:32.170 ERROR nova.compute.manager
[req-5441aa83-cc8a-4d25-a17e-9e4f63448451
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1510, in spawn\n block_device_info=block_device_info)\n',
' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2326, in to_xml\n disk_info, rescue,
block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2244, in get_guest_config\n inst_type):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2051, in get_guest_storage_config\n inst_type)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2013, in get_guest_disk_config\n self.disk_cachemode,\n',
' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
355, in disk_cachemode\n if not
self._supports_direct_io(CONF.instances_path):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1676, in _supports_direct_io\n {\'path\': dirpath,
\'ex\': str(e)})\n', ' File "/usr/lib/python2.7/contextlib.py",
line 24, in __exit__\n self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1663, in _supports_direct_io\n f = os.open(testfile,
os.O_CREAT | os.O_WRONLY | os.O_DIRECT)\n', "OSError: [Errno 13]
Permission denied: '/var/lib/nova/instances/.directio.test'\n"]</div>
<div>2013-07-24 11:22:38.103 ERROR nova.compute.manager
[req-26522972-c8be-4be5-83d1-f45412718d94
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] Instance failed to
spawn</div>
<div>2013-07-24 11:22:50.791 1685 ERROR nova.virt.libvirt.driver [-]
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 11:22:50.925 ERROR nova.compute.manager
[req-26522972-c8be-4be5-83d1-f45412718d94
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3/'\n"]</div>
<div>2013-07-24 11:26:00.874 ERROR nova.compute.manager
[req-43b99187-3d4b-4f42-8ee5-eab58a448d05
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] Instance failed to
spawn</div>
<div>2013-07-24 11:27:07.567 ERROR nova.compute.manager
[req-43b99187-3d4b-4f42-8ee5-eab58a448d05
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/b60db5a8-92ea-4a81-bd53-d73dc2019b0b/'\n"]</div>
<div>2013-07-24 11:27:08.045 ERROR nova.openstack.common.rpc.amqp
[req-43b99187-3d4b-4f42-8ee5-eab58a448d05
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
Exception during message handling</div>
<div>2013-07-24 11:34:02.320 1685 ERROR nova.virt.libvirt.driver [-]
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 11:38:23.618 ERROR nova.compute.manager
[req-d9052cd7-12d2-4df6-94c2-4ed3891e6bbb
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 69a2c512-bea1-46de-91be-c33a07799981] Instance failed to
spawn</div>
<div>2013-07-24 11:38:49.087 1685 ERROR nova.virt.libvirt.driver [-]
[instance: 69a2c512-bea1-46de-91be-c33a07799981] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 11:38:49.220 ERROR nova.compute.manager
[req-d9052cd7-12d2-4df6-94c2-4ed3891e6bbb
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 69a2c512-bea1-46de-91be-c33a07799981] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn\n admin_pass=admin_password)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image\n
fileutils.ensure_tree(basepath(suffix=\'\'))\n', ' File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree\n os.makedirs(path)\n', '
File "/usr/lib/python2.7/os.py", line 157, in makedirs\n
mkdir(name, mode)\n', "OSError: [Errno 13] Permission denied:
'/var/lib/nova/instances/69a2c512-bea1-46de-91be-c33a07799981/'\n"]</div>
<div>2013-07-24 11:41:15.017 1685 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 12:45:36.353 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 13:13:09.224 ERROR nova.virt.libvirt.driver
[req-4d081c1f-ad11-4b89-904d-700291b47894
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
Error on '/var/lib/nova/instances' while checking direct I/O: '[Errno
13] Permission denied: '/var/lib/nova/instances/.directio.test''</div>
<div>2013-07-24 13:13:09.225 ERROR nova.compute.manager
[req-4d081c1f-ad11-4b89-904d-700291b47894
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: f105be37-d5d9-4234-ba4e-3897d60e97bb] Instance failed to
spawn</div>
<div>2013-07-24 13:13:21.636 1694 ERROR nova.virt.libvirt.driver [-]
[instance: f105be37-d5d9-4234-ba4e-3897d60e97bb] During wait destroy,
instance disappeared.</div>
<div>2013-07-24 13:13:21.729 ERROR nova.compute.manager
[req-4d081c1f-ad11-4b89-904d-700291b47894
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: f105be37-d5d9-4234-ba4e-3897d60e97bb] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1510, in spawn\n block_device_info=block_device_info)\n',
' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2326, in to_xml\n disk_info, rescue,
block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2244, in get_guest_config\n inst_type):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2051, in get_guest_storage_config\n inst_type)\n', '
File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2013, in get_guest_disk_config\n self.disk_cachemode,\n',
' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
355, in disk_cachemode\n if not
self._supports_direct_io(CONF.instances_path):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1676, in _supports_direct_io\n {\'path\': dirpath,
\'ex\': str(e)})\n', ' File "/usr/lib/python2.7/contextlib.py",
line 24, in __exit__\n self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1663, in _supports_direct_io\n f = os.open(testfile,
os.O_CREAT | os.O_WRONLY | os.O_DIRECT)\n', "OSError: [Errno 13]
Permission denied: '/var/lib/nova/instances/.directio.test'\n"]</div>
<div>2013-07-24 13:25:36.702 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 14:05:37.095 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 14:45:37.319 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 14:47:05.364 ERROR nova.compute.manager
[req-4b74d886-c5cc-4e28-ac42-824ba815f7ac
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 748277e2-e3b5-4385-9c0e-c8e0ddefa601] Instance failed to
spawn</div>
<div>2013-07-24 14:47:26.986 ERROR nova.compute.manager
[req-4b74d886-c5cc-4e28-ac42-824ba815f7ac
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 748277e2-e3b5-4385-9c0e-c8e0ddefa601] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-748277e2-e3b5-4385-9c0e-c8e0ddefa601'\n"]</div>
<div>2013-07-24 15:25:37.532 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 16:05:37.847 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 16:14:39.249 ERROR nova.compute.manager
[req-e0716278-f864-4f70-962a-bf74559fc4c9
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 23cf38cc-797e-40f2-a995-6e181493c913] Instance failed to
spawn</div>
<div>2013-07-24 16:14:54.459 ERROR nova.compute.manager
[req-e0716278-f864-4f70-962a-bf74559fc4c9
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 23cf38cc-797e-40f2-a995-6e181493c913] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-23cf38cc-797e-40f2-a995-6e181493c913'\n"]</div>
<div>2013-07-24 16:43:47.486 ERROR nova.compute.manager
[req-5d9b9575-a6eb-4324-b975-78dba69c24ef
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 00497f97-a0fe-4a51-b7f6-6901d0d34791] Instance failed to
spawn</div>
<div>2013-07-24 16:43:58.434 ERROR nova.compute.manager
[req-5d9b9575-a6eb-4324-b975-78dba69c24ef
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 00497f97-a0fe-4a51-b7f6-6901d0d34791] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-00497f97-a0fe-4a51-b7f6-6901d0d34791'\n"]</div>
<div>2013-07-24 16:46:43.408 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 17:26:43.627 1694 ERROR nova.manager [-] Error during
ComputeManager._run_image_cache_manager_pass: [Errno 13] Permission
denied: '/var/lock/nova'</div>
<div>2013-07-24 17:47:46.003 ERROR nova.compute.manager
[req-370ac716-203d-43aa-a146-709297c715b3
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 8a4e0c84-07ec-40ab-9585-5433dff92b64] Instance failed to
spawn</div>
<div>2013-07-24 17:47:55.194 ERROR nova.compute.manager
[req-370ac716-203d-43aa-a146-709297c715b3
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 8a4e0c84-07ec-40ab-9585-5433dff92b64] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-8a4e0c84-07ec-40ab-9585-5433dff92b64'\n"]</div>
<div>2013-07-24 17:53:42.789 ERROR nova.compute.manager
[req-153949aa-d5a7-473f-b79b-38616ae77441
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: d3bfc215-7e24-40d2-b6f9-a1542a2b9d05] Instance failed to
spawn</div>
<div>2013-07-24 17:54:05.061 ERROR nova.compute.manager
[req-153949aa-d5a7-473f-b79b-38616ae77441
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: d3bfc215-7e24-40d2-b6f9-a1542a2b9d05] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-d3bfc215-7e24-40d2-b6f9-a1542a2b9d05'\n"]</div>
<div>2013-07-24 18:05:44.677 ERROR nova.compute.manager
[req-60486a96-54a1-4472-846b-b57209c68921
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 005f7640-a8ce-429a-ba91-85e7db1d86ac] Instance failed to
spawn</div>
<div>2013-07-24 18:06:14.408 ERROR nova.compute.manager
[req-60486a96-54a1-4472-846b-b57209c68921
c402785616534f2096b34ce132b7d3f2 d532a4fc2e9e4b5f83b6dec7085237e5]
[instance: 005f7640-a8ce-429a-ba91-85e7db1d86ac] Error: ['Traceback
(most recent call last):\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834,
in _run_instance\n set_access_ip=set_access_ip)\n', '
File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
line 1093, in _spawn\n LOG.exception(_(\'Instance failed
to spawn\'), instance=instance)\n', ' File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n
self.gen.next()\n', ' File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1520, in spawn\n block_device_info)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2435, in _create_domain_and_network\n domain =
self._create_domain(xml, instance=instance)\n', ' File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2396, in _create_domain\n
domain.createWithFlags(launch_flags)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
doit\n result = proxy_call(self._autowrap, f, *args,
**kwargs)\n', ' File
"/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
proxy_call\n rv = execute(f,*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line
76, in tworker\n rv = meth(*args,**kwargs)\n', '
File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in
createWithFlags\n if ret == -1: raise libvirtError
(\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError:
internal error cannot load AppArmor profile
'libvirt-005f7640-a8ce-429a-ba91-85e7db1d86ac'\n"]</div></div>
<div><br></div>
<div><br></div>
<div>
<div>cat /var/log/nova/nova-*.log | grep -E TRACE</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager Traceback (most
recent call last):</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/manager.py", line 241, in
periodic_tasks</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager
task(self, context)</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4007,
in _run_image_cache_manager_pass</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager
storage_users.register_storage_use(CONF.instances_path,
CONF.host)</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 228, in inner</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager
retval = f(*args, **kwargs)</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/virt/storage_users.py", line
44, in register_storage_use</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager
with open(id_path, 'w') as f:</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager IOError: [Errno
13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 08:03:57.262 1820 TRACE nova.manager </div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager Traceback (most
recent call last):</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/manager.py", line 241, in
periodic_tasks</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager
task(self, context)</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4007,
in _run_image_cache_manager_pass</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager
storage_users.register_storage_use(CONF.instances_path,
CONF.host)</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 228, in inner</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager
retval = f(*args, **kwargs)</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/virt/storage_users.py", line
44, in register_storage_use</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager
with open(id_path, 'w') as f:</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager IOError: [Errno
13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 08:43:57.655 1820 TRACE nova.manager </div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager Traceback (most
recent call last):</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/manager.py", line 241, in
periodic_tasks</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager
task(self, context)</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4007,
in _run_image_cache_manager_pass</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager
storage_users.register_storage_use(CONF.instances_path,
CONF.host)</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 228, in inner</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager
retval = f(*args, **kwargs)</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/virt/storage_users.py", line
44, in register_storage_use</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager
with open(id_path, 'w') as f:</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager IOError: [Errno
13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 09:23:57.816 1820 TRACE nova.manager </div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager Traceback (most
recent call last):</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/manager.py", line 241, in
periodic_tasks</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager
task(self, context)</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4007,
in _run_image_cache_manager_pass</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager
storage_users.register_storage_use(CONF.instances_path,
CONF.host)</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 228, in inner</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager
retval = f(*args, **kwargs)</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/virt/storage_users.py", line
44, in register_storage_use</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager
with open(id_path, 'w') as f:</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager IOError: [Errno
13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 10:03:57.993 1820 TRACE nova.manager </div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] Traceback (most
recent call last):</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc]
block_device_info)</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc]
admin_pass=admin_password)</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc]
fileutils.ensure_tree(basepath(suffix=''))</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc]
os.makedirs(path)</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] File
"/usr/lib/python2.7/os.py", line 157, in makedirs</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc]
mkdir(name, mode)</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] OSError: [Errno 13]
Permission denied:
'/var/lib/nova/instances/55215431-0a42-4fc8-a642-c08d3cc5e2bc/'</div>
<div>2013-07-24 10:20:21.767 1820 TRACE nova.compute.manager
[instance: 55215431-0a42-4fc8-a642-c08d3cc5e2bc] </div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] Traceback (most
recent call last):</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd]
block_device_info)</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd]
admin_pass=admin_password)</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd]
fileutils.ensure_tree(basepath(suffix=''))</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd]
os.makedirs(path)</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] File
"/usr/lib/python2.7/os.py", line 157, in makedirs</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd]
mkdir(name, mode)</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] OSError: [Errno 13]
Permission denied:
'/var/lib/nova/instances/ca733a02-766e-46e1-9a15-bd2a12b10ebd/'</div>
<div>2013-07-24 10:33:17.279 1820 TRACE nova.compute.manager
[instance: ca733a02-766e-46e1-9a15-bd2a12b10ebd] </div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] Traceback (most
recent call last):</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73]
block_device_info)</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73]
admin_pass=admin_password)</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73]
fileutils.ensure_tree(basepath(suffix=''))</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73]
os.makedirs(path)</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] File
"/usr/lib/python2.7/os.py", line 157, in makedirs</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73]
mkdir(name, mode)</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] OSError: [Errno 13]
Permission denied:
'/var/lib/nova/instances/3b15a4e9-fb2c-452a-8045-16d1f58ebf73/'</div>
<div>2013-07-24 10:40:26.722 1820 TRACE nova.compute.manager
[instance: 3b15a4e9-fb2c-452a-8045-16d1f58ebf73] </div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager Traceback (most
recent call last):</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/manager.py", line 241, in
periodic_tasks</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager
task(self, context)</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4007,
in _run_image_cache_manager_pass</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager
storage_users.register_storage_use(CONF.instances_path,
CONF.host)</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 228, in inner</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager
retval = f(*args, **kwargs)</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager File
"/usr/lib/python2.7/dist-packages/nova/virt/storage_users.py", line
44, in register_storage_use</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager
with open(id_path, 'w') as f:</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager IOError: [Errno
13] Permission denied: '/var/lib/nova/instances/compute_nodes'</div>
<div>2013-07-24 10:43:58.194 1820 TRACE nova.manager </div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] Traceback (most
recent call last):</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
block_device_info)</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1510, in spawn</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
block_device_info=block_device_info)</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2326, in to_xml</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
disk_info, rescue, block_device_info)</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2244, in get_guest_config</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
inst_type):</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2051, in get_guest_storage_config</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
inst_type)</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
2013, in get_guest_disk_config</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
self.disk_cachemode,</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
355, in disk_cachemode</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] if not
self._supports_direct_io(CONF.instances_path):</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1676, in _supports_direct_io</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
{'path': dirpath, 'ex': str(e)})</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/contextlib.py", line 24, in __exit__</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d]
self.gen.next()</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1663, in _supports_direct_io</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] f =
os.open(testfile, os.O_CREAT | os.O_WRONLY | os.O_DIRECT)</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] OSError: [Errno 13]
Permission denied: '/var/lib/nova/instances/.directio.test'</div>
<div>2013-07-24 11:03:19.658 1685 TRACE nova.compute.manager
[instance: 40c3fb5c-61d9-491a-9bfa-cac824a2887d] </div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] Traceback (most
recent call last):</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3]
block_device_info)</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3]
admin_pass=admin_password)</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3]
fileutils.ensure_tree(basepath(suffix=''))</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3]
os.makedirs(path)</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] File
"/usr/lib/python2.7/os.py", line 157, in makedirs</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3]
mkdir(name, mode)</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] OSError: [Errno 13]
Permission denied:
'/var/lib/nova/instances/fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3/'</div>
<div>2013-07-24 11:22:38.103 1685 TRACE nova.compute.manager
[instance: fd3ab09d-fc9f-4ee9-b5f5-72540893ecd3] </div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] Traceback (most
recent call last):</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089,
in _spawn</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b]
block_device_info)</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1517, in spawn</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b]
admin_pass=admin_password)</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] File
"/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line
1748, in _create_image</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b]
fileutils.ensure_tree(basepath(suffix=''))</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/fileutils.py",
line 29, in ensure_tree</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b]
os.makedirs(path)</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] File
"/usr/lib/python2.7/os.py", line 157, in makedirs</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b]
mkdir(name, mode)</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] OSError: [Errno 13]
Permission denied:
'/var/lib/nova/instances/b60db5a8-92ea-4a81-bd53-d73dc2019b0b/'</div>
<div>2013-07-24 11:26:00.874 1685 TRACE nova.compute.manager
[instance: b60db5a8-92ea-4a81-bd53-d73dc2019b0b] </div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
Traceback (most recent call last):</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py",
line 430, in _process_data</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
rval = self.proxy.dispatch(ctxt, version, method,
**args)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py",
line 133, in dispatch</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
return getattr(proxyobj, method)(ctxt, **kwargs)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/dist-packages/nova/exception.py", line
117, in wrapped</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
temp_level, payload)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/contextlib.py", line 24, in
__exit__</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
self.gen.next()</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/dist-packages/nova/exception.py", line
94, in wrapped</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
return f(self, context, *args, **kw)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 209,
in decorated_function</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
pass</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/contextlib.py", line 24, in
__exit__</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
self.gen.next()</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 195,
in decorated_function</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
return function(self, context, *args, **kwargs)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260,
in decorated_function</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
function(self, context, *args, **kwargs)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237,
in decorated_function</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
e, sys.exc_info())</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/contextlib.py", line 24, in
__exit__</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
self.gen.next()</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224,
in decorated_function</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
return function(self, context, *args, **kwargs)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1210,
in run_instance</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
do_run_instance()</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py",
line 242, in inner</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
retval = f(*args, **kwargs)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1209,
in do_run_instance</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
admin_password, is_first_time, node, instance)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 865,
in _run_instance</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
self._set_instance_error_state(context,
instance['uuid'])</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File "/usr/lib/python2.7/contextlib.py", line 24, in
__exit__</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
self.gen.next()</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
"/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 857,
in _run_instance</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
filter_properties, bdms)</div>
<div>2013-07-24 11:27:08.045 1685 TRACE nova.openstack.common.rpc.amqp
File
</div></div></div></font></div></div></blockquote></div></div></font></div></div></blockquote></div></blockquote></div></div></blockquote></div></div></font></div></div></blockquote></div></div></font></div></div>
</blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div>
</blockquote></div></blockquote></div></div></div>...<br><br>[Mensagem reduzida] </blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
_______________________________________________<br>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div></blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div></div></blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote></div><br></div>