<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; "><div>Hi</div><div><br></div><div>We have deployed 2 x Controller and 8 x Compute nodes.</div><div><br></div><div>The controllers run everything in HA behind HAProxy – Except MySQL (MySQL is standalone on controller0)</div><div><br></div><div>When issuing nova boot then the following work fine :</div><div><br></div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute0</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute2</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute4</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute6</div><div><br></div><div>However the following fail :</div><div><br></div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute1</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute3</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute5</div><div>nova boot --flavor 3 --user_data /srv/install_salt --image 02e7425f-a71b-4e5f-b480-eafeebbbeda3 --key_name root_salt-master --nic net-id=d7742ca3-e7d8-4a41-ba53-a33c145f9243 stage-webserver-12 --availability-zone nova:compute7</div><div><br></div><div>With the failure I get the following stack trace :</div><div><br></div><div><div>+-------------------------------------+---------------------------------------------------------------------------------------------------------+</div><div>| Property                            | Value                                                                                                   |</div><div>+-------------------------------------+---------------------------------------------------------------------------------------------------------+</div><div>| status                              | ERROR                                                                                                   |</div><div>| updated                             | 2013-08-23T21:19:52Z                                                                                    |</div><div>| OS-EXT-STS:task_state               | None                                                                                                    |</div><div>| OS-EXT-SRV-ATTR:host                | None                                                                                                    |</div><div>| key_name                            | root_salt-master                                                                                        |</div><div>| image                               | Ubuntu 13.04 amd64 (02e7425f-a71b-4e5f-b480-eafeebbbeda3)                                               |</div><div>| hostId                              |                                                                                                         |</div><div>| OS-EXT-STS:vm_state                 | error                                                                                                   |</div><div>| OS-EXT-SRV-ATTR:instance_name       | instance-000001c3                                                                                       |</div><div>| OS-EXT-SRV-ATTR:hypervisor_hostname | None                                                                                                    |</div><div>| flavor                              | m1.medium (3)                                                                                           |</div><div>| id                                  | 496a9ad5-c511-4641-a086-ad8fd2177952                                                                    |</div><div>| user_id                             | b7818872f0e84537a978e7df0c453924                                                                        |</div><div>| name                                | stage-webserver-12                                                                                      |</div><div>| created                             | 2013-08-23T21:19:51Z                                                                                    |</div><div>| tenant_id                           | 59a2d92051fe417f90539622d61951d0                                                                        |</div><div>| OS-DCF:diskConfig                   | MANUAL                                                                                                  |</div><div>| metadata                            | {}                                                                                                      |</div><div>| accessIPv4                          |                                                                                                         |</div><div>| accessIPv6                          |                                                                                                         |</div><div>| fault                               | {u'message': u'HTTPInternalServerError', u'code': 500, u'details': u'HTTPInternalServerError (HTTP 500) |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function      |</div><div>|                                     |     return function(self, context, *args, **kwargs)                                                     |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1224, in run_instance           |</div><div>|                                     |     do_run_instance()                                                                                   |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 242, in inner        |</div><div>|                                     |     retval = f(*args, **kwargs)                                                                         |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1223, in do_run_instance        |</div><div>|                                     |     admin_password, is_first_time, node, instance)                                                      |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 879, in _run_instance           |</div><div>|                                     |     self._set_instance_error_state(context, instance[\'uuid\'])                                         |</div><div>|                                     |   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__                                         |</div><div>|                                     |     self.gen.next()                                                                                     |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 800, in _run_instance           |</div><div>|                                     |     image_meta = self._check_image_size(context, instance)                                              |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1006, in _check_image_size      |</div><div>|                                     |     image_meta = _get_image_meta(context, instance[\'image_ref\'])                                      |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 268, in _get_image_meta         |</div><div>|                                     |     return image_service.show(context, image_id)                                                        |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 240, in show                       |</div><div>|                                     |     _reraise_translated_image_exception(image_id)                                                       |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 238, in show                       |</div><div>|                                     |     image = self._client.call(context, 1, \'get\', image_id)                                            |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 183, in call                       |</div><div>|                                     |     return getattr(client.images, method)(*args, **kwargs)                                              |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 104, in get                   |</div><div>|                                     |     % urllib.quote(image_id))                                                                           |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 260, in raw_request         |</div><div>|                                     |     return self._http_request(url, method, **kwargs)                                                    |</div><div>|                                     |   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 221, in _http_request       |</div><div>|                                     |     raise exc.from_response(resp, body_str)                                                             |</div><div>|                                     | ', u'created': u'2013-08-23T21:19:52Z'}                                                                 |</div><div>| OS-EXT-STS:power_state              | 0                                                                                                       |</div><div>| OS-EXT-AZ:availability_zone         | nova                                                                                                    |</div><div>| config_drive                        |                                                                                                         |</div><div>+-------------------------------------+---------------------------------------------------------------------------------------------------------+</div></div><div><br></div><div>The odd thing is if I use horizon to boot 14 instances then they end up on compute0 – 7, and they all work perfectly.</div><div><br></div><div>I am using the same credentials in Horizon and Nova.</div><div><br></div><div>Thanks</div></body></html>