[Openstack-operators] Cannot create Instances

Steven Barnabas sbarnabas at frontporch.com
Mon Mar 18 21:33:48 UTC 2013


Ok, the URL where my Image was located was down.  Thanks for the tip.  Now, when I try to create my instance I get further than I did before.  It actually says its "Spawning" and it was in that state for about 10 min and then I got another Error in status.  When I check my nova-compute log, I see this:

2013-03-18 14:25:00 23291 ERROR nova.openstack.common.rpc.common [-] Returning exception Instance instance-00000013 could not be found. to caller
2013-03-18 14:25:00 23291 ERROR nova.openstack.common.rpc.common [-] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data\n    rval = self.proxy.dispatch(ctxt, version, method, **args)\n', '  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch\n    return getattr(proxyobj, method)(ctxt, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n    temp_level, payload)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n    return f(*args, **kw)\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 190, in decorated_function\n    return function(self, context, *args, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1924, in get_console_output\n    output = self.driver.get_console_output(instance)\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n    temp_level, payload)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n    return f(*args, **kw)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1123, in get_console_output\n    virt_dom = self._lookup_by_name(instance[\'name\'])\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1880, in _lookup_by_name\n    raise exception.InstanceNotFound(instance_id=instance_name)\n', 'InstanceNotFound: Instance instance-00000013 could not be found.\n']
2013-03-18 14:25:02 23291 DEBUG nova.openstack.common.rpc.amqp [-] received {u'_context_roles': [u'KeystoneAdmin', u'admin', u'KeystoneServiceAdmin'], u'_msg_id': u'702b8cfb33954f8ea1b8301cd58129bf', u'_context_quota_class': None, u'_context_request_id': u'req-8b5721fb-5cd9-44ed-b9c6-1395f208cc86', u'_context_service_catalog': [{u'endpoints': [{u'adminURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92', u'id': u'e5a407fe88ba48388a33d16827dccd56', u'publicURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92'}], u'endpoints_links': [], u'type': u'compute', u'name': u'nova'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:9696/', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:9696/', u'id': u'68feec81b17b4635ad5a4ea4854fd4e6', u'publicURL': u'http://192.168.0.1:9696/'}], u'endpoints_links': [], u'type': u'network', u'name': u'quantum'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:9292/v2', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:9292/v2', u'id': u'997a29b8b00247a4ad6be89012d0f88e', u'publicURL': u'http://192.168.0.1:9292/v2'}], u'endpoints_links': [], u'type': u'image', u'name': u'glance'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92', u'id': u'f73dfee83bc54a10a21ea57200a71dec', u'publicURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92'}], u'endpoints_links': [], u'type': u'volume', u'name': u'cinder'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:8773/services/Admin', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:8773/services/Cloud', u'id': u'a183ab5aa7314edf904e962a03db6f83', u'publicURL': u'http://192.168.0.1:8773/services/Cloud'}], u'endpoints_links': [], u'type': u'ec2', u'name': u'ec2'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:8080/v1', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:8080/v1/AUTH_fd28b03caed749d8b8b014ec350d9f92', u'id': u'e7e86ca473f44fe8834b2af0dff526da', u'publicURL': u'http://192.168.0.1:8080/v1/AUTH_fd28b03caed749d8b8b014ec350d9f92'}], u'endpoints_links': [], u'type': u'object-store', u'name': u'swift'}, {u'endpoints': [{u'adminURL': u'http://192.168.0.1:35357/v2.0', u'region': u'RegionOne', u'internalURL': u'http://192.168.0.1:5000/v2.0', u'id': u'03cf80121bdf4bba8eef07481d24023d', u'publicURL': u'http://192.168.0.1:5000/v2.0'}], u'endpoints_links': [], u'type': u'identity', u'name': u'keystone'}], u'_context_user_name': u'admin', u'_context_auth_token': '<SANITIZED>', u'args': {u'instance': {u'vm_state': u'error', u'availability_zone': None, u'terminated_at': None, u'ephemeral_gb': 160, u'instance_type_id': 6, u'user_data': None, u'vm_mode': None, u'deleted_at': None, u'reservation_id': u'r-qajsvfdc', u'id': 19, u'security_groups': [{u'deleted_at': None, u'user_id': u'aa0e0626b30140fd87f26225a202bf58', u'name': u'default', u'deleted': False, u'created_at': u'2013-02-28T01:24:01.000000', u'updated_at': None, u'rules': [{u'from_port': 22, u'protocol': u'tcp', u'group_id': None, u'deleted': False, u'created_at': u'2013-02-28T01:27:17.000000', u'updated_at': None, u'to_port': 22, u'parent_group_id': 1, u'cidr': u'0.0.0.0/0', u'deleted_at': None, u'id': 1}, {u'from_port': 0, u'protocol': u'icmp', u'group_id': None, u'deleted': False, u'created_at': u'2013-02-28T01:31:00.000000', u'updated_at': None, u'to_port': 8, u'parent_group_id': 1, u'cidr': u'0.0.0.0/0', u'deleted_at': None, u'id': 2}, {u'from_port': 3389, u'protocol': u'tcp', u'group_id': None, u'deleted': False, u'created_at': u'2013-02-28T01:31:12.000000', u'updated_at': None, u'to_port': 3389, u'parent_group_id': 1, u'cidr': u'0.0.0.0/0', u'deleted_at': None, u'id': 3}], u'project_id': u'fd28b03caed749d8b8b014ec350d9f92', u'id': 1, u'description': u'default'}], u'disable_terminate': False, u'user_id': u'aa0e0626b30140fd87f26225a202bf58', u'uuid': u'fa60c6af-d79c-49da-8972-1b9cbd5f5b1b', u'server_name': None, u'default_swap_device': None, u'info_cache': {u'instance_uuid': u'fa60c6af-d79c-49da-8972-1b9cbd5f5b1b', u'deleted': False, u'created_at': u'2013-03-18T21:13:57.000000', u'updated_at': u'2013-03-18T21:23:26.000000', u'network_info': u'[]', u'deleted_at': None, u'id': 19}, u'hostname': u'porchlight7', u'launched_on': u'FPCompute', u'display_description': u'Porchlight7', u'key_data': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAAgQCwnoxl9FvGcrbBj43nXFa6wo9/UB2mAXoFvzT9sHWqo4t28jS1gmXfG5ODALyenysa8o+SYpLvSdMolGuCq2PNnOkf9UWwOYRG55hbTDFhw6RADGwqtrOYnuH3Osx8xFjqFO336k6tuMl1B0SFLxhsDvHuxpGTxSYr1TqatmOKtQ== Generated by Nova\n', u'kernel_id': u'', u'power_state': 0, u'default_ephemeral_device': u'/dev/vdb', u'progress': 0, u'project_id': u'fd28b03caed749d8b8b014ec350d9f92', u'launched_at': None, u'scheduled_at': u'2013-03-18T21:13:57.000000', u'ramdisk_id': u'', u'access_ip_v6': None, u'access_ip_v4': None, u'deleted': False, u'key_name': u'PorchLight', u'updated_at': u'2013-03-18T21:22:47.000000', u'host': u'FPCompute', u'display_name': u'Porchlight7', u'task_state': None, u'shutdown_terminate': False, u'architecture': None, u'root_gb': 10, u'locked': False, u'name': u'instance-00000013', u'created_at': u'2013-03-18T21:13:57.000000', u'launch_index': 0, u'metadata': [], u'memory_mb': 16384, u'instance_type': {u'disabled': False, u'root_gb': 10, u'deleted_at': None, u'name': u'Porchlight', u'deleted': False, u'created_at': u'2013-03-14T22:43:51.000000', u'ephemeral_gb': 160, u'updated_at': None, u'memory_mb': 16384, u'vcpus': 4, u'swap': 0, u'rxtx_factor': 1.0, u'is_public': True, u'flavorid': u'6', u'vcpu_weight': None, u'id': 6}, u'vcpus': 4, u'image_ref': u'9e57504f-4267-43d2-ab00-47a51084d1b6', u'root_device_name': u'/dev/vda', u'auto_disk_config': None, u'os_type': None, u'config_drive': u''}, u'console_type': u'novnc'}, u'_context_instance_lock_checked': False, u'_context_project_name': u'admin', u'_context_is_admin': True, u'version': u'2.0', u'_context_project_id': u'fd28b03caed749d8b8b014ec350d9f92', u'_context_timestamp': u'2013-03-18T21:25:02.960018', u'_context_read_deleted': u'no', u'_context_user_id': u'aa0e0626b30140fd87f26225a202bf58', u'method': u'get_vnc_console', u'_context_remote_address': u'192.168.0.1'} _safe_log /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/common.py:195
2013-03-18 14:25:02 23291 DEBUG nova.openstack.common.rpc.amqp [-] unpacked context: {'project_name': u'admin', 'user_id': u'aa0e0626b30140fd87f26225a202bf58', 'roles': [u'KeystoneAdmin', u'admin', u'KeystoneServiceAdmin'], 'timestamp': u'2013-03-18T21:25:02.960018', 'auth_token': '<SANITIZED>', 'remote_address': u'192.168.0.1', 'quota_class': None, 'is_admin': True, 'service_catalog': [{u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92', u'internalURL': u'http://192.168.0.1:8774/v2/fd28b03caed749d8b8b014ec350d9f92', u'id': u'e5a407fe88ba48388a33d16827dccd56'}], u'type': u'compute', u'name': u'nova'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:9696/', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:9696/', u'internalURL': u'http://192.168.0.1:9696/', u'id': u'68feec81b17b4635ad5a4ea4854fd4e6'}], u'type': u'network', u'name': u'quantum'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:9292/v2', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:9292/v2', u'internalURL': u'http://192.168.0.1:9292/v2', u'id': u'997a29b8b00247a4ad6be89012d0f88e'}], u'type': u'image', u'name': u'glance'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92', u'internalURL': u'http://192.168.0.1:8776/v1/fd28b03caed749d8b8b014ec350d9f92', u'id': u'f73dfee83bc54a10a21ea57200a71dec'}], u'type': u'volume', u'name': u'cinder'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:8773/services/Admin', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:8773/services/Cloud', u'internalURL': u'http://192.168.0.1:8773/services/Cloud', u'id': u'a183ab5aa7314edf904e962a03db6f83'}], u'type': u'ec2', u'name': u'ec2'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:8080/v1', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:8080/v1/AUTH_fd28b03caed749d8b8b014ec350d9f92', u'internalURL': u'http://192.168.0.1:8080/v1/AUTH_fd28b03caed749d8b8b014ec350d9f92', u'id': u'e7e86ca473f44fe8834b2af0dff526da'}], u'type': u'object-store', u'name': u'swift'}, {u'endpoints_links': [], u'endpoints': [{u'adminURL': u'http://192.168.0.1:35357/v2.0', u'region': u'RegionOne', u'publicURL': u'http://192.168.0.1:5000/v2.0', u'internalURL': u'http://192.168.0.1:5000/v2.0', u'id': u'03cf80121bdf4bba8eef07481d24023d'}], u'type': u'identity', u'name': u'keystone'}], 'request_id': u'req-8b5721fb-5cd9-44ed-b9c6-1395f208cc86', 'instance_lock_checked': False, 'project_id': u'fd28b03caed749d8b8b014ec350d9f92', 'user_name': u'admin', 'read_deleted': u'no'} _safe_log /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/common.py:195
2013-03-18 14:25:02 DEBUG nova.compute.manager [req-8b5721fb-5cd9-44ed-b9c6-1395f208cc86 aa0e0626b30140fd87f26225a202bf58 fd28b03caed749d8b8b014ec350d9f92] [instance: fa60c6af-d79c-49da-8972-1b9cbd5f5b1b] Getting vnc console get_vnc_console /usr/lib/python2.7/dist-packages/nova/compute/manager.py:1947
2013-03-18 14:25:02 23291 ERROR nova.openstack.common.rpc.amqp [-] Exception during message handling
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     rval = self.proxy.dispatch(ctxt, version, method, **args)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     return getattr(proxyobj, method)(ctxt, **kwargs)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     temp_level, payload)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     return f(*args, **kw)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 190, in decorated_function
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1961, in get_vnc_console
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     connect_info = self.driver.get_vnc_console(instance)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     temp_level, payload)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     return f(*args, **kw)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1200, in get_vnc_console
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     port = get_vnc_port_for_instance(instance['name'])
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1191, in get_vnc_port_for_instance
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     virt_dom = self._lookup_by_name(instance_name)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1880, in _lookup_by_name
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp     raise exception.InstanceNotFound(instance_id=instance_name)
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp InstanceNotFound: Instance instance-00000013 could not be found.
2013-03-18 14:25:02 23291 TRACE nova.openstack.common.rpc.amqp
2013-03-18 14:25:02 23291 ERROR nova.openstack.common.rpc.common [-] Returning exception Instance instance-00000013 could not be found. to caller
2013-03-18 14:25:02 23291 ERROR nova.openstack.common.rpc.common [-] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data\n    rval = self.proxy.dispatch(ctxt, version, method, **args)\n', '  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch\n    return getattr(proxyobj, method)(ctxt, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n    temp_level, payload)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n    return f(*args, **kw)\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 190, in decorated_function\n    return function(self, context, *args, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1961, in get_vnc_console\n    connect_info = self.driver.get_vnc_console(instance)\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n    temp_level, payload)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', '  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n    return f(*args, **kw)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1200, in get_vnc_console\n    port = get_vnc_port_for_instance(instance[\'name\'])\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1191, in get_vnc_port_for_instance\n    virt_dom = self._lookup_by_name(instance_name)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1880, in _lookup_by_name\n    raise exception.InstanceNotFound(instance_id=instance_name)\n', 'InstanceNotFound: Instance instance-00000013 could not be found.\n']



Did it just time out?


Steven Barnabas
Network Engineer
Front Porch, Inc.
209-288-5580
209-652-7733 mobile
www.frontporch.com<http://www.frontporch.com/>



On Mar 14, 2013, at 8:51 PM, Steven Barnabas <sbarnabas at frontporch.com<mailto:sbarnabas at frontporch.com>> wrote:

Thanks Mike, I will check this out on Monday when I get back into work.  I'll make sure to get that log for you.

Sent from my iPhone

On Mar 14, 2013, at 6:27 PM, "Michael Still" <mikal at stillhq.com<mailto:mikal at stillhq.com>> wrote:

On Thu, Mar 14, 2013 at 7:25 PM, Steven Barnabas
<sbarnabas at frontporch.com<mailto:sbarnabas at frontporch.com>> wrote:

[snip]

File "/usr/lib
/python2.7/dist-packages/glanceclient/common/http.py", line 158, in
_http_request\n    raise exc.from_response(resp)\n',
'HTTPInternalServerError: HTTPInternalServerError (HTTP 500)\n']

I have been trying to figure this out for 2 weeks now.  I don't know what I
am doing wrong.  Any help would be appreciated.  I can get any other info
needed also.

It looks like glance is returning a 500 error for your image fetch
requests. I'd try the following things:

- source a valid novarc file
- does a "glance index" work?
- what about a "glance image-download <uuid of image>"?

Either way, I think I need to see the glance log to debug any further.

Cheers,
Michael



_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130318/68b4f412/attachment.html>


More information about the OpenStack-operators mailing list