[openstack-dev] [Savanna] error in cluster launch: instance count gets to three, status=waiting, before going to error status

kesten broughton kesten.broughton at gmail.com
Tue Sep 17 19:15:40 UTC 2013


I have applied the proposed patch for the setattr launch error


I patch works, but the launch still fails.

The stack trace just says the creation failed.


127.0.0.1 - - [16/Sep/2013 12:21:20] "POST
/v1.0/2c8b2627a169458e8ab875690a51eabd/clusters HTTP/1.1" 202 1877
1.441746
2013-09-16 12:21:42.592 47355 WARNING savanna.service.instances [-]
Can't start cluster 'cluster-1' (reason: node cluster-1-workers-002
has error status)
2013-09-16 12:21:51.369 47355 ERROR savanna.context [-] Thread
'cluster-creating-057ae8f2-ce41-4508-9696-3affe064178d' fails with
exception: 'node cluster-1-workers-002 has error status'
2013-09-16 12:21:51.369 47355 TRACE savanna.context Traceback (most
recent call last):
2013-09-16 12:21:51.369 47355 TRACE savanna.context   File
"/home/stack/savanna-venv/local/lib/python2.7/site-packages/savanna/context.py",
line 93, in wrapper
2013-09-16 12:21:51.369 47355 TRACE savanna.context     func(*args, **kwargs)
2013-09-16 12:21:51.369 47355 TRACE savanna.context   File
"/home/stack/savanna-venv/local/lib/python2.7/site-packages/savanna/service/api.py",
line 137, in _provision_cluster
2013-09-16 12:21:51.369 47355 TRACE savanna.context
i.create_cluster(cluster)
2013-09-16 12:21:51.369 47355 TRACE savanna.context   File
"/home/stack/savanna-venv/local/lib/python2.7/site-packages/savanna/service/instances.py",
line 63, in create_cluster
2013-09-16 12:21:51.369 47355 TRACE savanna.context
_rollback_cluster_creation(cluster, ex)
2013-09-16 12:21:51.369 47355 TRACE savanna.context   File
"/home/stack/savanna-venv/local/lib/python2.7/site-packages/savanna/openstack/common/excutils.py",
line 70, in __exit__
2013-09-16 12:21:51.369 47355 TRACE savanna.context
six.reraise(self.type_, self.value, self.tb)
2013-09-16 12:21:51.369 47355 TRACE savanna.context   File
"/home/stack/savanna-venv/local/lib/python2.7/site-packages/savanna/service/instances.py",
line 45, in create_cluster
2013-09-16 12:21:51.369 47355 TRACE savanna.context     cluster =
_await_instances(cluster)


complete details here: http://paste.openstack.org/show/47126/
I can see in horizon that it makes it past the "waiting" log message.

My suspicion is with volumes.attach() below since the output from the
cluster_create contains

"volume_mount_prefix": "/volumes/disk",


I am using the vmware machine as configured in the guide, but
locate /volumes/disk returns nothing.

--- here is instances.py where the exception is thrown

def create_cluster(cluster):
    ctx = context.ctx()
    try:
        # create all instances
        conductor.cluster_update(ctx, cluster, {"status": "Spawning"})
        LOG.info(g.format_cluster_status(cluster))
        _create_instances(cluster)

        # wait for all instances are up and accessible
        cluster = conductor.cluster_update(ctx, cluster, {"status":
"Waiting"})
        LOG.info(g.format_cluster_status(cluster))
        cluster = _await_instances(cluster)

        # attach volumes
        volumes.attach(cluster)

        # prepare all instances
        cluster = conductor.cluster_update(ctx, cluster,
                                           {"status": "Preparing"})
        LOG.info(g.format_cluster_status(cluster))

        _configure_instances(cluster)

    except Exception as ex:
        LOG.warn("Can't start cluster '%s' (reason: %s)", cluster.name, ex)

tips to debug?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130917/43748545/attachment.html>


More information about the OpenStack-dev mailing list