<div dir="ltr"><div><div><div><div>I configured Nova (both controller-nodes and compute-nodes) with <b>ZooKeeper</b> (on Ubuntu 12.04). <br></div>I can create instance and other operations seem OK.<br>But when i delete instance:<br>
# nova delete 92d154dd-6f4d-483c-84d4-ad1b8a691156<br><span style="color:rgb(255,0,0)">The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-48afc072-1e7d-473a-b99f-53c22051f260)</span><br>
<br></div>And check nova-api.log and saw errors (quite long):<br><br>2013-09-17 17:39:19.617 ERROR nova.exception [req-48afc072-1e7d-473a-b99f-53c22051f260 3f75c75d09ce4d01887c7415ef7c5ae9 55634eee777042<br>b69cdb478230e88d52] Exception in string format operation<br>
2013-09-17 17:39:19.617 20071 TRACE nova.exception Traceback (most recent call last):<br>2013-09-17 17:39:19.617 20071 TRACE nova.exception File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 147, in __init__<br>
2013-09-17 17:39:19.617 20071 TRACE nova.exception message = self.message % kwargs<br>2013-09-17 17:39:19.617 20071 TRACE nova.exception TypeError: %d format: a number is required, not str<br>2013-09-17 17:39:19.617 20071 TRACE nova.exception<br>
2013-09-17 17:39:19.618 ERROR nova.exception [req-48afc072-1e7d-473a-b99f-53c22051f260 3f75c75d09ce4d01887c7415ef7c5ae9 55634eee777042<br>b69cdb478230e88d52] code: 500<br>2013-09-17 17:39:19.618 ERROR nova.exception [req-48afc072-1e7d-473a-b99f-53c22051f260 3f75c75d09ce4d01887c7415ef7c5ae9 55634eee777042<br>
b69cdb478230e88d52] driver: ZooKeeperDriver<br>2013-09-17 17:39:19.642 ERROR nova.api.openstack [req-48afc072-1e7d-473a-b99f-53c22051f260 3f75c75d09ce4d01887c7415ef7c5ae9 55634eee77<br>7042b69cdb478230e88d52] Caught error: The service from servicegroup driver %(driver) is temporarily unavailable.<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack Traceback (most recent call last):<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line<br>
81, in __call__<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return req.get_response(self.application)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1296, in send<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack application, catch_exc_info=False)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1260, in call_<br>
application<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack app_iter = application(self.environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return resp(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/keystoneclient/middleware/auth_token.p<br>
y", line 450, in __call__<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return self.app(env, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return resp(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return resp(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return resp(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __<br>
call__<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack response = self.app(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return resp(environ, start_response)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack resp = self.call_func(req, *args, **self.kwargs)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return self.func(req, *args, **kwargs)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 890, in __call__<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack content_type, body, accept)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 942, in _process_stack<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack action_result = self.dispatch(meth, request, action_args)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 1022, in dispatch<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return method(req=request, **action_args)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 1117, in delete<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack self._delete(req.environ['nova.context'], req, id)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 961, in _delete<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack self.compute_api.delete(context, instance)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 163, in wrapped<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return func(self, context, target, *args, **kwargs)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 153, in inner<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return function(self, context, instance, *args, **kwargs)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 134, in inner<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return f(self, context, instance, *args, **kw)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1233, in delete<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack self._delete_instance(context, instance)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1225, in _delete_instance<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack task_state=task_states.DELETING)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1122, in _delete<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack project_id=project_id)<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack self.gen.next()<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1093, in _delete<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack if self.servicegroup_api.service_is_up(service):<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/servicegroup/api.py", line 93, in service_is_up<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack return self._driver.is_up(member)<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/servicegroup/drivers/zk.py", line 115, in is_up<br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack all_members = self.get_all(group_id)<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack File "/usr/lib/python2.7/dist-packages/nova/servicegroup/drivers/zk.py", line 138, in get_all<br><b>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack raise exception.ServiceGroupUnavailable(driver="ZooKeeperDriver")<br>
2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack ServiceGroupUnavailable: The service from servicegroup driver %(driver) is temporarily unavailable.</b><br>2013-09-17 17:39:19.642 20071 TRACE nova.api.openstack <br>
2013-09-17 17:39:19.646 INFO nova.api.openstack [req-48afc072-1e7d-473a-b99f-53c22051f260 3f75c75d09ce4d01887c7415ef7c5ae9 55634eee777042b69cdb478230e88d52] <a href="http://123.30.234.14:8774/v2/55634eee777042b69cdb478230e88d52/servers/92d154dd-6f4d-483c-84d4-ad1b8a691156">http://123.30.234.14:8774/v2/55634eee777042b69cdb478230e88d52/servers/92d154dd-6f4d-483c-84d4-ad1b8a691156</a> returned with HTTP 500<br>
<br><br></div>Do you have an idea why this bug happen?<br><br></div>Thank you very much!<br></div>