Open Stack

While I struggle to try to get "my" Openstack-ZFS backend working
and the configuration of my FWaas, I thought I'd get another one
of my must-haves. Senlin.

However, as usual, that doesn't want to work either :(.

While trying to run

	openstack --debug cluster build info

I get in the log:

----- s n i p -----
==> /var/log/keystone/keystone.log <==
2016-07-17 11:21:58.996 6947 INFO keystone.common.wsgi [req-70bed223-6c4b-48e7-b320-df99c935cd1f - - - - -] GET http://openstack.domain.tld:35357/v3/
2016-07-17 11:21:59.001 6947 INFO eventlet.wsgi.server [req-70bed223-6c4b-48e7-b320-df99c935cd1f - - - - -] 10.0.4.1 - - [17/Jul/2016 11:21:59] "GET /v3 HTTP/1.1" 200 479 0.006817
2016-07-17 11:21:59.020 6947 INFO keystone.common.wsgi [req-6714b6fd-c117-4549-bff8-42f09089548c - - - - -] POST http://openstack.domain.tld:35357/v3/auth/tokens
2016-07-17 11:21:59.464 6947 INFO eventlet.wsgi.server [req-6714b6fd-c117-4549-bff8-42f09089548c - - - - -] 10.0.4.1 - - [17/Jul/2016 11:21:59] "POST /v3/auth/tokens HTTP/1.1" 201 12654 0.445635
2016-07-17 11:21:59.543 6957 INFO keystone.common.wsgi [req-77fced3a-7495-4b27-9315-4f1b8a2f3386 - - - - -] POST http://openstack.domain.tld:35357/v3/auth/tokens
2016-07-17 11:21:59.849 6957 INFO eventlet.wsgi.server [req-77fced3a-7495-4b27-9315-4f1b8a2f3386 - - - - -] 10.0.4.1 - - [17/Jul/2016 11:21:59] "POST /v3/auth/tokens HTTP/1.1" 201 12654 0.309226

==> /var/log/senlin/senlin-api.log <==
2016-07-17 11:21:59.854 16603 DEBUG eventlet.wsgi.server [-] (16603) accepted ('10.0.4.1', 49820) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:867
2016-07-17 11:21:59.856 16603 DEBUG senlin.api.middleware.version_negotiation [-] Processing request: GET /v1/build-info Accept: */* process_request /usr/lib/python2.7/dist-packages/senlin/api/middleware/version_negotiation.py:47
2016-07-17 11:21:59.857 16603 DEBUG senlin.api.middleware.version_negotiation [-] Matched versioned URI. Version: 1.0 process_request /usr/lib/python2.7/dist-packages/senlin/api/middleware/version_negotiation.py:62

==> /var/log/keystone/keystone.log <==
2016-07-17 11:21:59.876 6971 INFO keystone.common.wsgi [req-0666a7d2-5309-459c-838e-079c6f10ba75 - - - - -] POST http://openstack.domain.tld:5000/v3/auth/tokens
2016-07-17 11:21:59.896 6971 WARNING keystone.common.wsgi [req-0666a7d2-5309-459c-838e-079c6f10ba75 - - - - -] Expecting to find id or name in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.
2016-07-17 11:21:59.899 6971 INFO eventlet.wsgi.server [req-0666a7d2-5309-459c-838e-079c6f10ba75 - - - - -] 10.0.4.1 - - [17/Jul/2016 11:21:59] "POST /v3/auth/tokens HTTP/1.1" 400 465 0.026738
----- s n i p -----

The debug output say:

----- s n i p -----
Making authentication request to http://openstack.domain.tld:35357/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 12377
take_action(Namespace(columns=[], formatter='table', max_width=0, noindent=False, prefix='', variables=[]))
Connection: <openstack.connection.Connection object at 0x7f93ac876310>
Clustering client initialized using OpenStackSDK: <openstack.cluster.v1._proxy.Proxy object at 0x7f93b4ac0450>
Making authentication request to http://openstack.domain.tld:35357/v3/auth/tokens
Starting new HTTP connection (1): openstack.domain.tld
"POST /v3/auth/tokens HTTP/1.1" 201 12377
REQ: curl -g -i -X GET http://10.0.4.1:8778/v1/build-info -H "User-Agent: openstacksdk/0.8.1 keystoneauth1/2.4.1 python-requests/2.10.0 CPython/2.7.12" -H "X-Auth-Token: {SHA1}5404e5bc0bd1a9ab9a369fe720713fa1b86af1b9"
Starting new HTTP connection (1): 10.0.4.1
"GET /v1/build-info HTTP/1.1" 503 100
RESP: [503] Content-Length: 100 Content-Type: text/plain; charset=UTF-8 X-Openstack-Request-Id: req-df1cf88a-0082-47ae-9ba7-ddeb58c6ab7b Date: Sun, 17 Jul 2016 10:28:39 GMT Connection: keep-alive 
RESP BODY: 503 Service Unavailable

The server is currently unavailable. Please try again at a later time.

   

Request returned failure status: 503
HttpException: Service Unavailable, 503 Service Unavailable
----- s n i p -----

Senlin seems to be both registered and running:

----- s n i p -----
bladeA01:/etc/senlin# openstack service list | grep senlin
| f9246a3b8a68466b8a83f09d3da5a3d9 | senlin     | clustering          |
bladeA01:/etc/senlin# openstack endpoint list | grep 8778
| 7d8ade426d56435aa4b239b07c9ca7e6 | europe-london | senlin       | clustering          | True    | admin     | http://10.0.4.1:8778                    |
| 7e42b5af29bd42ec95516361c8e05160 | europe-london | senlin       | clustering          | True    | internal  | http://10.0.4.1:8778                    |
| d82efcfea30b477498f3a46695c2eb91 | europe-london | senlin       | clustering          | True    | public    | http://10.0.4.1:8778                    |
bladeA01:/etc/senlin# lsof | grep LISTEN | grep 8778
senlin-ap 16603            senlin    4u     IPv4           25111065        0t0        TCP *:8778 (LISTEN)
bladeA01:/etc/senlin# ps | grep senlin
16603 ?        Ss     0:03 /usr/bin/python2.7 /usr/bin/senlin-api --config-file=/etc/senlin/senlin.conf --log-file=/var/log/senlin/senlin-api.log
16706 ?        Ss     0:03 /usr/bin/python2.7 /usr/bin/senlin-engine --config-file=/etc/senlin/senlin.conf --log-file=/var/log/senlin/senlin-engine.log
bladeA01:/etc/senlin# senlin-manage service list
Service ID                           Host                     Binary           Topic            Status     Created At               Updated At              
a9acd007-6291-4424-b5aa-99d6bdf7bb7f bladeA01                 senlin-engine    senlin-engine    up         2016-07-17 10:46:33      2016-07-17 10:56:33     
----- s n i p -----

There is no reference to Senlin in the documentation.

	http://docs.openstack.org/mitaka/config-reference/

and the specific Senlin doc page is/must be lacking information

	http://docs.openstack.org/developer/senlin/install.html

because I have exactly that!
--
You know, boys, a nuclear reactor is a lot like a woman.
You just have to read the manual and press the right buttons
- Homer Simpson