<html><head><style>body{font-family:Helvetica,Arial;font-size:13px}</style></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">hi,</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">not related to your problem in particular - but why are you trying to setup ZMQ? RabbitMQ is not sufficient for you?</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">cheers,</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">NM</div> <div id="bloop_sign_1395770278918766848" class="bloop_sign"><span style="font-family:helvetica,arial;font-size:13px"></span>-- <br>Nick Maslov<br><span>Sent with Airmail</span></div> <br><p style="color:#000;">On March 25, 2014 at 5:47:14 PM, Antonio Messina (<a href="mailto:antonio.s.messina@gmail.com">antonio.s.messina@gmail.com</a>) wrote:</p> <blockquote type="cite" class="clean_bq"><span><div><div></div><div>Hi all,
<br>
<br>I am testing Havana with ZeroMQ but I'm unable to make it work.
<br>
<br>First of all, I have a few questions:
<br>
<br>* I gather that the nova-rpc-zmq-receiver *must* run on *all* nodes
<br> (including compute nodes), is that correct?
<br>* the nova-rpc-zmq-receiver is part (in Ubuntu) of the nova-scheduler
<br> package, should I install the package and disable nova-scheduler on
<br> the compute nodes? Is there an init script available for it or
<br> should I create my own?
<br>* How the communication works: the nova-compute services talk to the
<br> nova-rpc-zmq-receiver via `tcp://` and the services on the same node
<br> as the nova-rpc-zmq-receiver talk using `ipc://`?
<br>
<br>I am currently using two nodes: a controller node and a compute node.
<br>On both nodes I added to nova.conf:
<br>
<br> rpc_zmq_bind_address = *
<br> rpc_zmq_contexts = 1
<br> rpc_zmq_host = cloud2.gc3
<br> rpc_zmq_ipc_dir = /var/run/openstack
<br> rpc_zmq_matchmaker =
<br>nova.openstack.common.rpc.matchmaker_ring.MatchMakerRing
<br> rpc_zmq_port = 9501
<br>
<br>started nova-rpc-zmq-receiver with:
<br>
<br> nova-rpc-zmq-receiver --config-file /etc/nova/nova.conf
<br>
<br>and created a /etc/oslo/matchmaker_ring.json file containing:
<br>
<br> {
<br> "scheduler": ["cloud2"],
<br> "conductor": ["cloud2"],
<br> "cert": ["cloud2"],
<br> "consoleauth": ["cloud2"],
<br> "network": ["cloud2"],
<br> "compute": ["node-08-01-01"]
<br>
<br> }
<br>
<br>where `cloud2` is my controller and `node-08-01-01` is my compute node.
<br>
<br>However, when I run `nova service-list` (or `nova-manage service
<br>list`) I don't see the compute node:
<br>
<br> +------------------+---------------+----------+---------+-------+----------------------------+-----------------+
<br> | Binary | Host | Zone | Status | State |
<br>Updated_at | Disabled Reason |
<br> +------------------+---------------+----------+---------+-------+----------------------------+-----------------+
<br> | nova-consoleauth | cloud2 | internal | enabled | up |
<br>2014-03-25T15:23:49.000000 | None |
<br> | nova-cert | cloud2 | internal | enabled | up |
<br>2014-03-25T15:24:13.000000 | None |
<br> | nova-scheduler | cloud2 | internal | enabled | up |
<br>2014-03-25T15:23:36.000000 | None |
<br> | nova-conductor | cloud2 | internal | enabled | up |
<br>2014-03-25T15:23:56.000000 | None |
<br> +------------------+---------------+----------+---------+-------+----------------------------+-----------------+
<br>
<br>When I start the nova-compute service I see only the following lines
<br>in the nova-compute.log:
<br>
<br> 2014-03-25 16:27:05.158 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Sending
<br>message(s) to: [(u'conductor.cloud2', u'cloud2')] _multi_send
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:725
<br> 2014-03-25 16:27:05.159 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Creating payload
<br>_call /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:650
<br> 2014-03-25 16:27:05.159 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Creating queue
<br>socket for reply waiter _call
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:663
<br> 2014-03-25 16:27:05.162 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Subscribing to
<br>0a9babcb7ba14b1180621583031a4223 subscribe
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:158
<br> 2014-03-25 16:27:05.162 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Connecting to
<br>ipc:///var/run/openstack/zmq_topic_zmq_replies.node-08-01-01.gc3 with
<br>SUB __init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-25 16:27:05.162 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] -> Subscribed to
<br>0a9babcb7ba14b1180621583031a4223 __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-25 16:27:05.162 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] -> bind: False
<br>__init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-25 16:27:05.163 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Sending cast
<br>_call /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:676
<br> 2014-03-25 16:27:05.163 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Connecting to
<br>tcp://cloud2:9501 with PUSH __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-25 16:27:05.163 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] -> Subscribed to
<br>None __init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-25 16:27:05.164 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] -> bind: False
<br>__init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-25 16:27:05.164 7791 DEBUG
<br>nova.openstack.common.rpc.common
<br>[req-9bf7fc72-6419-4b62-aaa9-b1a7fac964ac None None] Cast sent;
<br>Waiting reply _call
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:679
<br>
<br>
<br>and when I try to start a VM it stays in `BUILD/scheduling` state. On
<br>the log of the compute node (verbose=True, debug=True) I don't see
<br>anything, while the nova-{scheduler,conductor,cert}.log files only
<br>contain the following line, repeated over and over again:
<br>
<br> 2014-03-25 16:28:57.039 31938 DEBUG
<br>nova.openstack.common.loopingcall [-] Dynamic looping call sleeping
<br>for 60.00 seconds _inner
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/loopingcall.py:132
<br>
<br>The nova-rpc-zmq-receiver.log contains:
<br>
<br> 2014-03-24 14:42:32.359 30163 INFO
<br>nova.openstack.common.rpc.common [-] Registering reactor
<br> 2014-03-24 14:42:32.361 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] Connecting to tcp://*:9501 with
<br>PULL __init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-24 14:42:32.361 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> Subscribed to None __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-24 14:42:32.362 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> bind: True __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-24 14:42:32.362 30163 INFO
<br>nova.openstack.common.rpc.common [-] In reactor registered
<br> 2014-03-24 14:42:32.362 30163 INFO
<br>nova.openstack.common.rpc.common [-] Consuming socket
<br> 2014-03-24 14:42:32.401 30163 INFO
<br>nova.openstack.common.rpc.common [-] Creating proxy for topic:
<br>q-plugin.localhost
<br> 2014-03-24 14:42:32.401 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] Connecting to
<br>ipc:///var/run/openstack/zmq_topic_q-plugin.localhost with PUSH
<br>__init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-24 14:42:32.401 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> Subscribed to None __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-24 14:42:32.402 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> bind: True __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-24 14:42:45.891 30163 INFO
<br>nova.openstack.common.rpc.common [-] Creating proxy for topic:
<br>q-l3-plugin.localhost
<br> 2014-03-24 14:42:45.891 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] Connecting to
<br>ipc:///var/run/openstack/zmq_topic_q-l3-plugin.localhost with PUSH
<br>__init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-24 14:42:45.892 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> Subscribed to None __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-24 14:42:45.892 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> bind: True __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-24 14:43:05.093 30163 INFO
<br>nova.openstack.common.rpc.common [-] Creating proxy for topic:
<br>conductor.cloud2.gc3
<br> 2014-03-24 14:43:05.094 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] Connecting to
<br>ipc:///var/run/openstack/zmq_topic_conductor.cloud2.gc3 with PUSH
<br>__init__ /usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-24 14:43:05.094 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> Subscribed to None __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-24 14:43:05.094 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> bind: True __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br> 2014-03-24 14:44:57.760 30163 INFO
<br>nova.openstack.common.rpc.common [-] Creating proxy for topic:
<br>conductor.cloud2
<br> 2014-03-24 14:44:57.761 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] Connecting to
<br>ipc:///var/run/openstack/zmq_topic_conductor.cloud2 with PUSH __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:136
<br> 2014-03-24 14:44:57.761 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> Subscribed to None __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:137
<br> 2014-03-24 14:44:57.761 30163 DEBUG
<br>nova.openstack.common.rpc.common [-] -> bind: True __init__
<br>/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_zmq.py:138
<br>
<br>
<br>Thank you in advance to anyone willing to help me :)
<br>Antonio
<br>
<br>--
<br>antonio.s.messina@gmail.com
<br>antonio.messina@uzh.ch +41 (0)44 635 42 22
<br>GC3: Grid Computing Competence Center http://www.gc3.uzh.ch/
<br>University of Zurich
<br>Winterthurerstrasse 190
<br>CH-8057 Zurich Switzerland
<br>
<br>_______________________________________________
<br>Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
<br>Post to : openstack@lists.openstack.org
<br>Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
<br></div></div></span></blockquote></body></html>