Open Stack

Hi Steven,

You get this exception when Murano can't connect to the RabbitMQ used
to communicate
between engine and murano-agent on VM side. You need to configure
connection to RabbitMQ twice, in regular way for oslo.messaging, and
you need to configure connection to RabbitMQ in [rabbitmq] section.

Please, check RabbitMQ configuration in configuration file (section [rabbitmq]).

I would explain below why do we have two places to configure
connection to RabbitMQ.

Murano uses RabbitMQ for communication between components, specifically between:

* API & Engine
* Engine & Agent

One of the recommended way of OpenStack deployment with Murano is to
use two RabbitMQ installations:

* OS Rabbit: used by OpenStack & Murano
* Murano Rabbit: used only by Murano


OS Rabbit is used by Murano for communication between API & Engine and
it is same RabbitMQ instance that is used by rest of OpenStack
components. Murano Rabbit is used by Murano for communication between
Engine & Agent. Murano Rabbit is isolated from the management network,
but accessible from VMs.

This deployment model is recommended due to security reasons - VMs
spawned by Murano with murano-agent enabled use RabbitMQ for
communication, and if it's same RabbitMQ instance (with same
credentials/vhost) as one used by OpenStack, user may
affect/compromise OpenStack cloud itself.

On Thu, Feb 5, 2015 at 4:46 AM, Tran, Steven <steven.tran2 at hp.com> wrote:
> Hi,
>
>    Has anyone seen this exception in the recent revision?  I just get the
> latest today.
>
>    murano-engine outputs this exception when I deploy an environment.  It
> fails to create a VM.
>
>    I wonder if it’s my environment or a murano defect.
>
>
>
>
>
> {"packages": [{"class_definitions": ["io.murano.Environment",
> "io.murano.resources.Network", "io.murano.Application",
> "io.murano.resources.WindowsInstance",
> "io.murano.resources.HeatSWConfigInstance",
> "io.murano.system.StatusReporter", "io.murano.resources.LinuxInstance",
> "io.murano.system.AgentListener", "io.murano.resources.NeutronNetwork",
> "io.murano.resources.LinuxMuranoInstance",
> "io.murano.resources.HeatSWConfigLinuxInstance",
> "io.murano.system.NetworkExplorer", "io.murano.system.Agent",
> "io.murano.SharedIp", "io.murano.system.HeatStack",
> "io.murano.system.InstanceNotifier", "io.murano.resources.Instance",
> "io.murano.system.SecurityGroupManager", "io.murano.StackTrace",
> "io.murano.Object", "io.murano.Exception",
> "io.murano.resources.LinuxUDInstance", "io.murano.system.Resources"],
> "description": "Core MuranoPL library\n", "tags": ["MuranoPL"], "updated":
> "2015-02-04T23:03:03", "is_public": true, "categories": [], "name": "Core
> library", "author": "murano.io", "created": "2015-02-04T23:03:03",
> "enabled": true, "id": "5ebdb96fc6f542dca9a1af766ddbfa94", "supplier": {},
> "fully_qualified_name": "io.murano", "type": "Library", "owner_id": ""}]}
>
> log_http_response
> /opt/stack/python-muranoclient/muranoclient/common/http.py:124
>
> 2015-02-04 17:37:50.950 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: Begin execution:
> io.murano.system.Resources.string (-7559542279869778927) called from File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml",
> line 98:28 in method deploy of class io.murano.resources.Instance
>
>     $.prepareUserData() _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> 2015-02-04 17:37:50.950 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.system.Resources.string (-7559542279869778927)
> _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:50.952 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: Begin execution:
> io.murano.system.Resources.string (-7559542279869778927) called from File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml",
> line 98:28 in method deploy of class io.murano.resources.Instance
>
>     $.prepareUserData() _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> 2015-02-04 17:37:50.952 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.system.Resources.string (-7559542279869778927)
> _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:50.953 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: Begin execution:
> io.murano.system.AgentListener.queueName (8227276669045428973) called from
> File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml",
> line 98:28 in method deploy of class io.murano.resources.Instance
>
>     $.prepareUserData() _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> 2015-02-04 17:37:50.953 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.system.AgentListener.queueName (8227276669045428973)
> _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:50.954 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: Begin execution:
> io.murano.system.Agent.queueName (-5211629396053631386) called from File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml",
> line 98:28 in method deploy of class io.murano.resources.Instance
>
>     $.prepareUserData() _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> 2015-02-04 17:37:50.954 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.system.Agent.queueName (-5211629396053631386)
> _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:50.956 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.resources.LinuxMuranoInstance.prepareUserData
> (-6721861659645843611) _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:50.957 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: Begin execution:
> io.murano.system.Agent.prepare (-5222445134521330586) called from File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano.apps.linux.Telnet/Classes/telnet.yaml",
> line 32:9 in method deploy of class io.murano.apps.linux.Telnet
>
>     $.instance.deploy() _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> Traceback (most recent call last):
>
>   File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line
> 115, in wait
>
>     listener.cb(fileno)
>
>   File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py",
> line 214, in main
>
>     result = function(*args, **kwargs)
>
>   File "/opt/stack/murano/murano/dsl/executor.py", line 179, in
> _invoke_method_implementation_gt
>
>     return body(this, **params)
>
>   File "/opt/stack/murano/murano/engine/system/agent.py", line 68, in
> prepare
>
>     with common.create_rmq_client() as client:
>
>   File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 52, in
> __enter__
>
>     self.connect()
>
>   File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 60, in
> connect
>
>     self._connection.connect()
>
>   File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 237, in connect
>
>     return self.connection
>
>   File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 741, in connection
>
>     self._connection = self._establish_connection()
>
>   File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 696, in _establish_connection
>
>     conn = self.transport.establish_connection()
>
>   File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqp.py",
> line 112, in establish_connection
>
>     conn = self.Connection(**opts)
>
>   File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line
> 180, in __init__
>
>     (10, 30),  # tune
>
>   File "/usr/local/lib/python2.7/dist-packages/amqp/abstract_channel.py",
> line 67, in wait
>
>     self.channel_id, allowed_methods)
>
>   File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line
> 240, in _wait_method
>
>     self.method_reader.read_method()
>
>   File "/usr/local/lib/python2.7/dist-packages/amqp/method_framing.py", line
> 189, in read_method
>
>     raise m
>
> MuranoPlException: [exceptions.IOError]: Socket closed
>
> Removing descriptor: 7
>
> 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.system.Agent.prepare (-5222445134521330586) with exception
> [exceptions.IOError]: Socket closed _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:156
>
> 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.resources.Instance.deploy (-6771477997220427611) with exception
> [exceptions.IOError]: Socket closed _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:156
>
> 2015-02-04 17:37:54.044 28689 DEBUG murano.dsl.executor [-]
> cad324b38b064c6a92f8bdf55b01ce37: End execution:
> io.murano.apps.linux.Telnet.deploy (-3331993352887903899) with exception
> [exceptions.IOError]: Socket closed _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:156
>
> 2015-02-04 17:37:54.045 28689 DEBUG murano.dsl.executor [-]
> 2d99ec6cb8744a418321010e0155d1be: Begin execution:
> io.murano.system.AgentListener.stop (8219708049029306173) called from File
> <unknown> in method None
>
>     None _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:142
>
> 2015-02-04 17:37:54.045 28689 DEBUG murano.dsl.executor [-]
> 2d99ec6cb8744a418321010e0155d1be: End execution:
> io.murano.system.AgentListener.stop (8219708049029306173)
> _invoke_method_implementation /opt/stack/murano/murano/dsl/executor.py:160
>
> 2015-02-04 17:37:54.046 28689 DEBUG murano.dsl.executor [-]
> 2d99ec6cb8744a418321010e0155d1be: End execution:
> io.murano.Environment.deploy (2363767013075233465) with exception
> [exceptions.IOError]: Socket closed _invoke_method_implementation
> /opt/stack/murano/murano/dsl/executor.py:156
>
> 2015-02-04 17:37:54.046 28689 ERROR murano.common.engine [-]
>
>   exceptions.IOError: Socket closed
>
>   Traceback (most recent call last):
>
>     File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/Environment.yaml",
> line 68:13 in method deploy of class io.murano.Environment
>
>         $.applications.pselect($.deploy())
>
>     File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano.apps.linux.Telnet/Classes/telnet.yaml",
> line 32:9 in method deploy of class io.murano.apps.linux.Telnet
>
>         $.instance.deploy()
>
>     File
> "/tmp/murano-packages-cache/1aaac863-f712-4ec6-b7c3-683d3498b951/io.murano/Classes/resources/Instance.yaml",
> line 102:9 in method deploy of class io.murano.resources.Instance
>
>         $.agent.prepare()
>
>     File "/opt/stack/murano/murano/engine/system/agent.py", line 68 in
> method prepare
>
>         with common.create_rmq_client() as client:
>
>     File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 52 in
> method __enter__
>
>         self.connect()
>
>     File "/opt/stack/murano/murano/common/messaging/mqclient.py", line 60 in
> method connect
>
>         self._connection.connect()
>
>     File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 237 in method connect
>
>         return self.connection
>
>     File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 741 in method connection
>
>         self._connection = self._establish_connection()
>
>     File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line
> 696 in method _establish_connection
>
>         conn = self.transport.establish_connection()
>
>     File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqp.py",
> line 112 in method establish_connection
>
>         conn = self.Connection(**opts)
>
>     File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line
> 180 in method __init__
>
>         (10, 30),  # tune
>
>     File "/usr/local/lib/python2.7/dist-packages/amqp/abstract_channel.py",
> line 67 in method wait
>
>         self.channel_id, allowed_methods)
>
>     File "/usr/local/lib/python2.7/dist-packages/amqp/connection.py", line
> 240 in method _wait_method
>
>         self.method_reader.read_method()
>
>     File "/usr/local/lib/python2.7/dist-packages/amqp/method_framing.py",
> line 189 in method read_method
>
>         raise m
>
> 2015-02-04 17:37:54.047 28689 DEBUG oslo_messaging._drivers.amqp [-]
> UNIQUE_ID is 7e43279a013a441eb58a9df6580988ab. _add_unique_id
> /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:224
>
> 2015-02-04 17:37:54.059 28689 DEBUG oslo_messaging._drivers.amqpdriver [-]
> MSG_ID is a6138cbd1245497eaf768f9ba2eb6bf1 _send
> /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:378
>
> 2015-02-04 17:37:54.060 28689 DEBUG oslo_messaging._drivers.amqp [-] Pool
> creating new connection create
> /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:68
>
> 2015-02-04 17:37:54.060 28689 INFO oslo_messaging._drivers.impl_rabbit [-]
> Connecting to AMQP server on 192.168.178.18:5672
>
> 2015-02-04 17:37:54.071 28689 INFO oslo_messaging._drivers.impl_rabbit [-]
> Connected to AMQP server on 192.168.178.18:5672
>
> 2015-02-04 17:37:54.074 28689 DEBUG oslo_messaging._drivers.amqp [-]
> UNIQUE_ID is 9edaec379ef24689a77772247baf951c. _add_unique_id
> /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:224
>
> 2015-02-04 17:37:54.074 28689 DEBUG oslo_messaging._drivers.amqp [-] Pool
> creating new connection create
> /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqp.py:68
>
> 2015-02-04 17:37:54.075 28689 INFO oslo_messaging._drivers.impl_rabbit [-]
> Connecting to AMQP server on 192.168.178.18:5672
>
> 2015-02-04 17:37:54.090 28689 INFO oslo_messaging._drivers.impl_rabbit [-]
> Connected to AMQP server on 192.168.178.18:5672
>
>
>
> Thanks,
>
> -Steven
>
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
Serg Melikyan, Senior Software Engineer at Mirantis, Inc.
http://mirantis.com | smelikyan at mirantis.com

+7 (495) 640-4904, 0261
+7 (903) 156-0836