<div dir="ltr">We also need to see the /etc/neutron/plugins/ml2/ml2_conf.ini from both because that has the physical network mappings.<div><br></div><div>Also, I don't see anything obvious in the agent logs there. Can you include the portion surrounding the "Failed to bind port" message from the Neutron server log?</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jul 28, 2015 at 4:13 AM, Asmaa Chebba <span dir="ltr"><<a href="mailto:achebba@cdta.dz" target="_blank">achebba@cdta.dz</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">openvswitch agent is running and the logs in compute2 are as follow:<br>
<br>
1. OVS-cleanup.log<br>
2015-06-20 12:52:19.976 1529 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-06-23 15:48:43.401 1332 INFO neutron.common.config [-] Logging enabled!<br>
2015-06-23 15:48:43.893 1332 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-06-23 15:48:44.520 1332 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-06-24 11:49:21.423 1770 INFO neutron.common.config [-] Logging enabled!<br>
2015-06-24 11:49:22.123 1770 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-06-24 11:49:22.628 1770 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-06-25 00:21:55.634 1337 INFO neutron.common.config [-] Logging enabled!<br>
2015-06-25 00:21:56.858 1337 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-06-25 00:21:57.900 1337 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-07-07 16:43:42.608 1457 INFO neutron.common.config [-] Logging enabled!<br>
2015-07-07 16:43:43.399 1457 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-07-07 16:43:43.792 1457 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-07-08 15:04:31.954 1351 INFO neutron.common.config [-] Logging enabled!<br>
2015-07-08 15:04:32.888 1351 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-07-08 15:04:33.235 1351 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed successfully<br>
2015-07-20 13:25:20.300 1550 INFO neutron.common.config [-] Logging enabled!<br>
2015-07-20 13:25:22.665 1550 INFO neutron.agent.ovs_cleanup_util [-] Cleaning br-int<br>
2015-07-20 13:25:22.770 1550 INFO neutron.agent.ovs_cleanup_util [-] OVS cleanup completed succe<br>
<br>
2. Openvswitch-agent.log<br>
2015-07-28 13:23:29.151 4615 ERROR neutron.agent.linux.ovsdb_monitor [-] Error received from ovsdb monitor: 2015-07-28T11:23:29Z|00001|fatal_signal|WARN|terminating with signal 15 (Terminated)<br>
2015-07-28 13:23:29.190 4615 ERROR neutron.agent.linux.utils [-]<br>
Command: ['ps', '--ppid', '4764', '-o', 'pid=']<br>
Exit code: 1<br>
Stdout: ''<br>
Stderr: ''<br>
2015-07-28 13:23:29.835 4615 CRITICAL neutron [req-dbf6bc78-c2df-4454-9e19-5f09bf688ee9 None] AssertionError: Trying to re-send() an already-triggered event.<br>
2015-07-28 13:23:29.835 4615 TRACE neutron Traceback (most recent call last):<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/bin/neutron-openvswitch-agent", line 10, in <module><br>
2015-07-28 13:23:29.835 4615 TRACE neutron sys.exit(main())<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1565, in main<br>
2015-07-28 13:23:29.835 4615 TRACE neutron agent.daemon_loop()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1485, in daemon_loop<br>
2015-07-28 13:23:29.835 4615 TRACE neutron self.rpc_loop(polling_manager=pm)<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>
2015-07-28 13:23:29.835 4615 TRACE neutron self.gen.next()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/polling.py", line 39, in get_polling_manager<br>
2015-07-28 13:23:29.835 4615 TRACE neutron pm.stop()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/polling.py", line 106, in stop<br>
2015-07-28 13:23:29.835 4615 TRACE neutron self._monitor.stop()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py", line 89, in stop<br>
2015-07-28 13:23:29.835 4615 TRACE neutron self._kill()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovsdb_monitor.py", line 99, in _kill<br>
2015-07-28 13:23:29.835 4615 TRACE neutron super(SimpleInterfaceMonitor, self)._kill(*args, **kwargs)<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py", line 116, in _kill<br>
2015-07-28 13:23:29.835 4615 TRACE neutron self._kill_event.send()<br>
2015-07-28 13:23:29.835 4615 TRACE neutron File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 150, in send<br>
2015-07-28 13:23:29.835 4615 TRACE neutron assert self._result is NOT_USED, 'Trying to re-send() an already-triggered event.'<br>
2015-07-28 13:23:29.835 4615 TRACE neutron AssertionError: Trying to re-send() an already-triggered event.<br>
2015-07-28 13:23:29.835 4615 TRACE neutron<br>
2015-07-28 13:23:32.197 6195 INFO neutron.common.config [-] Logging enabled!<br>
2015-07-28 13:23:33.005 6195 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:33.120 6195 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:33.126 6195 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:33.143 6195 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.287 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:34.304 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.315 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:34.321 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.327 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:34.333 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.338 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:34.344 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.349 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connecting to AMQP server on controller:5672<br>
2015-07-28 13:23:34.356 6195 INFO oslo.messaging._drivers.impl_rabbit [req-15e7e089-2323-4101-811e-ff2537fe3c27 ] Connected to AMQP server on controller:5672<br>
2015-07-28 13:23:34.360 6195 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-15e7e089-2323-4101-811e-ff2537fe3c27 None] Agent initialized successfully, now running...<br>
2015-07-28 13:23:34.367 6195 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-15e7e089-2323-4101-811e-ff2537fe3c27 None] Agent out of sync with plugin!<br>
2015-07-28 13:23:34.447 6195 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-15e7e089-2323-4101-811e-ff2537fe3c27 None] Agent tunnel out of sync with plugin!<br>
<br>
<br>
3. Openvswitch-agent.log.1 ==><br>
2015-07-26 12:15:51.431 4615 INFO neutron.agent.securitygroups_rpc [req-8d59b5d6-4b0f-4ced-a336-5a94159ac601 None] Security group member updated [u'b6692f4f-f96e-48eb-a796-8df11fb6c16b']<br>
<br>
<br>
- And the result of ovs-vsctl show:<br>
<br>
0a578213-5de5-48fd-923e-14b7b201c6c8<br>
Bridge br-int<br>
fail_mode: secure<br>
Port br-int<br>
Interface br-int<br>
type: internal<br>
Port patch-tun<br>
Interface patch-tun<br>
type: patch<br>
options: {peer=patch-int}<br>
Bridge br-tun<br>
fail_mode: secure<br>
Port "gre-c0a80204"<br>
Interface "gre-c0a80204"<br>
type: gre<br>
options: {df_default="true", in_key=flow, local_ip="192.168.2.5", out_key=flow, remote_ip="192.168.2.4"}<br>
Port br-tun<br>
Interface br-tun<br>
type: internal<br>
Port patch-int<br>
Interface patch-int<br>
type: patch<br>
options: {peer=patch-tun}<br>
Port "gre-c0a80203"<br>
Interface "gre-c0a80203"<br>
type: gre<br>
options: {df_default="true", in_key=flow, local_ip="192.168.2.5", out_key=flow, remote_ip="192.168.2.3"}<br>
Port "gre-c0a80202"<br>
Interface "gre-c0a80202"<br>
type: gre<br>
options: {df_default="true", in_key=flow, local_ip="192.168.2.5", out_key=flow, remote_ip="192.168.2.2"}<br>
ovs_version: "2.0.2"<br>
<br>
As for the configuration, here is the files of neutron.conf:<br>
<br>
1. ON compute<br>
[DEFAULT]<br>
verbose = True<br>
lock_path = $state_path/lock<br>
core_plugin = ml2<br>
service_plugins = router<br>
auth_strategy = keystone<br>
allow_overlapping_ips = True<br>
rabbit_host=controller<br>
<br>
[agent]<br>
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf<br>
<br>
[keystone_authtoken]<br>
auth_uri = <a href="http://controller:5000/v2.0" rel="noreferrer" target="_blank">http://controller:5000/v2.0</a><br>
identity_uri = <a href="http://controller:35357" rel="noreferrer" target="_blank">http://controller:35357</a><br>
admin_tenant_name = service<br>
admin_user = neutron<br>
admin_password = PASSWORD<br>
<br>
[service_providers]<br>
service_provider=LOADBALANCER:Haproxy:neutron.services.loadbalancer.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default<br>
service_provider=VPN:openswan:neutron.services.vpn.service_drivers.ipsec.IPsecVPNDriver:default<br>
<br>
2. ON controller<br>
[DEFAULT]<br>
verbose = True<br>
lock_path = $state_path/lock<br>
core_plugin = ml2<br>
service_plugins = router<br>
auth_strategy = keystone<br>
allow_overlapping_ips = True<br>
agent_down_time = 1000<br>
notify_nova_on_port_status_changes = True<br>
notify_nova_on_port_data_changes = True<br>
nova_url = <a href="http://controller:8774/v2" rel="noreferrer" target="_blank">http://controller:8774/v2</a><br>
nova_region_name = regionOne<br>
nova_admin_username = nova<br>
nova_admin_tenant_id =f41a56a0ca3d4ef982fadb9b2363c09f<br>
nova_admin_password = PASSWORD<br>
nova_admin_auth_url = <a href="http://controller:35357/v2.0" rel="noreferrer" target="_blank">http://controller:35357/v2.0</a><br>
rabbit_host=controller<br>
rabbit_password=PASSWORD<br>
rpc_backend=rabbit<br>
<br>
[agent]<br>
root_helper = sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf<br>
report_interval = 100<br>
<br>
[keystone_authtoken]<br>
auth_uri = <a href="http://controller:5000/v2.0" rel="noreferrer" target="_blank">http://controller:5000/v2.0</a><br>
identity_uri = <a href="http://controller:35357" rel="noreferrer" target="_blank">http://controller:35357</a><br>
admin_tenant_name = service<br>
admin_user = neutron<br>
admin_password = PASSWORD<br>
<br>
[database]<br>
connection = mysql://neutron:PASSWORD@controller/neutron<br>
<br>
[service_providers]<br>
service_provider=LOADBALANCER:Haproxy:neutron.services.loadbalancer.drivers.haproxy.plugin_driver.HaproxyOnHostPluginDriver:default<br>
service_provider=VPN:openswan:neutron.services.vpn.service_drivers.ipsec.IPsecVPNDriver:default<br>
<br>
Thanks.<br>
________________________________________<br>
De : Assaf Muller [<a href="mailto:amuller@redhat.com">amuller@redhat.com</a>]<br>
Date d'envoi : lundi 27 juillet 2015 15:13<br>
À : Kevin Benton<br>
Cc: Asmaa Chebba; OpenStack Operators<br>
Objet : Re: [Openstack-operators] Can't launch docker instance, Unexpected vif_type=binding_failed.<br>
<div class="HOEnZb"><div class="h5"><br>
Also can you paste the configuration for both the OVS agent and your neutron server? Binding failure is almost always a configuration mismatch.<br>
<br>
----- Original Message -----<br>
><br>
><br>
> Is the neutron openvswitch agent running on host compute2? What do the logs<br>
> say for the agent there?<br>
> On Jul 22, 2015 07:22, "Asmaa Chebba" < <a href="mailto:achebba@cdta.dz">achebba@cdta.dz</a> > wrote:<br>
><br>
><br>
><br>
> Hi,<br>
> I installed Docker with juno release on Ubuntu<br>
> all compute/networking services are up and enabled, and I can add docker<br>
> images with glance however, I can't launch an instance (stopped at spawning<br>
> step)<br>
> in the nova-compute log, I found :<br>
> Instance failed to spawn<br>
> InstanceDeployFailure: Cannot setup network: Unexpected<br>
> vif_type=binding_failed<br>
> and when verifying the neutron-server log:<br>
> Failed to bind port 5d299cc9-e3f3-48a0-a80f-f204910a47e7 on host compute2<br>
><br>
> Any idea on how to solve this?<br>
> I appriciate your help.<br>
> Tahnks.<br>
><br>
><br>
><br>
><br>
> _______________________________________________<br>
> OpenStack-operators mailing list<br>
> <a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
><br>
><br>
> _______________________________________________<br>
> OpenStack-operators mailing list<br>
> <a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div>Kevin Benton</div></div>
</div>