Hi,<br><br>I have a two node OpenStack Folsom Setup. One node runs all services with KVM. The other nodes is a Compute Node for ESXi 5.1. I have set the availabality_zones for each of this so that I can schedule instances as per my need. I am able to operate the instances on the KVM just fine. But when I launch an instance for ESXi, it goes to ERROR state with the error 'NetworkNotFoundForBridge: Network could not be found for bridge'.<br>
<br>After the vanilla Folsom installation, I was getting an AttribueError which got fixed after applying the patch at <a href="https://bugs.launchpad.net/nova/+bug/1063885">https://bugs.launchpad.net/nova/+bug/1063885</a><br>
<br>But then after that, I am seeing this error.<br><br>root@openstack-kvm:~# nova show 8110c50c-ed26-48dd-886b-71b44ee382dd<br>+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+<br>
| Property | Value |<br>+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+<br>
| OS-DCF:diskConfig | MANUAL |<br>| OS-EXT-SRV-ATTR:host | openstack-esxi |<br>
| OS-EXT-SRV-ATTR:hypervisor_hostname | None |<br>| OS-EXT-SRV-ATTR:instance_name | instance-00000016 |<br>
| OS-EXT-STS:power_state | 0 |<br>| OS-EXT-STS:task_state | None |<br>
| OS-EXT-STS:vm_state | error |<br>| accessIPv4 | |<br>
| accessIPv6 | |<br>| config_drive | |<br>
| created | 2013-01-23T07:13:11Z |<br>| fault | {u'message': u'NetworkNotFoundForBridge', u'code': 404, u'details': u'Network could not be found for bridge ', u'created': u'2013-01-23T07:13:14Z'} |<br>
| flavor | m1.tiny (6) |<br>| hostId | a9edbd6bb1136ff3bcf5225d1f6a34e0d18cc21eb9837acd67dec105 |<br>
| id | 8110c50c-ed26-48dd-886b-71b44ee382dd |<br>| image | Ubuntu1204 (4d70a998-a51e-4557-81fa-23747db12305) |<br>
| key_name | None |<br>| metadata | {} |<br>
| name | VM2 |<br>| security_groups | [{u'name': u'default'}] |<br>
| status | ERROR |<br>| tenant_id | b439758af3814f739fe7ab09b98a0120 |<br>
| updated | 2013-01-23T07:13:14Z |<br>| user_id | 9ac7dbe62fb349ce84927598a0f54d68 |<br>
+-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+<br>root@openstack-kvm:~#<br><br>
My /etc/nova/nova.conf on the ESXi compute nodes is:<br><br>[DEFAULT]<br>logdir=/var/log/nova<br>state_path=/var/lib/nova<br>lock_path=/run/lock/nova<br>verbose=True<br>api_paste_config=/etc/nova/api-paste.ini<br>scheduler_driver=nova.scheduler.simple.SimpleScheduler<br>
s3_host=10.5.3.230<br>ec2_host=10.5.3.230<br>ec2_dmz_host=10.5.3.230<br>rabbit_host=10.5.3.230<br>cc_host=10.5.3.230<br>dmz_cidr=<a href="http://169.254.169.254/32">169.254.169.254/32</a><br>metadata_host=10.5.3.230<br>metadata_listen=0.0.0.0<br>
nova_url=<a href="http://10.5.3.230:8774/v1.1/">http://10.5.3.230:8774/v1.1/</a><br>sql_connection=mysql://<a href="http://novaUser:novaPass@10.5.3.230/nova">novaUser:novaPass@10.5.3.230/nova</a><br>ec2_url=<a href="http://10.5.3.230:8773/services/Cloud">http://10.5.3.230:8773/services/Cloud</a><br>
root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf<br>my_ip=10.5.3.231<br><br># Auth<br>use_deprecated_auth=false<br>auth_strategy=keystone<br>keystone_ec2_url=<a href="http://10.5.3.230:5000/v2.0/ec2tokens">http://10.5.3.230:5000/v2.0/ec2tokens</a><br>
# Imaging service<br>glance_api_servers=<a href="http://10.5.3.230:9292">10.5.3.230:9292</a><br>image_service=nova.image.glance.GlanceImageService<br><br># Vnc configuration<br>novnc_enabled=true<br>novncproxy_base_url=<a href="http://10.5.12.20:6080/vnc_auto.html">http://10.5.12.20:6080/vnc_auto.html</a><br>
novncproxy_port=6080<br>vncserver_proxyclient_address=10.5.12.20<br>vncserver_listen=0.0.0.0<br><br># Network settings<br>network_api_class=nova.network.quantumv2.api.API<br>quantum_url=<a href="http://10.5.3.230:9696">http://10.5.3.230:9696</a><br>
quantum_auth_strategy=keystone<br>quantum_admin_tenant_name=service<br>quantum_admin_username=quantum<br>quantum_admin_password=service_pass<br>quantum_admin_auth_url=<a href="http://10.5.3.230:35357/v2.0">http://10.5.3.230:35357/v2.0</a><br>
libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver<br>linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver<br>firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver<br><br>
# Compute #<br>compute_driver= vmwareapi.VMWareESXDriver<br>vmwareapi_host_ip=10.5.3.99<br>vmwareapi_host_username=root<br>vmwareapi_host_password=S0nicwall<br>vmwareapi_wsdl_loc=<a href="http://127.0.0.1:8080/vmware/SDK/vsphere-ws/wsdl/vim25/vimService.wsdl">http://127.0.0.1:8080/vmware/SDK/vsphere-ws/wsdl/vim25/vimService.wsdl</a><br>
connection_type = vmwareapi<br>vmware_vif_driver = nova.virt.vmwareapi.vif.VMWareVlanBridgeDriver<br>console_manager = nova.console.vmrc_manager.ConsoleVMRCManager<br>vmwareapi_vlan_interface= vmnic4<br>node_availability_zone=zone2<br>
<br># Cinder #<br>volume_api_class=nova.volume.cinder.API<br>osapi_volume_listen_port=5900<br><br><br>The log snippet from nova-compute.log is below:<br><br><br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] Traceback (most recent call last):<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 743, in _spawn<br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] block_device_info)<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/driver.py", line 132, in spawn<br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] self._vmops.spawn(context, instance, image_meta, network_info)<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 187, in spawn<br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] vif_infos = _get_vif_infos()<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 180, in _get_vif_infos<br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] network_ref = _check_if_network_bridge_exists(network_name)<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 168, in _check_if_network_bridge_exists<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] raise exception.NetworkNotFoundForBridge(bridge=network_name)<br>2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] NetworkNotFoundForBridge: Network could not be found for bridge<br>
2013-01-22 23:13:14 TRACE nova.compute.manager [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd]<br>2013-01-22 23:13:14 DEBUG nova.compute.manager [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] Deallocating network for instance from (pid=2686) _deallocate_network /usr/lib/python2.7/dist-packages/nova/compute/manager.py:769<br>
2013-01-22 23:13:14 DEBUG nova.network.quantumv2.api [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] deallocate_for_instance() for VM2 from (pid=2686) deallocate_for_instance /usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py:160<br>
2013-01-22 23:13:14 DEBUG nova.compute.manager [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 8110c50c-ed26-48dd-886b-71b44ee382dd] Retry info not present, will not reschedule from (pid=2686) _reschedule /usr/lib/python2.7/dist-packages/nova/compute/manager.py:564<br>
2013-01-22 23:13:14 DEBUG nova.utils [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] Got semaphore "compute_resources" for method "update_usage"... from (pid=2686) inner /usr/lib/python2.7/dist-packages/nova/utils.py:713<br>
2013-01-22 23:13:14 DEBUG nova.utils [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] Got semaphore "compute_resources" for method "update_usage"... from (pid=2686) inner /usr/lib/python2.7/dist-packages/nova/utils.py:713<br>
2013-01-22 23:13:14 ERROR nova.openstack.common.rpc.amqp [-] Exception during message handling<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 275, in _process_data<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, **args)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp temp_level, payload)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self.gen.next()<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return f(*args, **kw)<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 181, in decorated_function<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp pass<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self.gen.next()<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 167, in decorated_function<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 202, in decorated_function<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp kwargs['instance']['uuid'], e, sys.exc_info())<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self.gen.next()<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 196, in decorated_function<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 824, in run_instance<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp do_run_instance()<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 752, in inner<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp retval = f(*args, **kwargs)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 823, in do_run_instance<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp admin_password, is_first_time, instance)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 516, in _run_instance<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self._set_instance_error_state(context, instance['uuid'])<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self.gen.next()<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 504, in _run_instance<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp is_first_time, request_spec, filter_properties)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 496, in _run_instance<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp injected_files, admin_password)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 743, in _spawn<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp block_device_info)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/driver.py", line 132, in spawn<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp self._vmops.spawn(context, instance, image_meta, network_info)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 187, in spawn<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp vif_infos = _get_vif_infos()<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 180, in _get_vif_infos<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp network_ref = _check_if_network_bridge_exists(network_name)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 168, in _check_if_network_bridge_exists<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp raise exception.NetworkNotFoundForBridge(bridge=network_name)<br>2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp NetworkNotFoundForBridge: Network could not be found for bridge<br>
2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp<br><br>Any help will be greatly appreciated.<br><br>Thanks,<br>Balu<br>