[openstack-dev] [Quantum][Nova]libvir: Network Filter error : Network filter not found:

Dan Wendlandt dan at nicira.com
Wed Sep 26 08:07:11 UTC 2012


Hi Yapeng,

With current devstack, you had to manually add a route to get metadata
to work with quantum.  I've actually proposed a small patch to
devstack to automatically add the route needed for metadata to work:
https://review.openstack.org/#/c/13693/

Feel free to test this patch, or just look at the commands run by the
patch and run them as part of your local.sh

Dan


On Tue, Sep 25, 2012 at 2:17 PM, Yapeng Wu <yapengwu at me.com> wrote:
> Thanks, Dan,
>
> The problem has been fixed as your suggested.
>
> Now I have another instance's meta-data problem during spawning instance,
> the following is the instance log message:
>
> udhcpc (v1.18.5) started
> Sending discover...
> Sending select for 10.0.0.3...
> Lease of 10.0.0.3 obtained, lease time 120
> deleting routers
> route: SIOCDELRT: No such process
> adding dns 10.0.0.2
> cloud-setup: checking
> http://169.254.169.254/2009-04-04/meta-data/instance-id
> wget: can't connect to remote host (169.254.169.254): Connection timed out
> cloud-setup: failed 1/30: up 15.71. request failed
> wget: can't connect to remote host (169.254.169.254): Connection timed out
> cloud-setup: failed 2/30: up 206.36. request failed
> wget: can't connect to remote host (169.254.169.254): Connection timed out
> cloud-setup: failed 3/30: up 396.83. request failed
>
>
> I changed the localrc as the following:
>
> disable_service n-net
> enable_service q-svc
> enable_service q-agt
> enable_service q-dhcp
> enable_service q-l3
> enable_service quantum
> Q_PLUGIN=openvswitch
>
> OVS_ENABLE_TUNNELING=False
> GUEST_INTERFACE_DEFAULT=eth0
>
> this is  /etc/quantum/l3_agent.ini:
> [DEFAULT]
> external_network_bridge = br-ex
> use_namespaces = True
> metadata_ip =
> debug = True
> verbose = True
>
>
> On Sep 25, 2012, at 02:12 PM, Dan Wendlandt <dan at nicira.com> wrote:
>
> Hi Yapeng,
>
> Sorry, I think the wiki page you were probably basing this is a bit
> out of date. I've updated it.
>
> The easy solution is to remove the line:
> LIBVIRT_FIREWALL_DRIVER=nova.virt.firewall.NoopFirewallDriver from
> your localrc
>
> The background on this is that the NoopFirewallDriver isn't compatible
> with any Nova vif-plugging that uses the Linux Bridge. This includes
> the LibvirtBridgeDriver, and the LibvirtHybridOVSBridgeDriver (which
> devstack now defaults to for Quantum with OVS plugin). This is
> being tracked here: https://bugs.launchpad.net/nova/+bug/1050433 . I
> suspect the fix could be just a simple if-check, and could probably be
> included in a later stable release. This bug hasn't really been a
> priority, as the main reason for using the
> LibvirtHybridOVSBridgeDriver is to work with nova security groups, and
> using the NoopFirewallDriver disables security groups.
>
> Dan
>
>
>
> On Tue, Sep 25, 2012 at 9:12 AM, Yapeng Wu <yapengwu at me.com> wrote:
>> Hello,
>>
>> When I tries to use devstack and quantum rc3 code base ( single node
>> environment in a VM, OpenVSwitch Plugin), the launch instance failed with
>> "libvir: Network Filter error : Network filter not found:: Could not find
>> filter 'nova-instance-instance-00000001-fa163e31fb45" error message in
>> Nova.
>>
>> devstack's localrc:
>> disable_service n-net
>> enable_service q-svc
>> enable_service q-agt
>> enable_service q-dhcp
>> enable_service quantum
>> LIBVIRT_FIREWALL_DRIVER=nova.virt.firewall.NoopFirewallDriver
>> Q_PLUGIN=openvswitch
>>
>> nova.conf:
>> [DEFAULT]$
>> verbose=True$
>> auth_strategy=keystone$
>> allow_resize_to_same_host=True$
>> rootwrap_config=/etc/nova/rootwrap.conf$
>> compute_scheduler_driver=nova.scheduler.filter_scheduler.FilterScheduler$
>> dhcpbridge_flagfile=/etc/nova/nova.conf$
>> fixed_range=10.0.0.0/24$
>> s3_host=192.168.0.111$
>> s3_port=3333$
>> network_api_class=nova.network.quantumv2.api.API$
>> quantum_admin_username=quantum$
>> quantum_admin_password=stack$
>> quantum_admin_auth_url=http://192.168.0.111:35357/v2.0$
>> quantum_auth_strategy=keystone$
>> quantum_admin_tenant_name=service$
>> quantum_url=http://localhost:9696$
>> libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver$
>> linuxnet_interface_driver=$
>>
>> osapi_compute_extension=nova.api.openstack.compute.contrib.standard_extensions$
>> my_ip=192.168.0.111$
>> sql_connection=mysql://root:stack@localhost/nova?charset=utf8$
>> libvirt_type=qemu$
>> libvirt_cpu_mode=none$
>> instance_name_template=instance-%08x$
>> novncproxy_base_url=http://192.168.0.111:6080/vnc_auto.html$
>> xvpvncproxy_base_url=http://192.168.0.111:6081/console$
>> vncserver_listen=127.0.0.1$
>> vncserver_proxyclient_address=127.0.0.1$
>> api_paste_config=/etc/nova/api-paste.ini$
>> image_service=nova.image.glance.GlanceImageService$
>> ec2_dmz_host=192.168.0.111$
>> rabbit_host=localhost$
>> rabbit_password=stack$
>> glance_api_servers=192.168.0.111:9292$
>> force_dhcp_release=True$
>> state_path=/opt/stack/data/nova$
>> instances_path=/opt/stack/data/nova/instances$
>> logging_context_format_string=%(asctime)s %(levelname)s %(name)s
>> [%(request_id)s %(user_name)s %(project_name)s] %(instance)s%(message)s$
>> volume_api_class=nova.volume.cinder.API$
>> compute_driver=libvirt.LibvirtDriver$
>> firewall_driver=nova.virt.firewall.NoopFirewallDriver$
>> enabled_apis=ec2,osapi_compute,metadata$
>>
>>
>> this is the instance's libvirt config from nova's log file:
>> 2012-09-25 11:36:08 DEBUG nova.virt.libvirt.config
>> [req-baee9add-d44b-449e-ac79-8d20bef14252 demo demo] Generated XML <domain
>> type="qemu">$
>> <uuid>1eb93cef-3bb9-43c3-aac9-728041698c44</uuid>$
>> <name>instance-00000001</name>$
>> <memory>524288</memory>$
>> <vcpu>1</vcpu>$
>> <os>$
>> <type>hvm</type>$
>>
>> <kernel>/opt/stack/data/nova/instances/instance-00000001/kernel</kernel>$
>>
>> <initrd>/opt/stack/data/nova/instances/instance-00000001/ramdisk</initrd>$
>> <cmdline>root=/dev/vda console=ttyS0</cmdline>$
>> </os>$
>> <features>$
>> <acpi/>$
>> </features>$
>> <clock offset="utc"/>$
>> <devices>$
>> <disk type="file" device="disk">$
>> <driver name="qemu" type="qcow2" cache="none"/>$
>> <source
>> file="/opt/stack/data/nova/instances/instance-00000001/disk"/>$
>> <target bus="virtio" dev="vda"/>$
>> </disk>$
>> <interface type="bridge">$
>> <mac address="fa:16:3e:31:fb:45"/>$
>> <source bridge="qbr4a87701a-bf"/>$
>> <filterref filter="nova-instance-instance-00000001-fa163e31fb45">$
>> <parameter name="IP" value="10.0.0.3"/>$
>> <parameter name="DHCPSERVER" value="10.0.0.2"/>$
>> <parameter name="PROJNET" value="10.0.0.0"/>$
>> <parameter name="PROJMASK" value="255.255.255.0"/>$
>> </filterref>$
>> </interface>$
>> <serial type="file">$
>> <source
>> path="/opt/stack/data/nova/instances/instance-00000001/console.log"/>$
>> </serial>$
>> <serial type="pty"/>$
>> <input type="tablet" bus="usb"/>$
>> <graphics type="vnc" autoport="yes" keymap="en-us" listen="127.0.0.1"/>$
>> </devices>$
>> </domain>$
>> from (pid=12179) to_xml /opt/stack/nova/nova/virt/libvirt/config.py:66$
>>
>> ...
>> libvir: Network Filter error : Network filter not found: Could not find
>> filter 'nova-instance-instance-00000001-fa163e31fb45'$
>> 2012-09-25 11:36:13 ERROR nova.compute.manager
>> [req-baee9add-d44b-449e-ac79-8d20bef14252 demo demo] [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] Instance failed to spawn$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] Traceback (most recent call last):$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/compute/manager.py", line 748, in _spawn$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] block_device_info)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/exception.py", line 117, in wrapped$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] temp_level, payload)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] self.gen.next()$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/exception.py", line 92, in wrapped$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] return f(*args, **kw)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1062, in spawn$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] block_device_info)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1888, in
>> _create_domain_and_network$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] domain = self._create_domain(xml)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/opt/stack/nova/nova/virt/libvirt/driver.py", line 1867, in
>> _create_domain$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44]
>> domain.createWithFlags(launch_flags)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
>> doit$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] result =
>> proxy_call(self._autowrap, f, *args, **kwargs)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
>> proxy_call$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] rv = execute(f,*args,**kwargs)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in
>> tworker$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] rv = meth(*args,**kwargs)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] File
>> "/usr/lib/python2.7/dist-packages/libvirt.py", line 581, in
>> createWithFlags$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] if ret == -1: raise libvirtError
>> ('virDomainCreateWithFlags() failed', dom=self)$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44] libvirtError: Network filter not
>> found: Could not find filter
>> 'nova-instance-instance-00000001-fa163e31fb45'$
>> 2012-09-25 11:36:13 TRACE nova.compute.manager [instance:
>> 1eb93cef-3bb9-43c3-aac9-728041698c44]-$
>>
>>
>> sudo ovs-vsctl show
>> ff5479be-2277-4e80-962e-9eed63b975ef
>> Bridge br-int
>> Port br-int
>> Interface br-int
>> type: internal
>> Port "qvo2f22c914-84"
>> tag: 1
>> Interface "qvo2f22c914-84"
>> Port "tapf6d67937-29"
>> tag: 1
>> Interface "tapf6d67937-29"
>> type: internal
>> ovs_version: "1.4.0+build0"
>>
>> Could someone on the list give me hint what went wrong?
>>
>> Thanks,
>> Yapeng
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Dan Wendlandt
> Nicira, Inc: www.nicira.com
> twitter: danwendlandt
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~
Dan Wendlandt
Nicira, Inc: www.nicira.com
twitter: danwendlandt
~~~~~~~~~~~~~~~~~~~~~~~~~~~



More information about the OpenStack-dev mailing list