Hello,
We 've a issue about running SR-IOV feature on OVS with Intel E810-C NIC.
Ovs configuration is shared. When try to attach interface to VM , gives error as below.
I wonder , can OVS work with Intel - SR-IOV ? Has anyone ever successed about it?
Best Regards,
OS: Ubuntu 20.04.4 LTS (GNU/Linux 5.13.0-40-lowlatency x86_64) **************** ovs_version: "2.15.2" **************** root@cmp15:/home/ulak# lspci |grep Eth b1:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02) b3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02) b3:01.0 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.1 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.2 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.3 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.4 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.5 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.6 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:01.7 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.0 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.1 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.2 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.3 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.4 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.5 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.6 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) b3:02.7 Ethernet controller: Intel Corporation Ethernet Adaptive Virtual Function (rev 02) **************** root@cmp15:/home/ulak# ethtool -i enp179s0 driver: ice version: 1.8.3 firmware-version: 3.00 0x80008271 1.2992.0 expansion-rom-version: bus-info: 0000:b3:00.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: yes **************** nova.conf [pci] passthrough_whitelist = { "address": "*:b1:00.*", "physical_network": null } passthrough_whitelist = { "address": "*:b3:00.*", "physical_network": null } passthrough_whitelist = { "address": "*:b3:01.*", "physical_network": null } passthrough_whitelist = { "address": "*:b3:02.*", "physical_network": null } passthrough_whitelist = { "devname": "enp177s0", "physical_network": null } passthrough_whitelist = { "devname": "enp179s0", "physical_network": null } passthrough_whitelist = { "vendor_id":"8086", "product_id":"1592", "physical_network": null } passthrough_whitelist = { "vendor_id":"8086", "product_id":"1889", "physical_network": null } passthrough_whitelist = { "address": "0000:b3:02.7", "physical_network": null } **************** root@cmp15:/home/ulak# dpdk-devbind.py -s
Network devices using kernel driver =================================== 0000:4b:00.0 'MT27710 Family [ConnectX-4 Lx] 1015' if=enp75s0f0 drv=mlx5_core unused=vfio-pci 0000:4b:00.1 'MT27710 Family [ConnectX-4 Lx] 1015' if=enp75s0f1 drv=mlx5_core unused=vfio-pci 0000:4c:00.0 'Ethernet Controller 10G X550T 1563' if=enp76s0f0 drv=ixgbe unused=vfio-pci 0000:4c:00.1 'Ethernet Controller 10G X550T 1563' if=enp76s0f1 drv=ixgbe unused=vfio-pci 0000:98:00.0 'MT2894 Family [ConnectX-6 Lx] 101f' if=enp152s0f0 drv=mlx5_core unused=vfio-pci 0000:98:00.1 'MT2894 Family [ConnectX-6 Lx] 101f' if=enp152s0f1 drv=mlx5_core unused=vfio-pci 0000:b1:00.0 'Ethernet Controller E810-C for QSFP 1592' if=enp177s0 drv=ice unused=vfio-pci 0000:b3:00.0 'Ethernet Controller E810-C for QSFP 1592' if=enp179s0 drv=ice unused=vfio-pci *Active* 0000:b3:01.0 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v0 drv=iavf unused=vfio-pci 0000:b3:01.1 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v1 drv=iavf unused=vfio-pci 0000:b3:01.2 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v2 drv=iavf unused=vfio-pci 0000:b3:01.3 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v3 drv=iavf unused=vfio-pci 0000:b3:01.4 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v4 drv=iavf unused=vfio-pci 0000:b3:01.5 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v5 drv=iavf unused=vfio-pci 0000:b3:01.6 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v6 drv=iavf unused=vfio-pci 0000:b3:01.7 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v7 drv=iavf unused=vfio-pci 0000:b3:02.0 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v8 drv=iavf unused=vfio-pci 0000:b3:02.1 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v9 drv=iavf unused=vfio-pci 0000:b3:02.2 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v10 drv=iavf unused=vfio-pci 0000:b3:02.3 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v11 drv=iavf unused=vfio-pci 0000:b3:02.4 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v12 drv=iavf unused=vfio-pci 0000:b3:02.5 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v13 drv=iavf unused=vfio-pci 0000:b3:02.6 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v14 drv=iavf unused=vfio-pci 0000:b3:02.7 'Ethernet Adaptive Virtual Function 1889' if=enp179s0v15 drv=iavf unused=vfio-pci /var/log/nova/nova-compute.log 2022-05-10 17:00:43.684 706104 INFO nova.virt.libvirt.driver [req-222a65f6-2db1-4dc1-b4c6-a08b016bfd8f 2896d201c5ed44d8813273c48bed5ba3 fe8aaa7d14f44459b6c46e230d538765 - default default] [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Deletion of /var/lib/nova/instances/e8adc95a-2d7c-40f9-a5ab-bbfa640418b7_del complete 2022-05-10 17:00:43.759 706104 INFO nova.compute.manager [req-222a65f6-2db1-4dc1-b4c6-a08b016bfd8f 2896d201c5ed44d8813273c48bed5ba3 fe8aaa7d14f44459b6c46e230d538765 - default default] [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Took 3.12 seconds to destroy the instance on the hypervisor. 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [req-222a65f6-2db1-4dc1-b4c6-a08b016bfd8f 2896d201c5ed44d8813273c48bed5ba3 fe8aaa7d14f44459b6c46e230d538765 - default default] [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Failed to build and run instance: nova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Traceback (most recent call last): 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/os_vif/__init__.py", line 77, in plug 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] plugin.plug(vif, instance_info) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 305, in plug 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self._plug_vf(vif, instance_info) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 269, in _plug_vf 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] pf_ifname = linux_net.get_ifname_by_pci_address( 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/vif_plug_ovs/linux_net.py", line 357, in get_ifname_by_pci_address 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] raise exception.PciDeviceNotFoundById(id=pci_addr) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] vif_plug_ovs.exception.PciDeviceNotFoundById: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Traceback (most recent call last): 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 696, in _plug_os_vif 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] os_vif.plug(vif, instance_info) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/os_vif/__init__.py", line 82, in plug 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] raise os_vif.exception.PlugException(vif=vif, err=err) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] os_vif.exception.PlugException: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] Traceback (most recent call last): 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2409, in _build_and_run_instance 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self.driver.spawn(context, instance, image_meta, 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 4172, in spawn 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self._create_guest_with_network( 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7240, in _create_guest_with_network 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self._cleanup( 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self.force_reraise() 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] raise self.value 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7205, in _create_guest_with_network 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self.plug_vifs(instance, network_info) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 1277, in plug_vifs 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self.vif_driver.plug(instance, vif) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 720, in plug 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] self._plug_os_vif(instance, vif_obj) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 700, in _plug_os_vif 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] raise exception.InternalError(msg) 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] nova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.304 706104 ERROR nova.compute.manager [instance: e8adc95a-2d7c-40f9-a5ab-bbfa640418b7] 2022-05-10 17:00:47.310 706104 ERROR os_vif [req-222a65f6-2db1-4dc1-b4c6-a08b016bfd8f 2896d201c5ed44d8813273c48bed5ba3 fe8aaa7d14f44459b6c46e230d538765 - default default] Failed to unplug vif VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True): vif_plug_ovs.exception.PciDeviceNotFoundById: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif Traceback (most recent call last): 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/os_vif/__init__.py", line 77, in plug 2022-05-10 17:00:47.310 706104 ERROR os_vif plugin.plug(vif, instance_info) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 305, in plug 2022-05-10 17:00:47.310 706104 ERROR os_vif self._plug_vf(vif, instance_info) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 269, in _plug_vf 2022-05-10 17:00:47.310 706104 ERROR os_vif pf_ifname = linux_net.get_ifname_by_pci_address( 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/linux_net.py", line 357, in get_ifname_by_pci_address 2022-05-10 17:00:47.310 706104 ERROR os_vif raise exception.PciDeviceNotFoundById(id=pci_addr) 2022-05-10 17:00:47.310 706104 ERROR os_vif vif_plug_ovs.exception.PciDeviceNotFoundById: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif Traceback (most recent call last): 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 696, in _plug_os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif os_vif.plug(vif, instance_info) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/os_vif/__init__.py", line 82, in plug 2022-05-10 17:00:47.310 706104 ERROR os_vif raise os_vif.exception.PlugException(vif=vif, err=err) 2022-05-10 17:00:47.310 706104 ERROR os_vif os_vif.exception.PlugException: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif Traceback (most recent call last): 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2409, in _build_and_run_instance 2022-05-10 17:00:47.310 706104 ERROR os_vif self.driver.spawn(context, instance, image_meta, 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 4172, in spawn 2022-05-10 17:00:47.310 706104 ERROR os_vif self._create_guest_with_network( 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7240, in _create_guest_with_network 2022-05-10 17:00:47.310 706104 ERROR os_vif self._cleanup( 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ 2022-05-10 17:00:47.310 706104 ERROR os_vif self.force_reraise() 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise 2022-05-10 17:00:47.310 706104 ERROR os_vif raise self.value 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 7205, in _create_guest_with_network 2022-05-10 17:00:47.310 706104 ERROR os_vif self.plug_vifs(instance, network_info) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/driver.py", line 1277, in plug_vifs 2022-05-10 17:00:47.310 706104 ERROR os_vif self.vif_driver.plug(instance, vif) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 720, in plug 2022-05-10 17:00:47.310 706104 ERROR os_vif self._plug_os_vif(instance, vif_obj) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/virt/libvirt/vif.py", line 700, in _plug_os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif raise exception.InternalError(msg) 2022-05-10 17:00:47.310 706104 ERROR os_vif nova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif Traceback (most recent call last): 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2232, in _do_build_and_run_instance 2022-05-10 17:00:47.310 706104 ERROR os_vif self._build_and_run_instance(context, instance, image, 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/nova/compute/manager.py", line 2505, in _build_and_run_instance 2022-05-10 17:00:47.310 706104 ERROR os_vif raise exception.RescheduledException( 2022-05-10 17:00:47.310 706104 ERROR os_vif nova.exception.RescheduledException: Build of instance e8adc95a-2d7c-40f9-a5ab-bbfa640418b7 was re-scheduled: Failure running os_vif plugin plug method: Failed to plug VIF VIFHostDevice(active=False,address=fa:16:3e:53:e0:10,dev_address=0000:b3:02.7,dev_type='ethernet',has_traffic_filtering=True,id=7ae16610-d6d9-461a-948f-9922cac62aae,network=Network(c260906e-04c6-4a49-a120-3389c7380247),plugin='ovs',port_profile=VIFPortProfileOVSRepresentor,preserve_on_delete=True). Got error: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif During handling of the above exception, another exception occurred: 2022-05-10 17:00:47.310 706104 ERROR os_vif 2022-05-10 17:00:47.310 706104 ERROR os_vif Traceback (most recent call last): 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/os_vif/__init__.py", line 110, in unplug 2022-05-10 17:00:47.310 706104 ERROR os_vif plugin.unplug(vif, instance_info) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 380, in unplug 2022-05-10 17:00:47.310 706104 ERROR os_vif self._unplug_vf(vif) 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/ovs.py", line 343, in _unplug_vf 2022-05-10 17:00:47.310 706104 ERROR os_vif pf_ifname = linux_net.get_ifname_by_pci_address( 2022-05-10 17:00:47.310 706104 ERROR os_vif File "/usr/lib/python3/dist-packages/vif_plug_ovs/linux_net.py", line 357, in get_ifname_by_pci_address 2022-05-10 17:00:47.310 706104 ERROR os_vif raise exception.PciDeviceNotFoundById(id=pci_addr) 2022-05-10 17:00:47.310 706104 ERROR os_vif vif_plug_ovs.exception.PciDeviceNotFoundById: PCI device 0000:b3:02.7 not found 2022-05-10 17:00:47.310 706104 ERROR os_vif