February 2023 - openstack-discuss

[openstack-dev][PCI passthrough] How to use PCI passthrough feature correctly? And is this BUG in update_devices_from_hypervisor_resources?
by Simon Jones 10 Mar '23

10 Mar '23

Hi all, I'm working on openstack Yoga's PCI passthrough feature, follow this link: https://docs.openstack.org/nova/latest/admin/pci-passthrough.html I configure exactly as the link said, but when I create server use this command, I found ERROR: ``` openstack server create --flavor cirros-os-dpu-test-1 --image cirros \ --nic net-id=066c8dc2-c98b-4fb8-a541-8b367e8f6e69 \ --security-group default --key-name mykey provider-instance | fault | {'code': 500, 'created': '2023-02-23T06:13:43Z', 'message': 'No valid host was found. There are not enough hosts available.', 'details': 'Traceback (most recent call last):\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 1548, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 908, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/usr/lib/python3/dist-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/usr/lib/python3/dist-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 189, in call\n result = self.transport._send(\n File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available.\nTraceback (most recent call last):\n\n File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/usr/lib/python3/dist-packages/nova/scheduler/manager.py", line 223, in select_destinations\n selections = self._select_destinations(\n\n File "/usr/lib/python3/dist-packages/nova/scheduler/manager.py", line 250, in _select_destinations\n selections = self._schedule(\n\n File "/usr/lib/python3/dist-packages/nova/scheduler/manager.py", line 416, in _schedule\n self._ensure_sufficient_hosts(\n\n File "/usr/lib/python3/dist-packages/nova/scheduler/manager.py", line 455, in _ensure_sufficient_hosts\n raise exception.NoValidHost(reason=reason)\n\nnova.exception.NoValidHost: No valid host was found. There are not enough hosts available.\n\n'} | // this is what I configured: gyw@c1:~$ openstack flavor show cirros-os-dpu-test-1 +----------------------------+------------------------------+ | Field | Value | +----------------------------+------------------------------+ | OS-FLV-DISABLED:disabled | False | | OS-FLV-EXT-DATA:ephemeral | 0 | | access_project_ids | None | | description | None | | disk | 1 | | id | 0 | | name | cirros-os-dpu-test-1 | | os-flavor-access:is_public | True | | properties | pci_passthrough:alias='a1:1' | | ram | 64 | | rxtx_factor | 1.0 | | swap | | | vcpus | 1 | +----------------------------+------------------------------+ // in controller node /etc/nova/nova.conf [filter_scheduler] enabled_filters = PciPassthroughFilter available_filters = nova.scheduler.filters.all_filters [pci] passthrough_whitelist = {"vendor_id": "15b3", "product_id": "101e", "physical_network": null, "remote_managed": "true"} alias = { "vendor_id":"15b3", "product_id":"101e", "device_type":"type-VF", "name":"a1" } // in compute node /etc/nova/nova.conf [pci] passthrough_whitelist = {"vendor_id": "15b3", "product_id": "101e", "physical_network": null, "remote_managed": "true"} alias = { "vendor_id":"15b3", "product_id":"101e", "device_type":"type-VF", "name":"a1" } ``` The detail ERROR I found is: - The reason why "There are not enough hosts available" is, nova-scheduler's log shows "There are 0 hosts available but 1 instances requested to build", which means no hosts support PCI passthough feature. This is nova-schduler's log ``` 2023-02-28 06:11:58.329 1942637 DEBUG nova.scheduler.manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Starting to schedule for instances: ['8ddfbe2c-f929-4b62-8b73-67902df8fb60'] select_destinations /usr/lib/python3/dist-packages/nova/scheduler/manager.py:141 2023-02-28 06:11:58.330 1942637 DEBUG nova.scheduler.request_filter [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED compute_status_filter /usr/lib/python3/dist-packages/nova/scheduler/request_filter.py:254 2023-02-28 06:11:58.330 1942637 DEBUG nova.scheduler.request_filter [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Request filter 'compute_status_filter' took 0.0 seconds wrapper /usr/lib/python3/dist-packages/nova/scheduler/request_filter.py:46 2023-02-28 06:11:58.331 1942637 DEBUG nova.scheduler.request_filter [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Request filter 'accelerators_filter' took 0.0 seconds wrapper /usr/lib/python3/dist-packages/nova/scheduler/request_filter.py:46 2023-02-28 06:11:58.332 1942637 DEBUG nova.scheduler.request_filter [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Request filter 'remote_managed_ports_filter' took 0.0 seconds wrapper /usr/lib/python3/dist-packages/nova/scheduler/request_filter.py:46 2023-02-28 06:11:58.485 1942637 DEBUG oslo_concurrency.lockutils [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Lock "567eb2f1-7173-4eee-b9e7-66932ed70fea" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s inner /usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py:386 2023-02-28 06:11:58.488 1942637 DEBUG oslo_concurrency.lockutils [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Lock "567eb2f1-7173-4eee-b9e7-66932ed70fea" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s inner /usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py:400 2023-02-28 06:11:58.494 1942637 DEBUG oslo_db.sqlalchemy.engines [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python3/dist-packages/oslo_db/sqlalchemy/engines.py:314 2023-02-28 06:11:58.520 1942637 INFO nova.scheduler.host_manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Host mapping not found for host c1c2. Not tracking instance info for this host. 2023-02-28 06:11:58.520 1942637 DEBUG oslo_concurrency.lockutils [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Lock "('c1c2', 'c1c2')" acquired by "nova.scheduler.host_manager.HostState.update.<locals>._locked_update" :: waited 0.000s inner /usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py:386 2023-02-28 06:11:58.521 1942637 DEBUG nova.scheduler.host_manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Update host state from compute node: ComputeNode(cpu_allocation_ratio=16.0,cpu_info='{"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sse4.2", "mds-no", "stibp", "pdpe1gb", "xsaveopt", "ht", "intel-pt", "mtrr", "abm", "tm", "lm", "umip", "mca", "pku", "ds_cpl", "rdrand", "adx", "rdseed", "lahf_lm", "xgetbv1", "nx", "invpcid", "rdtscp", "tsc", "xsavec", "pcid", "arch-capabilities", "pclmuldq", "spec-ctrl", "fsgsbase", "avx2", "md-clear", "vmx", "syscall", "mmx", "ds", "ssse3", "avx", "dtes64", "fxsr", "msr", "acpi", "vpclmulqdq", "smap", "erms", "pge", "cmov", "sha-ni", "fsrm", "x2apic", "xsaves", "cx8", "pse", "pse36", "clflushopt", "vaes", "pni", "ssbd", "movdiri", "movbe", "clwb", "xtpr", "de", "invtsc", "fpu", "tsc-deadline", "pae", "clflush", "ibrs-all", "waitpkg", "sse", "sse2", "bmi1", "3dnowprefetch", "cx16", "popcnt", "rdctl-no", "fma", "tsc_adjust", "xsave", "ss", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "monitor", "vme", "tm2", "pat", "pschange-mc-no", "movdir64b", "gfni", "mce", "smep", "sep", "apic", "arat", "f16c", "bmi2", "aes", "pbe", "est", "pdcm"]}',created_at=2023-02-14T03:19:40Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=415,free_disk_gb=456,free_ram_mb=31378,host='c1c2',host_ip=192.168.28.21,hypervisor_hostname='c1c2',hypervisor_type='QEMU',hypervisor_version=4002001,id=8,local_gb=456,local_gb_used=0,mapped=0,memory_mb=31890,memory_mb_used=512,metrics='[]',numa_topology='{" nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{" nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["cpuset", "memory_usage", "cpu_usage", "id", "pinned_cpus", "pcpuset", "socket", "network_metadata", "siblings", "mempages", "memory"]}]}, "nova_object.changes": ["cells"]}',pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.5,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec],updated_at=2023-02-28T06:01:33Z,uuid=c360cc82-f0fd-4662-bccd-e1f02b27af51,vcpus=12,vcpus_used=0) _locked_update /usr/lib/python3/dist-packages/nova/scheduler/host_manager.py:167 2023-02-28 06:11:58.524 1942637 DEBUG nova.scheduler.host_manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Update host state with aggregates: [] _locked_update /usr/lib/python3/dist-packages/nova/scheduler/host_manager.py:170 2023-02-28 06:11:58.524 1942637 DEBUG nova.scheduler.host_manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Update host state with service dict: {'id': 17, 'uuid': '6d0921a6-427d-4a82-a7d2-41dfa003125a', 'host': 'c1c2', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 121959, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2023, 2, 28, 6, 11, 49, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 61, 'created_at': datetime.datetime(2023, 2, 14, 3, 19, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 2, 28, 6, 11, 49, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} _locked_update /usr/lib/python3/dist-packages/nova/scheduler/host_manager.py:173 2023-02-28 06:11:58.524 1942637 DEBUG nova.scheduler.host_manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Update host state with instances: [] _locked_update /usr/lib/python3/dist-packages/nova/scheduler/host_manager.py:176 2023-02-28 06:11:58.525 1942637 DEBUG oslo_concurrency.lockutils [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Lock "('c1c2', 'c1c2')" "released" by "nova.scheduler.host_manager.HostState.update.<locals>._locked_update" :: held 0.004s inner /usr/lib/python3/dist-packages/oslo_concurrency/lockutils.py:400 2023-02-28 06:11:58.525 1942637 DEBUG nova.filters [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Starting with 1 host(s) get_filtered_objects /usr/lib/python3/dist-packages/nova/filters.py:70 2023-02-28 06:11:58.526 1942637 DEBUG nova.pci.stats [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] ---- before ---- _filter_pools /usr/lib/python3/dist-packages/nova/pci/stats.py:542 2023-02-28 06:11:58.526 1942637 DEBUG nova.pci.stats [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] [] _filter_pools /usr/lib/python3/dist-packages/nova/pci/stats.py:543 2023-02-28 06:11:58.526 1942637 DEBUG nova.pci.stats [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] ---- after ---- _filter_pools /usr/lib/python3/dist-packages/nova/pci/stats.py:545 2023-02-28 06:11:58.527 1942637 DEBUG nova.pci.stats [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] [] _filter_pools /usr/lib/python3/dist-packages/nova/pci/stats.py:546 2023-02-28 06:11:58.527 1942637 DEBUG nova.pci.stats [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Not enough PCI devices left to satisfy request _filter_pools /usr/lib/python3/dist-packages/nova/pci/stats.py:556 2023-02-28 06:11:58.527 1942637 DEBUG nova.scheduler.filters.pci_passthrough_filter [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] (c1c2, c1c2) ram: 31378MB disk: 424960MB io_ops: 0 instances: 0 doesn't have the required PCI devices (InstancePCIRequests(instance_uuid=<?>,requests=[InstancePCIRequest])) host_passes /usr/lib/python3/dist-packages/nova/scheduler/filters/pci_passthrough_filter.py:52 2023-02-28 06:11:58.528 1942637 INFO nova.filters [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Filter PciPassthroughFilter returned 0 hosts 2023-02-28 06:11:58.528 1942637 DEBUG nova.filters [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Filtering removed all hosts for the request with instance ID '8ddfbe2c-f929-4b62-8b73-67902df8fb60'. Filter results: [('PciPassthroughFilter', None)] get_filtered_objects /usr/lib/python3/dist-packages/nova/filters.py:114 2023-02-28 06:11:58.528 1942637 INFO nova.filters [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Filtering removed all hosts for the request with instance ID '8ddfbe2c-f929-4b62-8b73-67902df8fb60'. Filter results: ['PciPassthroughFilter: (start: 1, end: 0)'] 2023-02-28 06:11:58.529 1942637 DEBUG nova.scheduler.manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] Filtered [] _get_sorted_hosts /usr/lib/python3/dist-packages/nova/scheduler/manager.py:610 2023-02-28 06:11:58.529 1942637 DEBUG nova.scheduler.manager [req-13b1baee-e02d-40fc-926d-d497e70ca0dc ff627ad39ed94479b9c5033bc462cf78 512866f9994f4ad8916d8539a7cdeec9 - default default] There are 0 hosts available but 1 instances requested to build. _ensure_sufficient_hosts /usr/lib/python3/dist-packages/nova/scheduler/manager.py:450 ``` Then I search database, I found PCI configure of compute node is not upload: ``` gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 PCI_DEVICE No inventory of class PCI_DEVICE for c360cc82-f0fd-4662-bccd-e1f02b27af51 (HTTP 404) gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 PCI_DEVICE No inventory of class PCI_DEVICE for c360cc82-f0fd-4662-bccd-e1f02b27af51 (HTTP 404) gyw@c1:~$ openstack resource class show PCI_DEVICE +-------+------------+ | Field | Value | +-------+------------+ | name | PCI_DEVICE | +-------+------------+ gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 MEMORY_MB +------------------+-------+ | Field | Value | +------------------+-------+ | allocation_ratio | 1.5 | | min_unit | 1 | | max_unit | 31890 | | reserved | 512 | | step_size | 1 | | total | 31890 | | used | 0 | +------------------+-------+ 这个 31890 能跟上面compute node resource tracker上报的日志对上。 gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 VCPU 、^Cgyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 VCPU +------------------+-------+ | Field | Value | +------------------+-------+ | allocation_ratio | 16.0 | | min_unit | 1 | | max_unit | 12 | | reserved | 0 | | step_size | 1 | | total | 12 | | used | 0 | +------------------+-------+ gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 SRIOV_NET_VF No inventory of class SRIOV_NET_VF for c360cc82-f0fd-4662-bccd-e1f02b27af51 (HTTP 404) gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 DISK_GB +------------------+-------+ | Field | Value | +------------------+-------+ | allocation_ratio | 1.0 | | min_unit | 1 | | max_unit | 456 | | reserved | 0 | | step_size | 1 | | total | 456 | | used | 0 | +------------------+-------+ gyw@c1:~$ openstack resource provider inventory show c360cc82-f0fd-4662-bccd-e1f02b27af51 IPV4_ADDRESS No inventory of class IPV4_ADDRESS for c360cc82-f0fd-4662-bccd-e1f02b27af51 (HTTP 404) MariaDB [nova]> select * from compute_nodes; +---------------------+---------------------+---------------------+----+------------+-------+-----------+----------+------------+----------------+---------------+-----------------+--------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------+--------------+------------------+-------------+---------------------+---------+---------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+-----------------+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+----------------------+----------------------+--------------------------------------+-----------------------+--------+ | created_at | updated_at | deleted_at | id | service_id | vcpus | memory_mb | local_gb | vcpus_used | memory_mb_used | local_gb_used | hypervisor_type | hypervisor_version | cpu_info | disk_available_least | free_ram_mb | free_disk_gb | current_workload | running_vms | hypervisor_hostname | deleted | host_ip | supported_instances | pci_stats | metrics | extra_resources | stats | numa_topology | host | ram_allocation_ratio | cpu_allocation_ratio | uuid | disk_allocation_ratio | mapped | +---------------------+---------------------+---------------------+----+------------+-------+-----------+----------+------------+----------------+---------------+-----------------+--------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------+--------------+------------------+-------------+---------------------+---------+---------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+-----------------+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+----------------------+----------------------+--------------------------------------+-----------------------+--------+ | 2023-01-04 01:55:44 | 2023-01-04 03:02:28 | 2023-02-13 08:34:08 | 1 | NULL | 4 | 3931 | 60 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 4, "cores": 1, "threads": 1}, "features": ["pat", "cmov", "ibrs-all", "pge", "sse4.2", "sse", "mmx", "ibrs", "avx2", "syscall", "fpu", "mtrr", "xsaves", "mce", "invpcid", "tsc_adjust", "ssbd", "pku", "ibpb", "xsave", "xsaveopt", "pae", "lm", "pdcm", "bmi1", "avx512vnni", "stibp", "x2apic", "avx512dq", "pcid", "nx", "bmi2", "erms", "3dnowprefetch", "de", "avx512bw", "arch-capabilities", "pni", "fma", "rdctl-no", "sse4.1", "rdseed", "arat", "avx512vl", "avx512f", "pclmuldq", "msr", "fxsr", "sse2", "amd-stibp", "hypervisor", "tsx-ctrl", "clflushopt", "cx16", "clwb", "xgetbv1", "xsavec", "adx", "rdtscp", "mds-no", "cx8", "aes", "tsc-deadline", "pse36", "fsgsbase", "umip", "spec-ctrl", "lahf_lm", "md-clear", "avx512cd", "amd-ssbd", "vmx", "apic", "f16c", "pse", "tsc", "movbe", "smep", "ss", "pschange-mc-no", "ssse3", "popcnt", "avx", "vme", "smap", "pdpe1gb", "mca", "skip-l1dfl-vmentry", "abm", "sep", "clflush", "rdrand"]} | 49 | 3419 | 60 | 0 | 0 | gyw | 1 | 192.168.2.99 | [["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"]] | {"nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3], "pcpuset": [0, 1, 2, 3], "memory": 3931, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0], [1], [2], [3]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 1006396, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "reserved", "size_kb", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "reserved", "size_kb", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "reserved", "size_kb", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": null}, "nova_object.changes": ["cpuset", "pinned_cpus", "mempages", "network_metadata", "cpu_usage", "pcpuset", "memory", "id", "socket", "siblings", "memory_usage"]}]}, "nova_object.changes": ["cells"]} | gyw | 1.5 | 16 | b1bf35bd-a9ad-4f0c-9033-776a5c6d1c9b | 1 | 1 | | 2023-01-04 03:12:17 | 2023-01-31 06:36:36 | 2023-02-23 08:50:29 | 2 | NULL | 4 | 3931 | 60 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 4, "cores": 1, "threads": 1}, "features": ["pclmuldq", "fsgsbase", "f16c", "fxsr", "ibpb", "adx", "movbe", "aes", "x2apic", "abm", "mtrr", "arat", "sse4.2", "bmi1", "stibp", "sse4.1", "pae", "vme", "msr", "skip-l1dfl-vmentry", "fma", "pcid", "avx2", "de", "ibrs-all", "ssse3", "apic", "umip", "xsavec", "3dnowprefetch", "amd-ssbd", "sse", "nx", "fpu", "pse", "smap", "smep", "lahf_lm", "pni", "spec-ctrl", "xsave", "xsaves", "rdtscp", "vmx", "avx512f", "cmov", "invpcid", "hypervisor", "erms", "rdctl-no", "cx16", "cx8", "tsc", "pge", "pdcm", "rdrand", "avx", "amd-stibp", "avx512vl", "xsaveopt", "mds-no", "popcnt", "clflushopt", "sse2", "xgetbv1", "rdseed", "pdpe1gb", "pschange-mc-no", "clwb", "avx512vnni", "mca", "tsx-ctrl", "tsc_adjust", "syscall", "pse36", "mmx", "avx512cd", "avx512bw", "pku", "tsc-deadline", "arch-capabilities", "avx512dq", "ssbd", "clflush", "mce", "ss", "pat", "bmi2", "lm", "ibrs", "sep", "md-clear"]} | 49 | 3419 | 60 | 0 | 0 | c1c1 | 2 | 192.168.2.99 | [["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"]] | {"nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3], "pcpuset": [0, 1, 2, 3], "memory": 3931, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0], [1], [2], [3]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 1006393, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "total", "size_kb", "reserved"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "total", "size_kb", "reserved"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "total", "size_kb", "reserved"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["tunneled", "physnets"]}, "socket": null}, "nova_object.changes": ["memory_usage", "socket", "cpuset", "siblings", "id", "mempages", "pinned_cpus", "memory", "pcpuset", "network_metadata", "cpu_usage"]}]}, "nova_object.changes": ["cells"]} | c1c1 | 1.5 | 16 | 1eac1c8d-d96a-4eeb-9868-5a341a80c6df | 1 | 0 | | 2023-02-07 08:25:27 | 2023-02-07 08:25:27 | 2023-02-13 08:34:22 | 3 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sha-ni", "intel-pt", "pat", "monitor", "movbe", "nx", "msr", "avx2", "md-clear", "popcnt", "rdseed", "pse36", "mds-no", "ds", "sse", "fsrm", "rdctl-no", "pse", "dtes64", "ds_cpl", "xgetbv1", "lahf_lm", "smep", "waitpkg", "smap", "fsgsbase", "sep", "tsc_adjust", "cmov", "ibrs-all", "mtrr", "cx16", "f16c", "arch-capabilities", "pclmuldq", "clflush", "erms", "umip", "xsaves", "xsavec", "ssse3", "acpi", "tsc", "movdir64b", "vpclmulqdq", "skip-l1dfl-vmentry", "xsave", "arat", "mmx", "rdpid", "sse2", "ssbd", "pdpe1gb", "spec-ctrl", "adx", "pcid", "de", "pku", "est", "pae", "tsc-deadline", "pdcm", "clwb", "vme", "rdtscp", "fxsr", "3dnowprefetch", "invpcid", "x2apic", "tm", "lm", "fma", "bmi1", "sse4.1", "abm", "xsaveopt", "pschange-mc-no", "syscall", "clflushopt", "pbe", "avx", "cx8", "vmx", "gfni", "fpu", "mce", "tm2", "movdiri", "invtsc", "apic", "bmi2", "mca", "pge", "rdrand", "xtpr", "sse4.2", "stibp", "ht", "ss", "pni", "vaes", "aes"]} | 416 | 31378 | 456 | 0 | 0 | c-MS-7D42 | 3 | 192.168.2.99 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {" nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163866, "used": 0, "reserved": 0}, "nova_object.changes": ["total", "reserved", "used", "size_kb"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["total", "reserved", "used", "size_kb"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["total", "reserved", "used", "size_kb"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["network_metadata", "cpuset", "mempages", "id", "socket", "cpu_usage", "memory", "pinned_cpus", "pcpuset", "siblings", "memory_usage"]}]}, "nova_object.changes": ["cells"]} | c-MS-7D42 | 1.5 | 16 | f115a1c2-fda3-42c6-945a-8b54fef40daf | 1 | 0 | | 2023-02-07 09:53:12 | 2023-02-13 08:38:04 | 2023-02-13 08:39:33 | 4 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["rdctl-no", "acpi", "umip", "invpcid", "bmi1", "clflushopt", "pclmuldq", "movdir64b", "ssbd", "apic", "rdpid", "ht", "fsrm", "pni", "pse", "xsaves", "cx16", "nx", "f16c", "arat", "popcnt", "mtrr", "vpclmulqdq", "intel-pt", "spec-ctrl", "syscall", "3dnowprefetch", "ds", "mce", "bmi2", "tm2", "md-clear", "fpu", "monitor", "pae", "erms", "dtes64", "tsc", "fsgsbase", "xgetbv1", "est", "mds-no", "tm", "x2apic", "xsavec", "cx8", "stibp", "clflush", "ssse3", "pge", "movdiri", "pdpe1gb", "vaes", "gfni", "mmx", "clwb", "waitpkg", "xsaveopt", "pse36", "aes", "pschange-mc-no", "sse2", "abm", "ss", "pcid", "sep", "rdseed", "mca", "skip-l1dfl-vmentry", "pat", "smap", "sse", "lahf_lm", "avx", "cmov", "sse4.1", "sse4.2", "ibrs-all", "smep", "vme", "tsc_adjust", "arch-capabilities", "fma", "movbe", "adx", "avx2", "xtpr", "pku", "pbe", "rdrand", "tsc-deadline", "pdcm", "ds_cpl", "de", "invtsc", "xsave", "msr", "fxsr", "lm", "vmx", "sha-ni", "rdtscp"]} | 416 | 31378 | 456 | 0 | 0 | c-MS-7D42 | 4 | 192.168.28.21 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {" nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163866, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "total", "used", "reserved"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "total", "used", "reserved"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "total", "used", "reserved"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["siblings", "cpuset", "mempages", "socket", "pcpuset", "memory", "memory_usage", "id", "network_metadata", "cpu_usage", "pinned_cpus"]}]}, "nova_object.changes": ["cells"]} | c1c2 | 1.5 | 16 | 10ea8254-ad84-4db9-9acd-5c783cb8600e | 1 | 0 | | 2023-02-13 08:41:21 | 2023-02-13 08:41:22 | 2023-02-13 09:56:50 | 5 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["bmi2", "ht", "pae", "pku", "monitor", "avx2", "sha-ni", "acpi", "ssbd", "syscall", "mca", "mmx", "mds-no", "erms", "fsrm", "arat", "xsaves", "movbe", "movdir64b", "fpu", "clflush", "nx", "mce", "pse", "cx8", "aes", "avx", "xsavec", "invpcid", "est", "xgetbv1", "fxsr", "rdrand", "vaes", "cmov", "intel-pt", "smep", "dtes64", "f16c", "adx", "sse2", "stibp", "rdseed", "xsave", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "ds", "umip", "pni", "rdctl-no", "clwb", "md-clear", "pschange-mc-no", "msr", "popcnt", "sse4.2", "pge", "tm2", "pat", "xtpr", "fma", "gfni", "sep", "ibrs-all", "tsc", "ds_cpl", "tm", "clflushopt", "pcid", "de", "rdtscp", "vme", "cx16", "lahf_lm", "ss", "pdcm", "x2apic", "pbe", "movdiri", "tsc-deadline", "invtsc", "apic", "fsgsbase", "mtrr", "vpclmulqdq", "ssse3", "3dnowprefetch", "abm", "xsaveopt", "tsc_adjust", "pse36", "pclmuldq", "bmi1", "smap", "arch-capabilities", "lm", "vmx", "sse", "pdpe1gb", "spec-ctrl", "waitpkg"]} | 416 | 31378 | 456 | 0 | 0 | c-MS-7D42 | 5 | 192.168.28.21 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {"nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163866, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "size_kb", "total", "reserved"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "size_kb", "total", "reserved"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["used", "size_kb", "total", "reserved"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["tunneled", "physnets"]}, "socket": 0}, "nova_object.changes": ["pinned_cpus", "cpuset", "memory_usage", "id", "cpu_usage", "network_metadata", "siblings", "mempages", "socket", "memory", "pcpuset"]}]}, "nova_object.changes": ["cells"]} | c1c2 | 1.5 | 16 | 8efa100f-ab14-45fd-8c39-644b49772883 | 1 | 0 | | 2023-02-13 09:57:30 | 2023-02-13 09:57:31 | 2023-02-13 13:52:57 | 6 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["rdpid", "intel-pt", "fxsr", "pclmuldq", "xsaveopt", "pae", "xsave", "movdiri", "syscall", "ibrs-all", "mmx", "tsc_adjust", "abm", "ssbd", "sse", "mce", "clwb", "vmx", "dtes64", "ssse3", "fsrm", "est", "bmi1", "mtrr", "avx2", "pse36", "pat", "gfni", "mds-no", "clflushopt", "cmov", "fma", "sep", "mca", "ss", "umip", "popcnt", "skip-l1dfl-vmentry", "ht", "sha-ni", "pdcm", "pdpe1gb", "rdrand", "pge", "lahf_lm", "aes", "xsavec", "pni", "smep", "md-clear", "waitpkg", "tm", "xgetbv1", "stibp", "apic", "vaes", "fpu", "ds_cpl", "ds", "sse4.2", "3dnowprefetch", "smap", "x2apic", "vpclmulqdq", "acpi", "avx", "de", "pbe", "sse2", "xsaves", "monitor", "clflush", "tm2", "pschange-mc-no", "bmi2", "movbe", "pku", "pcid", "xtpr", "erms", "movdir64b", "cx8", "nx", "rdctl-no", "invpcid", "spec-ctrl", "tsc", "adx", "invtsc", "f16c", "rdtscp", "vme", "pse", "lm", "cx16", "fsgsbase", "rdseed", "msr", "sse4.1", "arch-capabilities", "arat", "tsc-deadline"]} | 416 | 31378 | 456 | 0 | 0 | c-MS-7D42 | 6 | 192.168.28.21 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {" nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163866, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "total", "reserved"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "total", "reserved"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "total", "reserved"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["memory_usage", "id", "mempages", "pinned_cpus", "network_metadata", "pcpuset", "cpuset", "siblings", "socket", "cpu_usage", "memory"]}]}, "nova_object.changes": ["cells"]} | c1c2 | 1.5 | 16 | 8f5b58c5-d5d7-452c-9ec7-cff24baf6c94 | 1 | 0 | | 2023-02-14 01:35:43 | 2023-02-14 01:35:43 | 2023-02-14 03:16:51 | 7 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["pcid", "pse36", "movdir64b", "apic", "nx", "vpclmulqdq", "mtrr", "popcnt", "pdcm", "fsgsbase", "lahf_lm", "sse2", "pae", "aes", "movdiri", "xsaves", "erms", "invtsc", "waitpkg", "pbe", "ht", "pni", "avx2", "rdpid", "fxsr", "tm2", "pku", "x2apic", "fma", "pge", "rdseed", "pdpe1gb", "mmx", "sse4.1", "sha-ni", "xtpr", "tsc_adjust", "cx16", "xsave", "cx8", "mce", "md-clear", "gfni", "clwb", "msr", "abm", "f16c", "ss", "xsaveopt", "ds_cpl", "pse", "syscall", "cmov", "3dnowprefetch", "ssse3", "pclmuldq", "arch-capabilities", "ibrs-all", "arat", "ds", "pat", "invpcid", "vaes", "xsavec", "mds-no", "tm", "smep", "acpi", "fsrm", "movbe", "fpu", "sse4.2", "umip", "rdtscp", "tsc-deadline", "skip-l1dfl-vmentry", "est", "rdctl-no", "clflush", "spec-ctrl", "tsc", "lm", "avx", "vmx", "clflushopt", "rdrand", "dtes64", "smap", "ssbd", "sse", "xgetbv1", "stibp", "mca", "adx", "vme", "bmi1", "pschange-mc-no", "intel-pt", "de", "monitor", "bmi2", "sep"]} | 416 | 31378 | 456 | 0 | 0 | c-MS-7D42 | 7 | 192.168.28.21 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {"nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163866, "used": 0, "reserved": 0}, "nova_object.changes": ["reserved", "total", "used", "size_kb"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["reserved", "total", "used", "size_kb"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["reserved", "total", "used", "size_kb"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["tunneled", "physnets"]}, "socket": 0}, "nova_object.changes": ["pcpuset", "mempages", "socket", "cpu_usage", "memory_usage", "siblings", "memory", "pinned_cpus", "network_metadata", "cpuset", "id"]}]}, "nova_object.changes": ["cells"]} | c1c2 | 1.5 | 16 | 9f81894d-028d-4bb0-ada0-116159b13ed8 | 1 | 0 | | 2023-02-14 03:19:40 | 2023-02-28 07:30:14 | NULL | 8 | NULL | 12 | 31890 | 456 | 0 | 512 | 0 | QEMU | 4002001 | {"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["ds_cpl", "vpclmulqdq", "pbe", "lahf_lm", "clflush", "xsaveopt", "bmi2", "clwb", "skip-l1dfl-vmentry", "de", "cmov", "pku", "acpi", "xsavec", "3dnowprefetch", "mmx", "mtrr", "vmx", "movbe", "ssse3", "adx", "syscall", "spec-ctrl", "abm", "umip", "fxsr", "pge", "vme", "xsave", "rdctl-no", "rdrand", "sse", "cx8", "gfni", "dtes64", "invpcid", "md-clear", "fsrm", "fma", "arat", "rdtscp", "tsc", "sse4.1", "xsaves", "est", "tm", "ibrs-all", "stibp", "fsgsbase", "cx16", "arch-capabilities", "ssbd", "pse", "avx", "pse36", "pdpe1gb", "tm2", "nx", "pdcm", "sse4.2", "erms", "sep", "aes", "mca", "invtsc", "bmi1", "rdseed", "ss", "ht", "x2apic", "movdir64b", "rdpid", "lm", "tsc-deadline", "msr", "mce", "smep", "avx2", "sse2", "pschange-mc-no", "intel-pt", "tsc_adjust", "ds", "monitor", "popcnt", "f16c", "pae", "movdiri", "xgetbv1", "pcid", "pni", "pclmuldq", "xtpr", "apic", "mds-no", "sha-ni", "smap", "vaes", "waitpkg", "pat", "fpu", "clflushopt"]} | 415 | 31378 | 456 | 0 | 0 | c1c2 | 0 | 192.168.28.21 | [["alpha", "qemu", "hvm"], ["armv7l", "qemu", "hvm"], ["aarch64", "qemu", "hvm"], ["cris", "qemu", "hvm"], ["i686", "qemu", "hvm"], ["i686", "kvm", "hvm"], ["lm32", "qemu", "hvm"], ["m68k", "qemu", "hvm"], ["microblaze", "qemu", "hvm"], ["microblazeel", "qemu", "hvm"], ["mips", "qemu", "hvm"], ["mipsel", "qemu", "hvm"], ["mips64", "qemu", "hvm"], ["mips64el", "qemu", "hvm"], ["ppc", "qemu", "hvm"], ["ppc64", "qemu", "hvm"], ["ppc64le", "qemu", "hvm"], ["s390x", "qemu", "hvm"], ["sh4", "qemu", "hvm"], ["sh4eb", "qemu", "hvm"], ["sparc", "qemu", "hvm"], ["sparc64", "qemu", "hvm"], ["unicore32", "qemu", "hvm"], ["x86_64", "qemu", "hvm"], ["x86_64", "kvm", "hvm"], ["xtensa", "qemu", "hvm"], ["xtensaeb", "qemu", "hvm"]] | {"nova_object.name": "PciDevicePoolList", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"objects": []}, "nova_object.changes": ["objects"]} | [] | NULL | {"failed_builds": "0"} | {"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "reserved", "total", "used"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "reserved", "total", "used"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "reserved", "total", "used"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["tunneled", "physnets"]}, "socket": 0}, "nova_object.changes": ["cpu_usage", "siblings", "id", "pcpuset", "cpuset", "network_metadata", "memory", "pinned_cpus", "memory_usage", "socket", "mempages"]}]}, "nova_object.changes": ["cells"]} | c1c2 | 1.5 | 16 | c360cc82-f0fd-4662-bccd-e1f02b27af51 | 1 | 0 | +---------------------+---------------------+---------------------+----+------------+-------+-----------+----------+------------+----------------+---------------+-----------------+--------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------+--------------+------------------+-------------+---------------------+---------+---------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+-----------------+------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+----------------------+----------------------+--------------------------------------+-----------------------+--------+ 8 rows in set (0.001 sec) ``` Then I search code, I found these infomation is upload in compute node's nova-compute, in the init process in nova/compute/resource_tracker.py:_init_compute_node Then I add some debug log, I found in _init_compute_node, there are PCI configure which read from /etc/nova/nova.conf, but in _setup_pci_tracker pop these infomation, this is code: ``` def _setup_pci_tracker(self, context, compute_node, resources): if not self.pci_tracker: LOG.debug("_setup_pci_tracker 11111") LOG.debug(resources) # 2023-02-28 14:01:33.782 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] _setup_pci_tracker 11111 _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:772 # 2023-02-28 14:01:33.782 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] {'supported_instances': [('alpha', 'qemu', 'hvm'), ('armv7l', 'qemu', 'hvm'), ('aarch64', 'qemu', 'hvm'), ('cris', 'qemu', 'hvm'), ('i686', 'qemu', 'hvm'), ('i686', 'kvm', 'hvm'), ('lm32', 'qemu', 'hvm'), ('m68k', 'qemu', 'hvm'), ('microblaze', 'qemu', 'hvm'), ('microblazeel', 'qemu', 'hvm'), ('mips', 'qemu', 'hvm'), ('mipsel', 'qemu', 'hvm'), ('mips64', 'qemu', 'hvm'), ('mips64el', 'qemu', 'hvm'), ('ppc', 'qemu', 'hvm'), ('ppc64', 'qemu', 'hvm'), ('ppc64le', 'qemu', 'hvm'), ('s390x', 'qemu', 'hvm'), ('sh4', 'qemu', 'hvm'), ('sh4eb', 'qemu', 'hvm'), ('sparc', 'qemu', 'hvm'), ('sparc64', 'qemu', 'hvm'), ('unicore32', 'qemu', 'hvm'), ('x86_64', 'qemu', 'hvm'), ('x86_64', 'kvm', 'hvm'), ('xtensa', 'qemu', 'hvm'), ('xtensaeb', 'qemu', 'hvm')], 'vcpus': 12, 'memory_mb': 31890, 'local_gb': 456.8854446411133, 'vcpus_used': 0, 'memory_mb_used': 3856, 'local_gb_used': 18.015335083007812, 'hypervisor_type': 'QEMU', 'hypervisor_version': 4002001, 'hypervisor_hostname': 'c1c2', 'cpu_info': '{"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sse4.2", "mds-no", "stibp", "pdpe1gb", "xsaveopt", "ht", "intel-pt", "mtrr", "abm", "tm", "lm", "umip", "mca", "pku", "ds_cpl", "rdrand", "adx", "rdseed", "lahf_lm", "xgetbv1", "nx", "invpcid", "rdtscp", "tsc", "xsavec", "pcid", "arch-capabilities", "pclmuldq", "spec-ctrl", "fsgsbase", "avx2", "md-clear", "vmx", "syscall", "mmx", "ds", "ssse3", "avx", "dtes64", "fxsr", "msr", "acpi", "vpclmulqdq", "smap", "erms", "pge", "cmov", "sha-ni", "fsrm", "x2apic", "xsaves", "cx8", "pse", "pse36", "clflushopt", "vaes", "pni", "ssbd", "movdiri", "movbe", "clwb", "xtpr", "de", "invtsc", "fpu", "tsc-deadline", "pae", "clflush", "ibrs-all", "waitpkg", "sse", "sse2", "bmi1", "3dnowprefetch", "cx16", "popcnt", "rdctl-no", "fma", "tsc_adjust", "xsave", "ss", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "monitor", "vme", "tm2", "pat", "pschange-mc-no", "movdir64b", "gfni", "mce", "smep", "sep", "apic", "arat", "f16c", "bmi2", "aes", "pbe", "est", "pdcm"]}', 'disk_available_least': 415.5914993286133, 'pci_passthrough_devices': '[{"dev_id": "pci_0000_02_00_0", "address": "0000:02:00.0", "product_id": "a809", "vendor_id": "144d", "numa_node": 0, "label": "label_144d_a809", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_5", "address": "0000:01:00.5", "product_id": "101e", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_101e", "dev_type": "type-VF", "parent_addr": "0000:01:00.0", "parent_ifname": "enp1s0f0np0", "capabilities": {"network": ["rx", "tx", "sg", "tso", "gso", "gro", "rxvlan", "txvlan", "rxhash", "rdma", "txudptnl"]}}, {"dev_id": "pci_0000_00_1c_0", "address": "0000:00:1c.0", "product_id": "7ab8", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ab8", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_08_0", "address": "0000:00:08.0", "product_id": "464f", "vendor_id": "8086", "numa_node": null, "label": "label_8086_464f", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_4", "address": "0000:00:1f.4", "product_id": "7aa3", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7aa3", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_3", "address": "0000:01:00.3", "product_id": "101e", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_101e", "dev_type": "type-VF", "parent_addr": "0000:01:00.0", "parent_ifname": "enp1s0f0np0", "capabilities": {"network": ["rx", "tx", "sg", "tso", "gso", "gro", "rxvlan", "txvlan", "rxhash", "rdma", "txudptnl"]}}, {"dev_id": "pci_0000_00_06_0", "address": "0000:00:06.0", "product_id": "464d", "vendor_id": "8086", "numa_node": null, "label": "label_8086_464d", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "7ae2", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ae2", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_5", "address": "0000:00:1f.5", "product_id": "7aa4", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7aa4", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_6", "address": "0000:01:00.6", "product_id": "101e", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_101e", "dev_type": "type-VF", "parent_addr": "0000:01:00.0", "parent_ifname": "enp1s0f0np0", "capabilities": {"network": ["rx", "tx", "sg", "tso", "gso", "gro", "rxvlan", "txvlan", "rxhash", "rdma", "txudptnl"]}}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "7a86", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7a86", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "4692", "vendor_id": "8086", "numa_node": null, "label": "label_8086_4692", "dev_type": "type-PF"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "7ae8", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ae8", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1c_1", "address": "0000:00:1c.1", "product_id": "7ab9", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ab9", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1c_3", "address": "0000:00:1c.3", "product_id": "7abb", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7abb", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "8125", "vendor_id": "10ec", "numa_node": null, "label": "label_10ec_8125", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "4650", "vendor_id": "8086", "numa_node": null, "label": "label_8086_4650", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "460d", "vendor_id": "8086", "numa_node": null, "label": "label_8086_460d", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "a2d6", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_a2d6", "dev_type": "type-PF", "mac_address": "08:c0:eb:8e:bd:f4"}, {"dev_id": "pci_0000_01_00_2", "address": "0000:01:00.2", "product_id": "c2d3", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_c2d3", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_14_2", "address": "0000:00:14.2", "product_id": "7aa7", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7aa7", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_14_3", "address": "0000:00:14.3", "product_id": "7af0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7af0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "7ad0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ad0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_4", "address": "0000:01:00.4", "product_id": "101e", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_101e", "dev_type": "type-VF", "parent_addr": "0000:01:00.0", "parent_ifname": "enp1s0f0np0", "capabilities": {"network": ["rx", "tx", "sg", "tso", "gso", "gro", "rxvlan", "txvlan", "rxhash", "rdma", "txudptnl"]}}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "0612", "vendor_id": "1b21", "numa_node": null, "label": "label_1b21_0612", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_1", "address": "0000:01:00.1", "product_id": "a2d6", "vendor_id": "15b3", "numa_node": null, "label": "label_15b3_a2d6", "dev_type": "type-PF", "mac_address": "08:c0:eb:8e:bd:f5"}, {"dev_id": "pci_0000_00_14_0", "address": "0000:00:14.0", "product_id": "7ae0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7ae0", "dev_type": "type-PCI"}]', 'numa_topology': '{"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["cpuset", "memory_usage", "cpu_usage", "id", "pinned_cpus", "pcpuset", "socket", "network_metadata", "siblings", "mempages", "memory"]}]}, "nova_object.changes": ["cells"]}', 'host_ip': '192.168.28.21'} _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:773 self.pci_tracker = pci_manager.PciDevTracker(context, compute_node) if 'pci_passthrough_devices' in resources: dev_json = resources.pop('pci_passthrough_devices') self.pci_tracker.update_devices_from_hypervisor_resources( dev_json) LOG.debug("_setup_pci_tracker 22222") LOG.debug(resources) # 2023-02-28 14:01:33.798 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] _setup_pci_tracker 22222 _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:781 # 2023-02-28 14:01:33.799 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] {'supported_instances': [('alpha', 'qemu', 'hvm'), ('armv7l', 'qemu', 'hvm'), ('aarch64', 'qemu', 'hvm'), ('cris', 'qemu', 'hvm'), ('i686', 'qemu', 'hvm'), ('i686', 'kvm', 'hvm'), ('lm32', 'qemu', 'hvm'), ('m68k', 'qemu', 'hvm'), ('microblaze', 'qemu', 'hvm'), ('microblazeel', 'qemu', 'hvm'), ('mips', 'qemu', 'hvm'), ('mipsel', 'qemu', 'hvm'), ('mips64', 'qemu', 'hvm'), ('mips64el', 'qemu', 'hvm'), ('ppc', 'qemu', 'hvm'), ('ppc64', 'qemu', 'hvm'), ('ppc64le', 'qemu', 'hvm'), ('s390x', 'qemu', 'hvm'), ('sh4', 'qemu', 'hvm'), ('sh4eb', 'qemu', 'hvm'), ('sparc', 'qemu', 'hvm'), ('sparc64', 'qemu', 'hvm'), ('unicore32', 'qemu', 'hvm'), ('x86_64', 'qemu', 'hvm'), ('x86_64', 'kvm', 'hvm'), ('xtensa', 'qemu', 'hvm'), ('xtensaeb', 'qemu', 'hvm')], 'vcpus': 12, 'memory_mb': 31890, 'local_gb': 456.8854446411133, 'vcpus_used': 0, 'memory_mb_used': 3856, 'local_gb_used': 18.015335083007812, 'hypervisor_type': 'QEMU', 'hypervisor_version': 4002001, 'hypervisor_hostname': 'c1c2', 'cpu_info': '{"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sse4.2", "mds-no", "stibp", "pdpe1gb", "xsaveopt", "ht", "intel-pt", "mtrr", "abm", "tm", "lm", "umip", "mca", "pku", "ds_cpl", "rdrand", "adx", "rdseed", "lahf_lm", "xgetbv1", "nx", "invpcid", "rdtscp", "tsc", "xsavec", "pcid", "arch-capabilities", "pclmuldq", "spec-ctrl", "fsgsbase", "avx2", "md-clear", "vmx", "syscall", "mmx", "ds", "ssse3", "avx", "dtes64", "fxsr", "msr", "acpi", "vpclmulqdq", "smap", "erms", "pge", "cmov", "sha-ni", "fsrm", "x2apic", "xsaves", "cx8", "pse", "pse36", "clflushopt", "vaes", "pni", "ssbd", "movdiri", "movbe", "clwb", "xtpr", "de", "invtsc", "fpu", "tsc-deadline", "pae", "clflush", "ibrs-all", "waitpkg", "sse", "sse2", "bmi1", "3dnowprefetch", "cx16", "popcnt", "rdctl-no", "fma", "tsc_adjust", "xsave", "ss", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "monitor", "vme", "tm2", "pat", "pschange-mc-no", "movdir64b", "gfni", "mce", "smep", "sep", "apic", "arat", "f16c", "bmi2", "aes", "pbe", "est", "pdcm"]}', 'disk_available_least': 415.5914993286133, 'numa_topology': '{"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["cpuset", "memory_usage", "cpu_usage", "id", "pinned_cpus", "pcpuset", "socket", "network_metadata", "siblings", "mempages", "memory"]}]}, "nova_object.changes": ["cells"]}', 'host_ip': '192.168.28.21'} _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:782 dev_pools_obj = self.pci_tracker.stats.to_device_pools_obj() LOG.debug("_setup_pci_tracker 44444") LOG.debug(dev_pools_obj) compute_node.pci_device_pools = dev_pools_obj LOG.debug("_setup_pci_tracker 33333") LOG.debug(resources) LOG.debug(compute_node) # 2023-02-28 14:01:33.799 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] _setup_pci_tracker 33333 _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:786 # 2023-02-28 14:01:33.800 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] {'supported_instances': [('alpha', 'qemu', 'hvm'), ('armv7l', 'qemu', 'hvm'), ('aarch64', 'qemu', 'hvm'), ('cris', 'qemu', 'hvm'), ('i686', 'qemu', 'hvm'), ('i686', 'kvm', 'hvm'), ('lm32', 'qemu', 'hvm'), ('m68k', 'qemu', 'hvm'), ('microblaze', 'qemu', 'hvm'), ('microblazeel', 'qemu', 'hvm'), ('mips', 'qemu', 'hvm'), ('mipsel', 'qemu', 'hvm'), ('mips64', 'qemu', 'hvm'), ('mips64el', 'qemu', 'hvm'), ('ppc', 'qemu', 'hvm'), ('ppc64', 'qemu', 'hvm'), ('ppc64le', 'qemu', 'hvm'), ('s390x', 'qemu', 'hvm'), ('sh4', 'qemu', 'hvm'), ('sh4eb', 'qemu', 'hvm'), ('sparc', 'qemu', 'hvm'), ('sparc64', 'qemu', 'hvm'), ('unicore32', 'qemu', 'hvm'), ('x86_64', 'qemu', 'hvm'), ('x86_64', 'kvm', 'hvm'), ('xtensa', 'qemu', 'hvm'), ('xtensaeb', 'qemu', 'hvm')], 'vcpus': 12, 'memory_mb': 31890, 'local_gb': 456.8854446411133, 'vcpus_used': 0, 'memory_mb_used': 3856, 'local_gb_used': 18.015335083007812, 'hypervisor_type': 'QEMU', 'hypervisor_version': 4002001, 'hypervisor_hostname': 'c1c2', 'cpu_info': '{"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sse4.2", "mds-no", "stibp", "pdpe1gb", "xsaveopt", "ht", "intel-pt", "mtrr", "abm", "tm", "lm", "umip", "mca", "pku", "ds_cpl", "rdrand", "adx", "rdseed", "lahf_lm", "xgetbv1", "nx", "invpcid", "rdtscp", "tsc", "xsavec", "pcid", "arch-capabilities", "pclmuldq", "spec-ctrl", "fsgsbase", "avx2", "md-clear", "vmx", "syscall", "mmx", "ds", "ssse3", "avx", "dtes64", "fxsr", "msr", "acpi", "vpclmulqdq", "smap", "erms", "pge", "cmov", "sha-ni", "fsrm", "x2apic", "xsaves", "cx8", "pse", "pse36", "clflushopt", "vaes", "pni", "ssbd", "movdiri", "movbe", "clwb", "xtpr", "de", "invtsc", "fpu", "tsc-deadline", "pae", "clflush", "ibrs-all", "waitpkg", "sse", "sse2", "bmi1", "3dnowprefetch", "cx16", "popcnt", "rdctl-no", "fma", "tsc_adjust", "xsave", "ss", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "monitor", "vme", "tm2", "pat", "pschange-mc-no", "movdir64b", "gfni", "mce", "smep", "sep", "apic", "arat", "f16c", "bmi2", "aes", "pbe", "est", "pdcm"]}', 'disk_available_least': 415.5914993286133, 'numa_topology': '{"nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{"nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["cpuset", "memory_usage", "cpu_usage", "id", "pinned_cpus", "pcpuset", "socket", "network_metadata", "siblings", "mempages", "memory"]}]}, "nova_object.changes": ["cells"]}', 'host_ip': '192.168.28.21'} _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:787 # 2023-02-28 14:01:33.800 443293 DEBUG nova.compute.resource_tracker [req-52743217-f0b6-4525-b9fd-371246b6c929 - - - - -] ComputeNode(cpu_allocation_ratio=16.0,cpu_info='{"arch": "x86_64", "model": "Broadwell-noTSX-IBRS", "vendor": "Intel", "topology": {"cells": 1, "sockets": 1, "cores": 6, "threads": 2}, "features": ["sse4.2", "mds-no", "stibp", "pdpe1gb", "xsaveopt", "ht", "intel-pt", "mtrr", "abm", "tm", "lm", "umip", "mca", "pku", "ds_cpl", "rdrand", "adx", "rdseed", "lahf_lm", "xgetbv1", "nx", "invpcid", "rdtscp", "tsc", "xsavec", "pcid", "arch-capabilities", "pclmuldq", "spec-ctrl", "fsgsbase", "avx2", "md-clear", "vmx", "syscall", "mmx", "ds", "ssse3", "avx", "dtes64", "fxsr", "msr", "acpi", "vpclmulqdq", "smap", "erms", "pge", "cmov", "sha-ni", "fsrm", "x2apic", "xsaves", "cx8", "pse", "pse36", "clflushopt", "vaes", "pni", "ssbd", "movdiri", "movbe", "clwb", "xtpr", "de", "invtsc", "fpu", "tsc-deadline", "pae", "clflush", "ibrs-all", "waitpkg", "sse", "sse2", "bmi1", "3dnowprefetch", "cx16", "popcnt", "rdctl-no", "fma", "tsc_adjust", "xsave", "ss", "skip-l1dfl-vmentry", "sse4.1", "rdpid", "monitor", "vme", "tm2", "pat", "pschange-mc-no", "movdir64b", "gfni", "mce", "smep", "sep", "apic", "arat", "f16c", "bmi2", "aes", "pbe", "est", "pdcm"]}',created_at=2023-02-14T03:19:40Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=415,free_disk_gb=456,free_ram_mb=31378,host='c1c2',host_ip=192.168.28.21,hypervisor_hostname='c1c2',hypervisor_type='QEMU',hypervisor_version=4002001,id=8,local_gb=456,local_gb_used=18,mapped=0,memory_mb=31890,memory_mb_used=3856,metrics='[]',numa_topology='{" nova_object.name": "NUMATopology", "nova_object.namespace": "nova", "nova_object.version": "1.2", "nova_object.data": {"cells": [{" nova_object.name": "NUMACell", "nova_object.namespace": "nova", "nova_object.version": "1.5", "nova_object.data": {"id": 0, "cpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "pcpuset": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11], "memory": 31890, "cpu_usage": 0, "memory_usage": 0, "pinned_cpus": [], "siblings": [[0, 1], [10, 11], [2, 3], [6, 7], [4, 5], [8, 9]], "mempages": [{"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 4, "total": 8163962, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {" nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 2048, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}, {"nova_object.name": "NUMAPagesTopology", "nova_object.namespace": "nova", "nova_object.version": "1.1", "nova_object.data": {"size_kb": 1048576, "total": 0, "used": 0, "reserved": 0}, "nova_object.changes": ["size_kb", "used", "reserved", "total"]}], "network_metadata": {"nova_object.name": "NetworkMetadata", "nova_object.namespace": "nova", "nova_object.version": "1.0", "nova_object.data": {"physnets": [], "tunneled": false}, "nova_object.changes": ["physnets", "tunneled"]}, "socket": 0}, "nova_object.changes": ["cpuset", "memory_usage", "cpu_usage", "id", "pinned_cpus", "pcpuset", "socket", "network_metadata", "siblings", "mempages", "memory"]}]}, "nova_object.changes": ["cells"]}',pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.5,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec,HVSpec],updated_at=2023-02-28T06:00:15Z,uuid=c360cc82-f0fd-4662-bccd-e1f02b27af51,vcpus=12,vcpus_used=0) _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:788 LOG.debug(compute_node.pci_device_pools.fields) # 2023-02-28 15:27:57.213 447003 DEBUG nova.compute.resource_tracker [req-7f09d102-95de-4b6f-a0f7-d6ee2fc26e6d - - - - -] {'objects': List(default=<class 'oslo_versionedobjects.fields.UnspecifiedDefault'>,nullable=False)} _setup_pci_tracker /usr/lib/python3/dist-packages/nova/compute/resource_tracker.py:789 ``` As above, this code "dev_json = resources.pop('pci_passthrough_devices')" pop these infomation. So my question is 1) is this BUG ? 2) what update_devices_from_hypervisor_resources do ? 3) how to use PCI passthough in openstack Yoga ? ---- Simon Jones

4 13

[cinder] Error when creating backups from iscsi volume
by Rishat Azizov 06 Mar '23

06 Mar '23

Hello! We have an error with creating backups from iscsi volume. Usually, this happens with large backups over 100GB. 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server [req-f6619913-6f96-4226-8d75-2da3fca722f1 23de1b92e7674cf59486f07ac75b886b a7585b47d1f143e9839c49b4e3bbe1b4 - - -] Exception during message handling: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Command: multipath -f 3624a93705842cfae35d7483200015ec6 Exit code: 1 Stdout: '' Stderr: 'Feb 16 00:22:45 | 3624a93705842cfae35d7483200015ec6 is not a multipath device\n' 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/cinder/utils.py", line 890, in wrapper 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return func(self, *args, **kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/cinder/backup/manager.py", line 410, in create_backup 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server volume_utils.update_backup_error(backup, str(err)) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server self.force_reraise() 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server raise self.value 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/cinder/backup/manager.py", line 399, in create_backup 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server updates = self._run_backup(context, backup, volume) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/cinder/backup/manager.py", line 493, in _run_backup 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server ignore_errors=True) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/cinder/backup/manager.py", line 1066, in _detach_device 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server force=force, ignore_errors=ignore_errors) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/utils.py", line 141, in trace_logging_wrapper 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return f(*args, **kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_concurrency/lockutils.py", line 360, in inner 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return f(*args, **kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/initiator/connectors/iscsi.py", line 880, in disconnect_volume 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server is_disconnect_call=True) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/initiator/connectors/iscsi.py", line 942, in _cleanup_connection 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server self._linuxscsi.flush_multipath_device(multipath_name) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/initiator/linuxscsi.py", line 382, in flush_multipath_device 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server root_helper=self._root_helper) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/executor.py", line 52, in _execute 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server result = self.__execute(*args, **kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return execute_root(*cmd, **kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 247, in _wrap 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server return self.channel.remote_call(name, args, kwargs) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server File "/usr/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 224, in remote_call 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server raise exc_type(*result[2]) 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Command: multipath -f 3624a93705842cfae35d7483200015ec6 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Exit code: 1 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Stdout: '' 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Stderr: 'Feb 16 00:22:45 | 3624a93705842cfae35d7483200015ec6 is not a multipath device\n' 2023-02-16 00:23:25.298 1920 ERROR oslo_messaging.rpc.server Could you please help with this error?

2 1

[kolla] [train] [cinder] Volume multiattach exposed to non-admin users via API
by Albert Braden 03 Mar '23

03 Mar '23

According to this document [1] multiattach volumes can only be setup if explicitly allowed by creating a “multiattach” volume type. “Starting from the Queens release the ability to attach a volume to multiple hosts/servers requires that the volume is of a special type that includes an extra-spec capability setting of multiattach=<is> True… Creating a new volume type is an admin-only operation by default. One of our customers appears to have used TerraForm to create a volume with the multiattach flag set and it worked, and that volume has multiple attachments. When I look here [2] it appears that the default is: #"volume:multiattach": "rule:xena_system_admin_or_project_member" So it looks like, by default, any project member can create a multiattach volume. What am I missing? [1]: https://docs.openstack.org/cinder/latest/admin/volume-multiattach.html [2]: https://docs.openstack.org/cinder/latest/configuration/block-storage/sample…

5 10

[governance][heat][tacker] Moving governance of tosca-parser(and heat-translator ?) to Tacker
by Takashi Kajinami 03 Mar '23

03 Mar '23

Hello, Currently tosca-parser is part of heat's governance, but the core reviewers of this repository does not contain any active heat cores while we see multiple Tacker cores in this group. Considering the fact the project is mainly maintained by Tacker cores, I'm wondering if we can migrate this repository to Tacker's governance. Most of the current heat cores are not quite familiar with the codes in this repository, and if Tacker team is not interested in maintaining this repository then I'd propose retiring this. Similarly, we have heat-translator project which has both heat cores and tacker cores as its core reviewers. IIUC this is tightly related to the work in tosca-parser, I'm wondering it makes more sense to move this project to Tacker, because the requirement is mostly made from Tacker side rather than Heat side. [1] https://review.opendev.org/admin/groups/1f7855baf3cf14fedf72e443eef18d844bc… [2] https://review.opendev.org/admin/groups/66028971dcbb58add6f0e7c17ac72643c48… Thank you, Takashi

3 8

[security-sig] Polls in preparation to revive our meetings
by Jeremy Stanley 01 Mar '23

01 Mar '23

As discussed at the last PTG, the present meeting time (15:00 UTC on the first Thursday of each month) is inconvenient for some attendees, and that combined with year-end holidays and general busy weeks recently have led to skipping them entirely. In order to start narrowing down the potential meeting schedule, I have two initial polls. The first is to determine what frequency we should meet. If you have an opinion on that, please fill out this poll before Thursday, February 9 (two weeks from today): https://framadate.org/wz7GioqmgyWeILkr The second poll is to hopefully determine what day of the week is optimal for potential attendees. If you have a preference for which day of the week to meet, please complete this one by the same date as the first: https://framadate.org/CyxKgZPT8PWxcCnJ Once I can analyze the results, I'll put together a more specific poll for choosing a time of day as well as possibly choosing which week(s) of the month (if we don't settle on weekly frequency). In the meantime, let's plan to hold February's meeting on Thursday the 2nd at 15:00-16:00 UTC as usual[*] for anyone who is able to attend, and I'll get an agenda together in preparation for that. [*] https://meetings.opendev.org/#OpenStack_Security_SIG_meeting -- Jeremy Stanley

1 1

[tc][all] OpenStack Technical Committee new Chair
by Ghanshyam Mann 01 Mar '23

01 Mar '23

Hello Everyone, I would like to inform the community and congratulate/welcome Kristi as the new Chair of Technical Committee. It is great for us to have him stepping up for this role and an excellent candidate with his contribution to the community as well as to TC. Thanks for having me as a Chair for the past 2 years. I will continue as TC and my other activities/role in the community. Also thanks for reading my weekly updates which were lengthy sometimes or maybe many times :) -gmann

7 6

Autoscaling in Kolla Ansible Wallaby Openstack release
by Uday Dikshit 01 Mar '23

01 Mar '23

Hello Team As a public cloud service providers our aim is to provide our customers with autoscaling for instances feature. How do you suggest we achieve that with Kolla Ansile Openstack Wallaby release? Thanks & Regards, [https://acefone.com/email-signature/logo-new.png] [https://acefone.com/email-signature/facebook.png]<https://www.facebook.com/real.time.data.services/> [https://acefone.com/email-signature/linkedin.png]<https://www.linkedin.com/company/real-time-data-services/mycompany/> [https://acefone.com/email-signature/twitter.png]<https://twitter.com/rtdsindia> [https://acefone.com/email-signature/youtube.png]<https://www.youtube.com/channel/UCq93lA3ch6Pt5GzOAhRwgpw> [https://acefone.com/email-signature/glassdoor.png]<https://www.glassdoor.co.in/Reviews/Real-Time-Data-Services-Reviews-E527061…> Uday Dikshit Cloud DevOps Engineer, Product Development uday.dikshit(a)myrealdata.in www.myrealdata.in<http://www.myrealdata.in/> 809-A Udyog Vihar, Phase 5, Gurugram - 122015, Haryana

3 3

[all][tc] Technical Committee next weekly meeting on 2023 Mar 1 at 1600 UTC
by Ghanshyam Mann 01 Mar '23

01 Mar '23

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 2023 Mar 1, at 1600 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Tuesday, Feb 28 at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

2 1

[all][docs] Inconsistencies in api-ref rendering - impacting compute and baremetal api-ref, maybe others
by Jay Faulkner 28 Feb '23

28 Feb '23

Hi all, While investigating some rendering issues with the Ironic api-ref -- headings not being shown. We discovered a strange configuration in openstackdocstheme. We're not really certain how it's broken, but there is a visual problem that needs to be fixed either in the theme or in Ironic's (and others') content. If you look at https://docs.openstack.org/api-ref/baremetal/ -- you'll notice there are no primary headers. This is because they are in a rst construct rendered as an h1, which the CSS in the openstackdocstheme renders to display:none: https://github.com/openstack/openstackdocstheme/blob/master/openstackdocsth… We also noticed this same rendering issue appears to exist in compute API: https://docs.openstack.org/api-ref/compute/ But not for Neutron: https://docs.openstack.org/api-ref/network/v2/index.html. It appears that neutron has added an additional layer of headers which are rendering ( https://raw.githubusercontent.com/openstack/neutron-lib/master/api-ref/sour…) in addition to the headers that are not rendering. This behavior has been in the openstackdocstheme for years, it was introduced in https://github.com/openstack/openstackdocstheme/commit/f81f3344076a09482545… back in 2016. This raises some questions * What's the correct fix? Dmitry is exploring options to do a neutron-style workaround in our Ironic api-ref to make them render properly for us; but given it's (effectively) broken for Nova as well is an interesting data point that might indicate a fix in the theme is needed. * Are other openstack projects/APIs impacted by this? I'm not a documentation or front end html/css expert, so I'm hoping folks with more historical context and front end knowledge can respond here and help us determine which way to go. In lieu of further input, Ironic will fix our api-ref in the same method that Neutron has appeared to be taking and I suggest Nova do the same. Thanks, Jay Faulkner Ironic PTL TC Member

4 6

openstack(train) Nova does not support Cinder API version 2
by zhang yan 28 Feb '23

28 Feb '23

hi i setup a study environment refer to the Minimal deployment for Train( https://docs.openstack.org/install-guide/openstack-services.html) . when i finish the Block Storage service install, and create a volume successfully. then i attach the volume to a compute instance, but the nova-compute log hint： 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server [req-24fde26d-3665-492c-8ce6-067bd793b864 bf6dc19622da48e59a272fc3daa292e5 b99ceef1d97c4aac89d15c732a5e1b0a - default default] Exception during message handling: UnsupportedCinderAPIVersion: Nova does not support Cinder API version 2 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 79, in wrapped 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server function_name, call_dict, binary, tb) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server self.force_reraise() 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 69, in wrapped 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1372, in decorated_function 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 219, in decorated_function 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info()) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server self.force_reraise() 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 207, in decorated_function 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6126, in attach_volume 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server do_attach_volume(context, instance, driver_bdm) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 328, in inner 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return f(*args, **kwargs) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6124, in do_attach_volume 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server bdm.destroy() 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server self.force_reraise() 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6121, in do_attach_volume 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return self._attach_volume(context, instance, driver_bdm) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6156, in _attach_volume 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server context, bdm['attachment_id']) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 399, in wrapper 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server res = method(self, ctx, *args, **kwargs) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 450, in wrapper 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server res = method(self, ctx, attachment_id, *args, **kwargs) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/retrying.py", line 68, in wrapped_f 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return Retrying(*dargs, **dkw).call(f, *args, **kw) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/retrying.py", line 223, in call 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server return attempt.get(self._wrap_exception) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server six.reraise(self.value[0], self.value[1], self.value[2]) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server attempt = Attempt(fn(*args, **kwargs), attempt_number, False) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 892, in attachment_delete 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server context, '3.44', skip_version_check=True).attachments.delete( 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 260, in cinderclient 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server raise exception.UnsupportedCinderAPIVersion(version=version) 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server UnsupportedCinderAPIVersion: Nova does not support Cinder API version 2 2023-02-28 14:34:13.322 6913 ERROR oslo_messaging.rpc.server how can i fix this problem，please help。

2 1