<div dir="ltr"><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Hi All,</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">I have installed open-stack <span style="background-image:initial;background-repeat:initial">openstack-</span><span class="">mitaka</span><span class=""> release on CentO7 system . It has two
Intel QAT devices. </span>There are 32 VF devices available per QAT Device/DH895xCC
device. </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]# lspci -nn | grep 0435</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">83:00.0 Co-processor
[0b40]: Intel Corporation DH895XCC Series QAT [8086:0435]</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">88:00.0 Co-processor
[0b40]: Intel Corporation DH895XCC Series QAT [8086:0435]</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]# cat
/sys/bus/pci/devices/0000\:88\:00.0/sriov_numvfs</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">32</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]# cat
/sys/bus/pci/devices/0000\:83\:00.0/sriov_numvfs</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">32</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]#</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Changed the nova configuration
(as stated below) for exposing VF ( via PCI-passthrough) to the instances. </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">pci_alias =
{"name": "QuickAssist", "product_id":
"0443", "vendor_id": "8086",
"device_type": "type-VF"}</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">pci_passthrough_whitelist
=
[{"vendor_id":"8086","product_id":"0443"}}]</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Restarted the nova
compute, nova API and nova scheduler service </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">service
openstack-nova-compute restart;service openstack-nova-api restart;systemctl
restart openstack-nova-scheduler;</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">scheduler_available_filters=nova.scheduler.filters.all_filters</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">scheduler_default_filters=RamFilter,ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,PciPassthroughFilter</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Thereafter it shows all
the available VFs (64) in nova database upon <span class=""><span style="background-image:initial;background-repeat:initial">select</span></span></span><span class=""><span style="background-image:initial;background-repeat:initial"> </span><span style="background-image:initial;background-repeat:initial">*
from pci_devices.</span></span><span style="font-size:12pt;line-height:115%"> Set the flavor 4 to allow
passing two VFs to instances.</span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]# nova flavor-show
4</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">+----------------------------+------------------------------------------------------------+</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| Property | Value
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">+----------------------------+------------------------------------------------------------+</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">|
OS-FLV-DISABLED:disabled | False
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">|
OS-FLV-EXT-DATA:ephemeral | 0
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| disk | 80 |</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| extra_specs |
{"pci_passthrough:alias": "QuickAssist:2"} |</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| id | 4
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| name | m1.large
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">|
os-flavor-access:is_public | True
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| ram | 8192
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| rxtx_factor | 1.0
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| swap |
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">| vcpus | 4
|</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">+----------------------------+------------------------------------------------------------+</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">[root@localhost
nova(keystone_admin)]#</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> Also when I launch an instance using this new flavor, it goes
into an error state</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">nova
boot --flavor 4 --key_name oskey1 --image bc859dc5-103b-428b-814f-d36e59009454
--nic net-id=e2ca118d-1f25-47de-8524-bb2a2635c4be TEST</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">Here
goes the output of nova-conductor.log</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">2016-06-16
07:55:34.640 5094 WARNING nova.scheduler.utils
[req-6189d3c8-5587-4350-8cd3-704fd35cf2ad 266f5859848e4f39b9725203dda5c3f2
4bc608763cee41d9a8df26d3ef919825 - - -] Failed to compute_task_build_instances:
No valid host was found. There are not enough hosts available.</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">Traceback
(most recent call last):</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> File
"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line
150, in inner</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> return func(*args, **kwargs)</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> File
"/usr/lib/python2.7/site-packages/nova/scheduler/manager.py", line
104, in select_destinations</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> dests =
self.driver.select_destinations(ctxt, spec_obj)</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> File
"/usr/lib/python2.7/site-packages/nova/scheduler/filter_scheduler.py",
line 74, in select_destinations</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> raise exception.NoValidHost(reason=reason)</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">NoValidHost:
No valid host was found. There are not enough hosts available.</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">Here
goes the output of nova-compute.log</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;background-image:initial;background-repeat:initial"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;background-image:initial;background-repeat:initial">2016-06-16
07:57:32.502 170789 INFO nova.compute.resource_tracker
[req-4529a2a8-390f-4620-98b3-d3eb77e077a3 - - - - -] Total usable vcpus: 36,
total allocated vcpus: 16</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;background-image:initial;background-repeat:initial">2016-06-16
07:57:32.502 170789 INFO nova.compute.resource_tracker [req-4529a2a8-390f-4620-98b3-d3eb77e077a3
- - - - -] Final resource view: name=localhost phys_ram=128721MB
used_ram=33280MB phys_disk=49GB used_disk=320GB total_vcpus=36 used_vcpus=16
pci_stats=[PciDevicePool(count=0,numa_node=0,product_id='10fb',tags={dev_type='type-PF'},vendor_id='8086'),
PciDevicePool(count=63,numa_node=1,product_id='0443',tags={dev_type='type-VF'},vendor_id='8086')]</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;background-image:initial;background-repeat:initial">2016-06-16
07:57:33.803 170789 INFO nova.compute.resource_tracker
[req-4529a2a8-390f-4620-98b3-d3eb77e077a3 - - - - -] Compute_service record
updated for localhost:localhost</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)">Here
goes the output of nova-scheduler.log</span><span style="font-size:12pt;line-height:115%"></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%;color:rgb(82,83,89);background:rgb(247,246,243)"><br></span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">2016-06-16 07:55:34.636 171018 WARNING
nova.scheduler.host_manager [req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2 4bc608763cee41d9a8df26d3ef919825 - - -] Host localhost
has more disk space than database expected (-141 GB > -271 GB)</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">2016-06-16 07:55:34.637 171018 INFO
nova.filters [req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2 4bc608763cee41d9a8df26d3ef919825 - - -] Filter
PciPassthroughFilter returned 0 hosts</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">2016-06-16 07:55:34.638 171018 INFO
nova.filters [req-6189d3c8-5587-4350-8cd3-704fd35cf2ad
266f5859848e4f39b9725203dda5c3f2 4bc608763cee41d9a8df26d3ef919825 - - -]
Filtering removed all hosts for the request with instance ID
'4f68c680-5a17-4a38-a6df-5cdb6d76d75b'. Filter results: ['RamFilter: (start: 1,
end: 1)', 'ComputeFilter: (start: 1, end: 1)', 'AvailabilityZoneFilter: (start:
1, end: 1)', 'ComputeCapabilitiesFilter: (start: 1, end: 1)',
'ImagePropertiesFilter: (start: 1, end: 1)', 'PciPassthroughFilter: (start: 1,
end: 0)']</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">2016-06-16 07:56:14.743 171018 INFO
nova.scheduler.host_manager [req-64a8dc31-f2ab-4d93-8579-6b9f8210ece7 - - - -
-] Successfully synced instances from host 'localhost'.</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">2016-06-16 07:58:17.748 171018 INFO
nova.scheduler.host_manager [req-152ac777-1f77-433d-8493-6cd86ab3e0fc - - - -
-] Successfully synced instances from host 'localhost'.</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"> </span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Note that, If I set the flavor using “QuickAssist:1”
(as </span><span style="font-size:16px;line-height:18.4px">nova flavor-key 4 set "pci_passthrough:alias"="QuickAssist:1"</span><span style="font-size:12pt;line-height:115%">) and create VM , it assigns a single VF to VM instance. I think, multiple VFs
can be assigned per VM. Can anyone please suggest , where I am wrong and the
way to solve this ? </span></p>
<p class="MsoNormal"><br></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%"><br></span></p><p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Regards,</span></p>
<p class="MsoNormal"><span style="font-size:12pt;line-height:115%">Chinmaya</span></p></div>