Hi!
I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a multi-node setup (1 controller+network, multiple computes).
On this cluster I would like to have support for normal, as well as direct (SR-IOV) vNIC types.
I have done all the pre-requirement like configure VF on SR-IOV network interface.
In the current deployment, I have created two physnets, one for flat network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct vNIC.
Mapping of PF with provider in sriov-agent.ini:
# cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini
[sriov_nic]
physical_device_mappings = sriovnet1:enp8s0f1
exclude_devices =
[securitygroup]
firewall_driver = neutron.agent.firewall.NoopFirewallDriver
----------------------------------------------
ml2_conf.ini on controller node:
# cat /etc/kolla/neutron-server/ml2_conf.ini
[ml2]
type_drivers = flat,vlan,vxlan
tenant_network_types = vxlan,vlan,flat
mechanism_drivers = openvswitch,l2population,sriovnicswitch
extension_drivers = port_security
[ml2_type_vlan]
network_vlan_ranges = physnet1,sriovnet1:1000:1009
[ml2_type_flat]
flat_networks = physnet1,sriovnet1
[ml2_sriov]
agent_required = False
supported_pci_vendor_devs = 8086:10ed
[ml2_type_vxlan]
vni_ranges = 1:1000
----------------------------------------------
# grep -nr enabled_filters /etc/kolla/nova-scheduler/
/etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter
----------------------------------------------
# grep passthrough /etc/kolla/nova-compute/nova.conf
passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": "enp8s0f1"}]
The interfaces on VMs from normal vNICs are able to communicate inter-compute. The same is not working for the direct vNICs belonging to the sriov_network. I have tried multiple config changes, but none seem to work.
Please help in solving this issue, or suggest a different way of achieving this if this is wrong or not optimal.
Thanks!