[openstack-dev] [neutron][sriov] SRIOV-VM could not work well with normal VM

Armando M. armamig at gmail.com
Thu Oct 22 15:04:13 UTC 2015


On 22 October 2015 at 01:21, yujie <judy_yujie at 126.com> wrote:

> I used ixgbe and vlan, passthrough a VF to vm.
> After the VM created, it could not connect to VM on the same compute node
> without use sriov.
>
>
Not sure if this is the same conversation happening on Launchpad, but if
not, this might be relevant:

https://bugs.launchpad.net/neutron/+bug/1506003


> 在 2015/10/22 10:58, Alexander Duyck 写道:
>
>> I assume by Intel cards you mean something that is running ixgbe?  If so
>> and you are trying to use SR-IOV with OVS and VLANs running on top of
>> the PF it will fail. The issue is that OVS requires the ability to place
>> the PF in promiscuous mode to support VLAN trunking, and ixgbe driver
>> prevents that when SR-IOV is enabled.
>>
>> The "bridge fdb add" approach mentioned should work as long as ixgbe PF
>> is used on a flat network.
>>
>> - Alex
>>
>> On 10/19/2015 07:33 PM, yujie wrote:
>>
>>> Hi Moshe Levi,
>>>    Sorry for replying to this message after so long time. The testing
>>> environment was unavailable before.
>>>    I use Intel cards, but could only tested base kilo and vlan. Could
>>> it work?
>>>
>>> 在 2015/9/22 13:24, Moshe Levi 写道:
>>>
>>>> Hi Yujie,
>>>>
>>>> There is a patch https://review.openstack.org/#/c/198736/ which I
>>>> wrote to add the mac of the normal instance to
>>>> the SR-IOV embedded switch so that the packet will go to the PF
>>>> instead of going to the wire.
>>>> This is done by using bridge tool with the command "bridge fdb add
>>>> <mac> dev <interface>"
>>>>
>>>> I was able to test it on Mellanox ConnectX3  card with both vlan and
>>>> flat network and it worked fine.
>>>> I wasn't able to test it on any of the Intel cards, but I was told
>>>> the it only working on flat network, in vlan network the Intel card
>>>> is dropping the tagged packets and they are not go up to the VF.
>>>>
>>>> What NIC are you using? Can you try using "bridge fdb add <mac> dev
>>>> <interface>" where <mac> is the mac of the normal vm and <interface>
>>>> is the PF
>>>> and see if  that resolve the issue.
>>>> Also can you check it with  flat and vlan networks.
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: yujie [mailto:judy_yujie at 126.com]
>>>> Sent: Tuesday, September 22, 2015 6:28 AM
>>>> To: openstack-dev at lists.openstack.org
>>>> Subject: [openstack-dev] [neutron][sriov] SRIOV-VM could not work
>>>> well with normal VM
>>>>
>>>> Hi all,
>>>> I am using neutron kilo without dvr to create sriov instance VM-A,it
>>>> works well and could connect to its gateway fine.
>>>> But when I let the normal instance VM-B which in the same
>>>> compute-node with VM-A ping its gateway, it failed. I capture the
>>>> packet on the network-node, find the gateway already reply the
>>>> ARP-reply message to VM-B. But compute-node which VM-B lives could
>>>> not send the package to VM-B.
>>>> If delete VM-A and set : echo 0 >
>>>> /sys/class/enp5s0f0/device/sriov_numvfs, the problem solved.
>>>>
>>>> Is it a same question with the bug: SR-IOV port doesn't reach OVS
>>>> port on same compute node ?
>>>> https://bugs.launchpad.net/neutron/+bug/1492228
>>>> Any suggestions will be grateful.
>>>>
>>>> Thanks,
>>>> Yujie
>>>>
>>>>
>>>>
>>>> __________________________________________________________________________
>>>>
>>>> OpenStack Development Mailing List (not for usage questions)
>>>> Unsubscribe:
>>>> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>>
>>>>
>>>> __________________________________________________________________________
>>>>
>>>> OpenStack Development Mailing List (not for usage questions)
>>>> Unsubscribe:
>>>> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>>
>>>>
>>>
>>>
>>> __________________________________________________________________________
>>>
>>> OpenStack Development Mailing List (not for usage questions)
>>> Unsubscribe:
>>> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>>
>>
>>
>> __________________________________________________________________________
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe:
>> OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20151022/8cea2613/attachment.html>


More information about the OpenStack-dev mailing list