Hi cinder team, I'd like to know if cinder supports NVMe/FC. From nvmeof connector [1], it seems only RoCE(RDMA) and TCP. [1] https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/... Thank you! Yian
Hi Yian, I have a similar understanding of the NVMe-oF connector. Also the in-tree drivers we have support TCP and RoCE[1] only. I'm unable to find any proposed patches in gerrit for FC support[2]. Maybe +Gorka Eguileor <geguileo@redhat.com> can provide more insights why FC is currently not supported and if we have any future plans for its support. [1] https://docs.openstack.org/cinder/latest/reference/support-matrix.html [1] https://review.opendev.org/q/project:openstack/os-brick+status:open+nvme On Tue, Apr 23, 2024 at 9:40 AM <yian.zong@dell.com> wrote:
Hi cinder team,
I'd like to know if cinder supports NVMe/FC.
From nvmeof connector [1], it seems only RoCE(RDMA) and TCP.
[1] https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/...
Thank you! Yian
On 24/04, Rajat Dhasmana wrote:
Hi Yian,
I have a similar understanding of the NVMe-oF connector. Also the in-tree drivers we have support TCP and RoCE[1] only. I'm unable to find any proposed patches in gerrit for FC support[2].
Maybe +Gorka Eguileor <geguileo@redhat.com> can provide more insights why FC is currently not supported and if we have any future plans for its support.
[1] https://docs.openstack.org/cinder/latest/reference/support-matrix.html [1] https://review.opendev.org/q/project:openstack/os-brick+status:open+nvme
Hi, You are both right, there is currently no support in OpenStack (os-brick or Cinder) for the NVMe-FC transport protocol. The reason is simple, nobody has volunteered to do the work. I've heard that there are some end users interested, but none are my customers, so I haven't given any priority to that effort. If I recall correctly, when I looked into it, it seemed like even the LVM+nvmet cinder driver+target could be updated to support NVMe-FC to allow development for those that don't have a real storage array supporting NVMe-FC. All that would be needed are newer model HBAs supporting NVMe-oF and supporting direct port connection without going through a switch (otherwise a modern FC switch would also be needed). Cheers, Gorka.
On Tue, Apr 23, 2024 at 9:40 AM <yian.zong@dell.com> wrote:
Hi cinder team,
I'd like to know if cinder supports NVMe/FC.
From nvmeof connector [1], it seems only RoCE(RDMA) and TCP.
[1] https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/...
Thank you! Yian
Hi Rajat and Gorka, Thank you for the confirmation! I'm looking into the opportunity to support NVMe-FC for PowerStore cinder driver. BR, Yian Internal Use - Confidential -----Original Message----- From: Gorka Eguileor <geguileo@redhat.com> Sent: Wednesday, April 24, 2024 8:07 PM To: Rajat Dhasmana <rdhasman@redhat.com> Cc: Zong, Yian <Yian.Zong@dell.com>; openstack-discuss@lists.openstack.org Subject: Re: [cinder][dev][ptl] NVMe/FC [EXTERNAL EMAIL] On 24/04, Rajat Dhasmana wrote:
Hi Yian,
I have a similar understanding of the NVMe-oF connector. Also the in-tree drivers we have support TCP and RoCE[1] only. I'm unable to find any proposed patches in gerrit for FC support[2].
Maybe +Gorka Eguileor <geguileo@redhat.com> can provide more insights why FC is currently not supported and if we have any future plans for its support.
[1] https://urldefense.com/v3/__https://docs.openstack.org/cinder/latest/r eference/support-matrix.html__;!!LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ6RmKH o1rCVa6RyjL5I_iigHn_XhpyunFyIGapl1xVSHsy9zQUmcot$ [docs[.]openstack[.]org] [1] https://urldefense.com/v3/__https://review.opendev.org/q/project:opens tack/os-brick*status:open*nvme__;Kys!!LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ 6RmKHo1rCVa6RyjL5I_iigHn_XhpyunFyIGapl1xVSHsy9w5YYx6E$ [review[.]opendev[.]org]
Hi, You are both right, there is currently no support in OpenStack (os-brick or Cinder) for the NVMe-FC transport protocol. The reason is simple, nobody has volunteered to do the work. I've heard that there are some end users interested, but none are my customers, so I haven't given any priority to that effort. If I recall correctly, when I looked into it, it seemed like even the LVM+nvmet cinder driver+target could be updated to support NVMe-FC to allow development for those that don't have a real storage array supporting NVMe-FC. All that would be needed are newer model HBAs supporting NVMe-oF and supporting direct port connection without going through a switch (otherwise a modern FC switch would also be needed). Cheers, Gorka.
On Tue, Apr 23, 2024 at 9:40 AM <yian.zong@dell.com> wrote:
Hi cinder team,
I'd like to know if cinder supports NVMe/FC.
From nvmeof connector [1], it seems only RoCE(RDMA) and TCP.
[1] https://urldefense.com/v3/__https://opendev.org/openstack/os-brick/s rc/branch/master/os_brick/initiator/connectors/nvmeof.py*L156__;Iw!! LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ6RmKHo1rCVa6RyjL5I_iigHn_XhpyunFyIGa pl1xVSHsy98uyK1nX$ [opendev[.]org]
Thank you! Yian
On 25/04, Zong, Yian wrote:
Hi Rajat and Gorka,
Thank you for the confirmation! I'm looking into the opportunity to support NVMe-FC for PowerStore cinder driver.
Hi, If you want to support NVMe-FC in the PowerStore cinder driver you will also need to do the appropriate code changes to the os-brick nvmeof connector [1] to support it. I believe Simon from Pure Storage (IRC handle simondodsley) was also interested in having NVMe-FC support in OpenStack, and he had some ideas of some of the changes that were needed. Cheers, Gorka. [1]: https://opendev.org/openstack/os-brick/src/branch/master/os_brick/initiator/...
BR, Yian
Internal Use - Confidential -----Original Message----- From: Gorka Eguileor <geguileo@redhat.com> Sent: Wednesday, April 24, 2024 8:07 PM To: Rajat Dhasmana <rdhasman@redhat.com> Cc: Zong, Yian <Yian.Zong@dell.com>; openstack-discuss@lists.openstack.org Subject: Re: [cinder][dev][ptl] NVMe/FC
[EXTERNAL EMAIL]
On 24/04, Rajat Dhasmana wrote:
Hi Yian,
I have a similar understanding of the NVMe-oF connector. Also the in-tree drivers we have support TCP and RoCE[1] only. I'm unable to find any proposed patches in gerrit for FC support[2].
Maybe +Gorka Eguileor <geguileo@redhat.com> can provide more insights why FC is currently not supported and if we have any future plans for its support.
[1] https://urldefense.com/v3/__https://docs.openstack.org/cinder/latest/r eference/support-matrix.html__;!!LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ6RmKH o1rCVa6RyjL5I_iigHn_XhpyunFyIGapl1xVSHsy9zQUmcot$ [docs[.]openstack[.]org] [1] https://urldefense.com/v3/__https://review.opendev.org/q/project:opens tack/os-brick*status:open*nvme__;Kys!!LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ 6RmKHo1rCVa6RyjL5I_iigHn_XhpyunFyIGapl1xVSHsy9w5YYx6E$ [review[.]opendev[.]org]
Hi,
You are both right, there is currently no support in OpenStack (os-brick or Cinder) for the NVMe-FC transport protocol.
The reason is simple, nobody has volunteered to do the work.
I've heard that there are some end users interested, but none are my customers, so I haven't given any priority to that effort.
If I recall correctly, when I looked into it, it seemed like even the LVM+nvmet cinder driver+target could be updated to support NVMe-FC to allow development for those that don't have a real storage array supporting NVMe-FC. All that would be needed are newer model HBAs supporting NVMe-oF and supporting direct port connection without going through a switch (otherwise a modern FC switch would also be needed).
Cheers, Gorka.
On Tue, Apr 23, 2024 at 9:40 AM <yian.zong@dell.com> wrote:
Hi cinder team,
I'd like to know if cinder supports NVMe/FC.
From nvmeof connector [1], it seems only RoCE(RDMA) and TCP.
[1] https://urldefense.com/v3/__https://opendev.org/openstack/os-brick/s rc/branch/master/os_brick/initiator/connectors/nvmeof.py*L156__;Iw!! LpKI!gGU7qqGiln81kFXleOxEyqrR5eQ6RmKHo1rCVa6RyjL5I_iigHn_XhpyunFyIGa pl1xVSHsy98uyK1nX$ [opendev[.]org]
Thank you! Yian
participants (5)
-
Gorka Eguileor
-
Rajat Dhasmana
-
Yian Zong
-
yian.zong＠dell.com
-
Zong, Yian