topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
Nowdays , the opestack rocky release ironic , is support ironic boot from cinder volume(the cinder volume backend is ceph storage)? My goal is to achieve this. Who can tell me about this principle? looking forward to a reply thank you all.
This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago. We are working on getting this support in place soon but it probably will not be until the U release. Thanks! Jay On 5/8/2019 6:48 AM, 陈杰 wrote:
Nowdays , the opestack rocky release ironic , is support ironic boot from cinder volume(the cinder volume backend is ceph storage)? My goal is to achieve this. Who can tell me about this principle? looking forward to a reply thank you all.
Just brainstorming.... Would it be possible to set up a couple of VMs as iscsi LIO gateways by hand while this feature is being developed and using that end point to boot an Ironic node? You may also be on a late enough version of Ceph to do it using http://docs.ceph.com/docs/mimic/rbd/iscsi-overview/. Not self-service but could work for a few cases.. Tim -----Original Message----- From: Jay Bryant <jungleboyj@gmail.com> Reply-To: "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Date: Wednesday, 8 May 2019 at 17:46 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage) This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago. We are working on getting this support in place soon but it probably will not be until the U release. Thanks! Jay On 5/8/2019 6:48 AM, 陈杰 wrote: > Nowdays , the opestack rocky release ironic , is support ironic boot > from cinder volume(the cinder volume backend is ceph storage)? My goal > is to achieve this. > Who can tell me about this principle? > looking forward to a reply > thank you all.
Tim, Good thought. That would be an interim solution until we are able to get the process automated. Jay On 5/8/2019 10:55 AM, Tim Bell wrote:
Just brainstorming....
Would it be possible to set up a couple of VMs as iscsi LIO gateways by hand while this feature is being developed and using that end point to boot an Ironic node? You may also be on a late enough version of Ceph to do it using http://docs.ceph.com/docs/mimic/rbd/iscsi-overview/.
Not self-service but could work for a few cases..
Tim
-----Original Message----- From: Jay Bryant <jungleboyj@gmail.com> Reply-To: "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Date: Wednesday, 8 May 2019 at 17:46 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago.
We are working on getting this support in place soon but it probably will not be until the U release.
Thanks!
Jay
On 5/8/2019 6:48 AM, 陈杰 wrote: > Nowdays , the opestack rocky release ironic , is support ironic boot > from cinder volume(the cinder volume backend is ceph storage)? My goal > is to achieve this. > Who can tell me about this principle? > looking forward to a reply > thank you all.
Tim, Jay -- I looked in to this recently as it was a use-case some of our HPC users wanted support for. I noticed that Ceph has the iSCSI gateway, but my impression was that this wouldn't work without adding some sort of new driver in Cinder. Is that not true? I thought that Cinder only Ceph via RBD. I'd be happy to be proven wrong on this. Cheers, /Jason ________________________________ From: Jay Bryant <jungleboyj@gmail.com> Sent: Wednesday, May 8, 2019 11:04 To: openstack-discuss@lists.openstack.org Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage) Tim, Good thought. That would be an interim solution until we are able to get the process automated. Jay On 5/8/2019 10:55 AM, Tim Bell wrote:
Just brainstorming....
Would it be possible to set up a couple of VMs as iscsi LIO gateways by hand while this feature is being developed and using that end point to boot an Ironic node? You may also be on a late enough version of Ceph to do it using http://docs.ceph.com/docs/mimic/rbd/iscsi-overview/.
Not self-service but could work for a few cases..
Tim
-----Original Message----- From: Jay Bryant <jungleboyj@gmail.com> Reply-To: "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Date: Wednesday, 8 May 2019 at 17:46 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago.
We are working on getting this support in place soon but it probably will not be until the U release.
Thanks!
Jay
On 5/8/2019 6:48 AM, 陈杰 wrote: > Nowdays , the opestack rocky release ironic , is support ironic boot > from cinder volume(the cinder volume backend is ceph storage)? My goal > is to achieve this. > Who can tell me about this principle? > looking forward to a reply > thank you all.
Jason, You are correct. The plan is to add a driver that will use the iSCSI gateway to make volumes available instead of using RBD commands. So, the driver will be heavily based on the existing RBD driver but do the export via iSCSI gateway. Unfortunately, the iSCSI Gateway CLI is not well suited to remote execution so we have Walt Boring looking into better ways of interacting with the gateway or possibly updating the client to support our needs. If you want to see additional notes on the topic see our discussion from the PTG last week at around line 119. [1] Thanks! Jay [1] https://etherpad.openstack.org/p/cinder-train-ptg-planning On 5/8/2019 11:14 AM, Jason Anderson wrote:
Tim, Jay --
I looked in to this recently as it was a use-case some of our HPC users wanted support for. I noticed that Ceph has the iSCSI gateway, but my impression was that this wouldn't work without adding some sort of new driver in Cinder. Is that not true? I thought that Cinder only Ceph via RBD. I'd be happy to be proven wrong on this.
Cheers, /Jason ------------------------------------------------------------------------ *From:* Jay Bryant <jungleboyj@gmail.com> *Sent:* Wednesday, May 8, 2019 11:04 *To:* openstack-discuss@lists.openstack.org *Subject:* Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
Thanks Jay! So I guess if one wants to use the iSCSI gateway with Ironic now, one would have to use the 'external' storage interface available since Rocky and do the poking of Ceph out of band. That won't really work for our use case, but perhaps others could take advantage. I'm very grateful that the Cinder team is spending time on this! Cheers, /Jason ________________________________ From: Jay Bryant <jungleboyj@gmail.com> Sent: Wednesday, May 8, 2019 11:21 To: openstack-discuss@lists.openstack.org Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage) Jason, You are correct. The plan is to add a driver that will use the iSCSI gateway to make volumes available instead of using RBD commands. So, the driver will be heavily based on the existing RBD driver but do the export via iSCSI gateway. Unfortunately, the iSCSI Gateway CLI is not well suited to remote execution so we have Walt Boring looking into better ways of interacting with the gateway or possibly updating the client to support our needs. If you want to see additional notes on the topic see our discussion from the PTG last week at around line 119. [1] Thanks! Jay [1] https://etherpad.openstack.org/p/cinder-train-ptg-planning On 5/8/2019 11:14 AM, Jason Anderson wrote: Tim, Jay -- I looked in to this recently as it was a use-case some of our HPC users wanted support for. I noticed that Ceph has the iSCSI gateway, but my impression was that this wouldn't work without adding some sort of new driver in Cinder. Is that not true? I thought that Cinder only Ceph via RBD. I'd be happy to be proven wrong on this. Cheers, /Jason ________________________________ From: Jay Bryant <jungleboyj@gmail.com><mailto:jungleboyj@gmail.com> Sent: Wednesday, May 8, 2019 11:04 To: openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
Jason, Thanks for the input on this. Helps us know the priority of this effort. If you have additional input or are able to help with the effort we welcome your contributions/input. Once we have the spec for this up I will mail the mailing list to keep everyone in the loop. Jay On 5/8/2019 11:24 AM, Jason Anderson wrote:
Thanks Jay!
So I guess if one wants to use the iSCSI gateway with Ironic now, one would have to use the 'external' storage interface available since Rocky and do the poking of Ceph out of band. That won't really work for our use case, but perhaps others could take advantage.
I'm very grateful that the Cinder team is spending time on this!
Cheers, /Jason
I’m not sure you actually need full cinder support, see “Boot Without Cinder” in https://docs.openstack.org/ironic/latest/admin/boot-from-volume.html (Never tried it though ….) Tim From: Jason Anderson <jasonanderson@uchicago.edu> Date: Wednesday, 8 May 2019 at 18:17 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org>, "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage) Tim, Jay -- I looked in to this recently as it was a use-case some of our HPC users wanted support for. I noticed that Ceph has the iSCSI gateway, but my impression was that this wouldn't work without adding some sort of new driver in Cinder. Is that not true? I thought that Cinder only Ceph via RBD. I'd be happy to be proven wrong on this. Cheers, /Jason ________________________________ From: Jay Bryant <jungleboyj@gmail.com> Sent: Wednesday, May 8, 2019 11:04 To: openstack-discuss@lists.openstack.org Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage) Tim, Good thought. That would be an interim solution until we are able to get the process automated. Jay On 5/8/2019 10:55 AM, Tim Bell wrote:
Just brainstorming....
Would it be possible to set up a couple of VMs as iscsi LIO gateways by hand while this feature is being developed and using that end point to boot an Ironic node? You may also be on a late enough version of Ceph to do it using http://docs.ceph.com/docs/mimic/rbd/iscsi-overview/.
Not self-service but could work for a few cases..
Tim
-----Original Message----- From: Jay Bryant <jungleboyj@gmail.com> Reply-To: "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Date: Wednesday, 8 May 2019 at 17:46 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago.
We are working on getting this support in place soon but it probably will not be until the U release.
Thanks!
Jay
On 5/8/2019 6:48 AM, 陈杰 wrote: > Nowdays , the opestack rocky release ironic , is support ironic boot > from cinder volume(the cinder volume backend is ceph storage)? My goal > is to achieve this. > Who can tell me about this principle? > looking forward to a reply > thank you all.
Tim, This was kind of what I was picturing as the temporary work around for Cinder not supporting this yet. Ideally the user would be able to use Cinder to do all the volume management (create/delete/etc.), but right now the Ceph iSCSI CLI only shows the volumes it created. This is one of the challenges we have to resolve in adding this support. None-the-less users could use a portion of their Ceph storage for boot-from-volume purposes via the Ceph iSCSI CLI until we add the support. It would just require them to create the volume and set up the iSCSI target on the Ceph iSCSI gateway. Then the directions you shared for use without Cinder could be used to use the iSCSI Gateway as the target. In the future it should be possible to add those volumes under Cinder Management once we have all the support in place and then the Ceph iSCSI CLI would not need to be used in the future. Jay On 5/8/2019 11:25 AM, Tim Bell wrote:
I’m not sure you actually need full cinder support, see “Boot Without Cinder” in https://docs.openstack.org/ironic/latest/admin/boot-from-volume.html
(Never tried it though ….)
Tim
*From: *Jason Anderson <jasonanderson@uchicago.edu> *Date: *Wednesday, 8 May 2019 at 18:17 *To: *"openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org>, "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> *Subject: *Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
Tim, Jay --
I looked in to this recently as it was a use-case some of our HPC users wanted support for. I noticed that Ceph has the iSCSI gateway, but my impression was that this wouldn't work without adding some sort of new driver in Cinder. Is that not true? I thought that Cinder only Ceph via RBD. I'd be happy to be proven wrong on this.
Cheers,
/Jason
------------------------------------------------------------------------
*From:*Jay Bryant <jungleboyj@gmail.com> *Sent:* Wednesday, May 8, 2019 11:04 *To:* openstack-discuss@lists.openstack.org *Subject:* Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
Tim,
Good thought. That would be an interim solution until we are able to get the process automated.
Jay
Just brainstorming....
Would it be possible to set up a couple of VMs as iscsi LIO gateways by hand while this feature is being developed and using that end point to boot an Ironic node? You may also be on a late enough version of Ceph to do it using http://docs.ceph.com/docs/mimic/rbd/iscsi-overview/.
Not self-service but could work for a few cases..
Tim
-----Original Message----- From: Jay Bryant <jungleboyj@gmail.com> Reply-To: "jsbryant@electronicjungle.net" <jsbryant@electronicjungle.net> Date: Wednesday, 8 May 2019 at 17:46 To: "openstack-discuss@lists.openstack.org" <openstack-discuss@lists.openstack.org> Subject: Re: topic: ironic boot from cinder volume(the cinder volume backend is ceph storage)
This is going to require being able to export Ceph volumes via iSCSI. The Ironic team communicated the importance of this feature to the Cinder team a few months ago.
We are working on getting this support in place soon but it
On 5/8/2019 10:55 AM, Tim Bell wrote: probably
will not be until the U release.
Thanks!
Jay
On 5/8/2019 6:48 AM, 陈杰 wrote: > Nowdays , the opestack rocky release ironic , is support ironic boot > from cinder volume(the cinder volume backend is ceph storage)? My goal > is to achieve this. > Who can tell me about this principle? > looking forward to a reply > thank you all.
participants (4)
-
Jason Anderson
-
Jay Bryant
-
Tim Bell
-
陈杰