Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys. Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys. Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Awesome, thank you so much! Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks! Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys. Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks! Mohammed

From: Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com Date: Monday, November 13, 2023 at 1:58 AM To: Mohammed Naser mnaser@vexxhost.com Cc: OpenStack Discuss openstack-discuss@lists.openstack.org Subject: Re: about magnum capi for production Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.commailto:nguyenhuukhoinw@gmail.com> wrote: Awesome, thank you so much! Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.commailto:mnaser@vexxhost.com> wrote: Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks! Mohammed

Get Outlook for iOShttps://aka.ms/o0ukef ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.commailto:nguyenhuukhoinw@gmail.com> Sent: Monday, October 30, 2023 8:23:07 AM To: Mohammed Naser <mnaser@vexxhost.commailto:mnaser@vexxhost.com> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.orgmailto:openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production

Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.commailto:mnaser@vexxhost.com> wrote: Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks Mohammed

Get Outlook for iOShttps://aka.ms/o0ukef ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.commailto:nguyenhuukhoinw@gmail.com> Sent: Monday, October 30, 2023 1:09:10 AM To: Mohammed Naser <mnaser@vexxhost.commailto:mnaser@vexxhost.com> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.orgmailto:openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.commailto:mnaser@vexxhost.com> wrote: Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks Mohammed

Get Outlook for iOShttps://aka.ms/o0ukef ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.commailto:nguyenhuukhoinw@gmail.com> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.orgmailto:openstack-discuss@lists.openstack.org> Subject: about magnum capi for production

Hello guys. Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hello. I get it now; Thank you very much. Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

...

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hello. It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

...

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

...

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hello. you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from *cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel satish.txt@gmail.com wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hello. It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

...

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

...

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Thanks for your reply, I have some doubts and questions inline with your response.

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser mnaser@vexxhost.com wrote:

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here?

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel satish.txt@gmail.com *Cc: *Mohammed Naser mnaser@vexxhost.com, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel satish.txt@gmail.com wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Oh!! That link is very informative. Lots of good stuff there and especially diagrams make more sense. Finally I need a small k8s cluster outside kolla-ansible.

@Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com But how to plan this in production and fit this in kolla-ansible? Now I have to maintain another k8s cluster to use with magnum. Did you deploy k8s inside kolla-ansible or outside nodes? How did you make it work and talk to kolla-ansible if its outside

On Fri, Dec 15, 2023 at 4:35 PM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hi Satish.

It will help you understand how magnum cluster works.

https://github.com/vexxhost/magnum-cluster-api/issues/56

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 3:21 AM Satish Patel satish.txt@gmail.com wrote:

...

Thanks for your reply, I have some doubts and questions inline with your response.

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser mnaser@vexxhost.com wrote:

...

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here?

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

...

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel satish.txt@gmail.com *Cc: *Mohammed Naser mnaser@vexxhost.com, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel satish.txt@gmail.com wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

I am playing with a kind cluster because it's easy to play. (I know this kind isn't for production load. What do you prefer for production deployment for a large network?)

Does this cluster management k8s be required to be highly available and how much load is it going to take when the cloud grows? Trying to understand a single point of failure scenario.

On Fri, Dec 15, 2023 at 5:27 PM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

We have many tools for k8s deployment,

I manage cluster management via kubespray.

Pls read my docs step by step,

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 4:54 AM Satish Patel satish.txt@gmail.com wrote:

...

Oh!! That link is very informative. Lots of good stuff there and especially diagrams make more sense. Finally I need a small k8s cluster outside kolla-ansible.

@Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com But how to plan this in production and fit this in kolla-ansible? Now I have to maintain another k8s cluster to use with magnum. Did you deploy k8s inside kolla-ansible or outside nodes? How did you make it work and talk to kolla-ansible if its outside

On Fri, Dec 15, 2023 at 4:35 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hi Satish.

It will help you understand how magnum cluster works.

https://github.com/vexxhost/magnum-cluster-api/issues/56

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 3:21 AM Satish Patel satish.txt@gmail.com wrote:

...

Thanks for your reply, I have some doubts and questions inline with your response.

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser mnaser@vexxhost.com wrote:

...

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here?

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

...

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel satish.txt@gmail.com *Cc: *Mohammed Naser mnaser@vexxhost.com, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel satish.txt@gmail.com wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Thank you,

I am stuck here.. I have build kind cluster outside kolla-ansible and copy ~/.kube/config to magnum_api and conductor container as per documented and when trying to create cluster getting following error # openstack coe cluster show mycluster2

+----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value

| +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | status | CREATE_FAILED

| | health_status | None

| | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5

| | node_addresses | []

| | uuid | abf42808-d67c-450e-88e0-a20e65f35232

| | stack_id | kube-a0lo8

| | status_reason | 404 Client Error: Not Found for url: https://192.168.18.234:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha7/na... | | | system/openstackmachinetemplates/magnum-v0.13.0?fieldManager=atmosphere-operator&force=True | | created_at | 2023-12-17T09:16:05+00:00

| | updated_at | 2023-12-17T09:16:11+00:00

| | coe_version | None

| | labels | {'kube_tag': 'v1.27.4'}

| | labels_overridden | {}

| | labels_skipped | {}

| | labels_added | {}

| | fixed_network | None

| | fixed_subnet | None

| | floating_ip_enabled | True

| | faults | {}

| | keypair | None

| | api_address | None

| | master_addresses | []

| | master_lb_enabled | False

| | create_timeout | 60

| | node_count | 1

| | discovery_url | None

| | docker_volume_size | None

| | master_count | 1

| | container_version | None

| | name | mycluster2

| | master_flavor_id | m1.medium

| | flavor_id | m1.medium

| | health_status_reason | {}

| | project_id | 08cae850a5bb47d998da180a7f0e2660

| +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+

I have kind cluster configured as per documented

# kubectl get namespaces NAME STATUS AGE capi-kubeadm-bootstrap-system Active 11h capi-kubeadm-control-plane-system Active 11h capi-system Active 11h capo-system Active 11h cert-manager Active 11h default Active 11h kube-node-lease Active 11h kube-public Active 11h kube-system Active 11h local-path-storage Active 11h magnum-system Active 11h

# kubectl get deployment --all-namespaces NAMESPACE NAME READY UP-TO-DATE AVAILABLE AGE capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager 1/1 1 1 11h capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager 1/1 1 1 11h capi-system capi-controller-manager 1/1 1 1 11h capo-system capo-controller-manager 1/1 1 1 11h cert-manager cert-manager 1/1 1 1 11h cert-manager cert-manager-cainjector 1/1 1 1 11h cert-manager cert-manager-webhook 1/1 1 1 11h kube-system coredns 2/2 2 2 11h local-path-storage local-path-provisioner 1/1 1 1 11h

What did I miss?

On Sun, Dec 17, 2023 at 4:12 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hi. I setup a k8s cluster managent by kubespray.

About load, we can scale up or scale out our k8s node. just monitor it and you will know how to do.

It inside /var/lib/magnum/.kube/config

If you see error saying URL 404 error so look like it reaching out to correct k8s cluster but application isn't there

On Sun, Dec 17, 2023 at 4:35 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hi.

Where you put "/.kube/config" inside the containers.

Nguyen Huu Khoi

On Sun, Dec 17, 2023 at 4:25 PM Satish Patel satish.txt@gmail.com wrote:

...

Thank you,

I am stuck here.. I have build kind cluster outside kolla-ansible and copy ~/.kube/config to magnum_api and conductor container as per documented and when trying to create cluster getting following error # openstack coe cluster show mycluster2

+----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | status | CREATE_FAILED | | health_status | None | | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | node_addresses | [] | | uuid | abf42808-d67c-450e-88e0-a20e65f35232 | | stack_id | kube-a0lo8 | | status_reason | 404 Client Error: Not Found for url: https://192.168.18.234:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha7/na... | | | system/openstackmachinetemplates/magnum-v0.13.0?fieldManager=atmosphere-operator&force=True | | created_at | 2023-12-17T09:16:05+00:00 | | updated_at | 2023-12-17T09:16:11+00:00 | | coe_version | None | | labels | {'kube_tag': 'v1.27.4'} | | labels_overridden | {} | | labels_skipped | {} | | labels_added | {} | | fixed_network | None | | fixed_subnet | None | | floating_ip_enabled | True | | faults | {} | | keypair | None | | api_address | None | | master_addresses | [] | | master_lb_enabled | False | | create_timeout | 60 | | node_count | 1 | | discovery_url | None | | docker_volume_size | None | | master_count | 1 | | container_version | None | | name | mycluster2 | | master_flavor_id | m1.medium | | flavor_id | m1.medium | | health_status_reason | {} | | project_id | 08cae850a5bb47d998da180a7f0e2660 | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+

I have kind cluster configured as per documented

# kubectl get namespaces NAME STATUS AGE capi-kubeadm-bootstrap-system Active 11h capi-kubeadm-control-plane-system Active 11h capi-system Active 11h capo-system Active 11h cert-manager Active 11h default Active 11h kube-node-lease Active 11h kube-public Active 11h kube-system Active 11h local-path-storage Active 11h magnum-system Active 11h

# kubectl get deployment --all-namespaces NAMESPACE NAME READY UP-TO-DATE AVAILABLE AGE capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager 1/1 1 1 11h capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager 1/1 1 1 11h capi-system capi-controller-manager 1/1 1 1 11h capo-system capo-controller-manager 1/1 1 1 11h cert-manager cert-manager 1/1 1 1 11h cert-manager cert-manager-cainjector 1/1 1 1 11h cert-manager cert-manager-webhook 1/1 1 1 11h kube-system coredns 2/2 2 2 11h local-path-storage local-path-provisioner 1/1 1 1 11h

What did I miss?

On Sun, Dec 17, 2023 at 4:12 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hi. I setup a k8s cluster managent by kubespray.

About load, we can scale up or scale out our k8s node. just monitor it and you will know how to do.

Little progress here. Looks like there is an issue in my CAPI deployment.

I have tried the following which changed my error mesg but still my cluster build process failed.

CAPI_VERSION=${CAPI_VERSION:-v1.5.1} CAPO_VERSION=${CAPO_VERSION:-v0.8.0}

# Install the `clusterctl` CLI sudo curl -Lo /usr/local/bin/clusterctl https://github.com/kubernetes-sigs/cluster-api/releases/download/$%7BCAPI_VE... sudo chmod +x /usr/local/bin/clusterctl

# Initialize the `clusterctl` CLI export EXP_CLUSTER_RESOURCE_SET=true export EXP_KUBEADM_BOOTSTRAP_FORMAT_IGNITION=true export CLUSTER_TOPOLOGY=true clusterctl init \ --core cluster-api:${CAPI_VERSION} \ --bootstrap kubeadm:${CAPI_VERSION} \ --control-plane kubeadm:${CAPI_VERSION} \ --infrastructure openstack:${CAPO_VERSION}

# ./kubectl get provider -A NAMESPACE NAME AGE TYPE PROVIDER VERSION capi-kubeadm-bootstrap-system bootstrap-kubeadm 17m BootstrapProvider kubeadm v1.5.1 capi-kubeadm-control-plane-system control-plane-kubeadm 17m ControlPlaneProvider kubeadm v1.5.1 capi-system cluster-api 17m CoreProvider cluster-api v1.5.1 capo-system infrastructure-openstack 17m InfrastructureProvider openstack v0.8.0

# Here is my template

# openstack coe cluster template show k8s-v1.27.4 +-----------------------+--------------------------------------+ | Field | Value | +-----------------------+--------------------------------------+ | insecure_registry | - | | labels | {'kube_tag': 'v1.27.4'} | | updated_at | - | | floating_ip_enabled | True | | fixed_subnet | - | | master_flavor_id | m1.medium | | uuid | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | no_proxy | - | | https_proxy | - | | tls_disabled | False | | keypair_id | - | | public | False | | http_proxy | - | | docker_volume_size | - | | server_type | vm | | external_network_id | public-network-201 | | cluster_distro | ubuntu | | image_id | 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd | | volume_driver | - | | registry_enabled | False | | docker_storage_driver | overlay2 | | apiserver_port | - | | name | k8s-v1.27.4 | | created_at | 2023-12-16T21:50:21+00:00 | | network_driver | calico | | fixed_network | - | | coe | kubernetes | | flavor_id | m1.medium | | master_lb_enabled | False | | dns_nameserver | 8.8.8.8 | | hidden | False | | tags | - | +-----------------------+--------------------------------------+

### create a cluster but there isn't any ERROR message. in status_reason

# openstack coe cluster create --cluster-template k8s-v1.27.4 mycluster4

# openstack coe cluster show mycluster4 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | status | CREATE_FAILED | | health_status | None | | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | node_addresses | [] | | uuid | 8eaf2db3-d13c-4849-a517-5528219fc32f | | stack_id | kube-8kyrq | | status_reason | | | created_at | 2023-12-17T20:54:01+00:00 | | updated_at | 2023-12-17T20:54:08+00:00 | | coe_version | None | | labels | {'kube_tag': 'v1.27.4'} | | labels_overridden | {} | | labels_skipped | {} | | labels_added | {} | | fixed_network | None | | fixed_subnet | None | | floating_ip_enabled | True | | faults | {} | | keypair | None | | api_address | None | | master_addresses | [] | | master_lb_enabled | False | | create_timeout | 60 | | node_count | 1 | | discovery_url | None | | docker_volume_size | None | | master_count | 1 | | container_version | None | | name | mycluster4 | | master_flavor_id | m1.medium | | flavor_id | m1.medium | | health_status_reason | {} | | project_id | 08cae850a5bb47d998da180a7f0e2660 | +----------------------+--------------------------------------+

Can someone share their CAPI deployment code if I am missing anything?

On Sun, Dec 17, 2023 at 8:54 AM kmceliker@gmail.com wrote:

Hey Nguyen,

I'm sorry to hear that you are stuck with your OpenStack cluster.

It seems that you are getting a 404 Client Error when trying to create a cluster using the magnum API. This could be due to several reasons, such as:

• The cluster template ID that you are using is not valid or does not

exist. You can check the list of available cluster templates by running “openstack coe cluster“ template list

• The image ID that you are using is not compatible with the COE that you

have selected. You can check the supported COEs and images by running “openstack coe list”

• The network driver or volume driver that you are using is not supported

by the COE or the image. You can check the supported drivers and options by running “openstack coe driver list” and “openstack image show <image-id>”

• The security group or firewall rules that you have configured on your

OpenStack instance or network are blocking the access to the magnum API endpoint. You can check the security group settings by running “openstack security group show <security-group-id>” and “openstack firewall show <firewall-id>”

To troubleshoot your issue, I suggest that you try the following steps below:

• Verify that your cluster template ID, image ID, network driver, volume

driver, and security group settings are correct and match your requirements.

• Restart your OpenStack instance and/or network to apply any changes.

• Run “openstack coe cluster show <cluster-id>” to see if your cluster is

in a valid state.

• Run “kubectl version --certificate-authority=ca.pem \

--client-key=key.pem \ --client-certificate=cert.pem -s <kubernetes-url>” to see if your Kubernetes client can connect to your cluster.

• If none of these steps resolve your issue, you may need to contact

OpenStack support if you have a Premium License instead of Commercial one :)

I hope this helps you fix your problem. Please let me know if you have any other questions or feedback. 😊

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hey Oliver,

it seems that the error is caused by a node group ID not being found in the database. This could happen if the node group was deleted or never created in the first place.

Here are some possible ways to fix this issue:

• You can try to recreate the node group using the nova-manage nodegroup create command with the same name and UUID as the one you are trying to use.

• if the node group exists in the database by using the nova-manage nodegroup list command and look for the one with the matching UUID.

• verify that you have created a cluster template with a valid node group ID and that it matches the one you are trying to use.You can

• check if there are any other processes or services that are using or locking the node group ID and terminate them.

I hope this helps you resolve your problem, mate :)

Cheers, Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hey Oliver:

It seems that the error message you’re sharing is because of the delete of a node group l, not related to the creation

Feel free to join our Slack channel for help there too.

Thanks Mohammed

Get Outlook for iOShttps://aka.ms/o0ukef ________________________________ From: Oliver Weinmann oliver.weinmann@me.com Sent: Monday, December 18, 2023 2:30:20 AM To: kmceliker@gmail.com kmceliker@gmail.com Cc: openstack-discuss@lists.openstack.org openstack-discuss@lists.openstack.org Subject: Re: about magnum capi for production

You don't often get email from oliver.weinmann@me.com. Learn why this is importanthttps://aka.ms/LearnAboutSenderIdentification Hi all,

I’m also trying to get the Vexxhost CAPI driver working under Kolla-Ansible. Many thanks to Nguyen Huu Khoi Github page. This was a very good starting point. My goal is to collect all the info to get it working in a single place (my blog). Currently the info is pretty much scattered on different websites, I managed to create the cluster template but the creation fails immediately. This is the error that I get in magnum-conductor.log:

==> /var/log/kolla/magnum/magnum-conductor.log <== 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/service/periodic.py", line 100, in update_status 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall ng.destroy() 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall return fn(self, *args, **kwargs) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/objects/nodegroup.py", line 175, in destroy 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall self.dbapi.destroy_nodegroup(self.cluster_id, self.uuid) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/db/sqlalchemy/api.py", line 832, in destroy_nodegroup 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall raise exception.NodeGroupNotFound(nodegroup=nodegroup_id) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall magnum.common.exception.NodeGroupNotFound: Nodegroup 4277e9e6-5c3e-4cce-a1cf-1f5e8c2f0689 could not be found. 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall

(2023.1) [vagrant@seed ~]$ openstack coe cluster list +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | uuid | name | keypair | node_count | master_count | status | health_status | +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | b4ce540f-78a9-4c5d-a687-e992b3bd19a7 | k8s-flan-small-37-v1.23.3-containerd | mykey | 2 | 1 | CREATE_COMPLETE | HEALTHY | | e8acc6da-f937-4e8f-9df8-1728a8079ed0 | k8s-v1.24.16 | mykey | 2 | 1 | CREATE_FAILED | None | +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ (2023.1) [vagrant@seed ~]$ openstack coe nodegroup list k8s-v1.24.16 +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | uuid | name | flavor_id | image_id | node_count | status | role | +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | 21c10537-e3d3-44cf-8e58-731cfeb5b9fe | default-master | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 1 | CREATE_IN_PROGRESS | master | | 12dec017-38cc-42d9-b944-649ae356907d | default-worker | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 2 | CREATE_IN_PROGRESS | worker | +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+————+

Cheers, Oliver

[On 17. Dec 2023, at 22:43, kmceliker@gmail.com wrote:

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

This is not about doc much. Because we have too many cloud environments. If we have a good blog, are you sure what you write will work well with all environments? Nguyen Huu Khoi

On Mon, Dec 18, 2023 at 5:01 PM Satish Patel satish.txt@gmail.com wrote:

Hi Oliver,

I am 100% with you, There isn't any good technical blog or document about integration with magnum-capi drivers. There is good information but not good technical details with simple steps to follow. How to troubleshoot components etc. for the last few days I am struggling and still have no luck. I have tried all possible combinations. If my setup works then I will surely write good blogs.

On Mon, Dec 18, 2023 at 3:33 AM Oliver Weinmann oliver.weinmann@me.com wrote:

...

Hi all,

I’m also trying to get the Vexxhost CAPI driver working under Kolla-Ansible. Many thanks to Nguyen Huu Khoi Github page. This was a very good starting point. My goal is to collect all the info to get it working in a single place (my blog). Currently the info is pretty much scattered on different websites, I managed to create the cluster template but the creation fails immediately. This is the error that I get in magnum-conductor.log:

==> /var/log/kolla/magnum/magnum-conductor.log <== 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/service/periodic.py", line 100, in update_status 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall ng.destroy() 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall return fn(self, *args, **kwargs) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/objects/nodegroup.py", line 175, in destroy 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall self.dbapi.destroy_nodegroup(self.cluster_id, self.uuid) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/db/sqlalchemy/api.py", line 832, in destroy_nodegroup 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall raise exception.NodeGroupNotFound(nodegroup=nodegroup_id) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall magnum.common.exception.NodeGroupNotFound: Nodegroup 4277e9e6-5c3e-4cce-a1cf-1f5e8c2f0689 could not be found. 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall

(2023.1) [vagrant@seed ~]$ openstack coe cluster list

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | uuid | name | keypair | node_count | master_count | status | health_status |

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | b4ce540f-78a9-4c5d-a687-e992b3bd19a7 | k8s-flan-small-37-v1.23.3-containerd | mykey | 2 | 1 | CREATE_COMPLETE | HEALTHY | | e8acc6da-f937-4e8f-9df8-1728a8079ed0 | k8s-v1.24.16 | mykey | 2 | 1 | CREATE_FAILED | None |

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ (2023.1) [vagrant@seed ~]$ openstack coe nodegroup list k8s-v1.24.16

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | uuid | name | flavor_id | image_id | node_count | status | role |

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | 21c10537-e3d3-44cf-8e58-731cfeb5b9fe | default-master | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 1 | CREATE_IN_PROGRESS | master | | 12dec017-38cc-42d9-b944-649ae356907d | default-worker | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 2 | CREATE_IN_PROGRESS | worker |

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+————+

Cheers, Oliver

[On 17. Dec 2023, at 22:43, kmceliker@gmail.com wrote:

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Closing the loop here. I have successfully set up CAPI and it works great. Build k8s cluster 1 Master and 1 Worker node in less than 3 minutes.

I will blog out my stuff for people looking for help like me :)

On Sun, Dec 17, 2023 at 4:53 PM kmceliker@gmail.com wrote:

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hi Satish,

Is it okay if we link that blog post to our documentation as a reference?

Thanks, Mohammed ________________________________ From: Satish Patel satish.txt@gmail.com Sent: December 26, 2023 5:45 PM To: Oliver Weinmann oliver.weinmann@me.com Cc: kmceliker@gmail.com kmceliker@gmail.com; openstack-discuss@lists.openstack.org openstack-discuss@lists.openstack.org Subject: Re: about magnum capi for production

Folks,

I have created blog of what I did to deploy Magnum-capi driver, Please let me know if any issue or missing stuff - https://satishdotpatel.github.io/openstack-magnum-capi/

On Wed, Dec 20, 2023 at 1:23 AM Oliver Weinmann <oliver.weinmann@me.commailto:oliver.weinmann@me.com> wrote: I would also like to know how managed to get it working. Still not working for me. :(

Von meinem iPhone gesendet

Am 20.12.2023 um 00:25 schrieb Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.commailto:nguyenhuukhoinw@gmail.com>:

 Hello.

I would like to recommend you should update something about your problem when it is finished. It may be good infonation for communication.

Nguyen Huu Khoi

On Wed, Dec 20, 2023 at 6:12 AM Satish Patel <satish.txt@gmail.commailto:satish.txt@gmail.com> wrote: Closing the loop here. I have successfully set up CAPI and it works great. Build k8s cluster 1 Master and 1 Worker node in less than 3 minutes.

I will blog out my stuff for people looking for help like me :)

On Sun, Dec 17, 2023 at 4:53 PM <kmceliker@gmail.commailto:kmceliker@gmail.com> wrote: Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremcelikerhttp://tr.linkedin.com/in/keremceliker

My questions are inline.

On Fri, Dec 15, 2023 at 3:28 AM Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com wrote:

Hello. you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

What do you mean by setup k8s cluster to manage? I though magnum create k8s cluster so from where I will get k8s cluster in advance?

Here is my steps.

1. Enable magnum on kolla-ansible 2. Installed capi python module in all magnum containers as per your notes. 3. Restart all containers. 4. Import all the images from vaxxhost 5. Creating coe template - this is where I’m getting error of missing .kube/config file.

What did I miss here?

We need get /root/.kube/config from *cluster management*.

what is cluster management ? Sorry if I’m asking noob question.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel satish.txt@gmail.com wrote:

...

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hello. It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel satish.txt@gmail.com wrote:

...

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser mnaser@vexxhost.com wrote:

...

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser mnaser@vexxhost.com *Cc: *OpenStack Discuss openstack-discuss@lists.openstack.org *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser mnaser@vexxhost.com wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser mnaser@vexxhost.com *Cc:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser mnaser@vexxhost.com wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS https://aka.ms/o0ukef

*From:* Nguyễn Hữu Khôi nguyenhuukhoinw@gmail.com *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss openstack-discuss@lists.openstack.org *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi