Hi there. We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. Let me know if you have any questions Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.org> Subject: about magnum capi for production Hello guys. Could you share with me some experience about using Magnum CAPI in production? https://github.com/vexxhost/magnum-cluster-api Thank you so much. Nguyen Huu Khoi

Hi there! It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine! We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it. Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> Sent: Monday, October 30, 2023 1:09:10 AM To: Mohammed Naser <mnaser@vexxhost.com> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production Hello, Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there. We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. Let me know if you have any questions Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: about magnum capi for production Hello guys. Could you share with me some experience about using Magnum CAPI in production? https://github.com/vexxhost/magnum-cluster-api Thank you so much. Nguyen Huu Khoi

Sounds good, thank you. We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :) Thanks! Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> Sent: Monday, October 30, 2023 8:23:07 AM To: Mohammed Naser <mnaser@vexxhost.com> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there! It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine! We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it. Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Monday, October 30, 2023 1:09:10 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello, Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there. We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. Let me know if you have any questions Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: about magnum capi for production Hello guys. Could you share with me some experience about using Magnum CAPI in production? https://github.com/vexxhost/magnum-cluster-api Thank you so much. Nguyen Huu Khoi

Hello Mohammed, I found that https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon? Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much! Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

...

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks! Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------ *From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------ *From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------ *From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys. Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hello. I get it now; Thank you very much. Nguyen Huu Khoi On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Thanks! Happy to see that it is working smoothly 😊 Appreciate any docs, comments or issues. From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> Date: Friday, November 17, 2023 at 8:57 AM To: Mohammed Naser <mnaser@vexxhost.com> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production Hello guys. I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it. Thank you vexxhost.com<http://vexxhost.com/> and contributors for very nice production. I will keep testing and reporting to help it be much better in the future. Nguyen Huu Khoi On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Hello. I get it now; Thank you very much. Nguyen Huu Khoi On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there, Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu Thanks! Mohammed From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Date: Monday, November 13, 2023 at 1:58 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello Mohammed, I found that https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon? Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Awesome, thank you so much! Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Sounds good, thank you. We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :) Thanks! Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Monday, October 30, 2023 8:23:07 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there! It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine! We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it. Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Monday, October 30, 2023 1:09:10 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello, Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there. We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. Let me know if you have any questions Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: about magnum capi for production Hello guys. Could you share with me some experience about using Magnum CAPI in production? https://github.com/vexxhost/magnum-cluster-api Thank you so much. Nguyen Huu Khoi

Hello. It uses prebuild Ubuntu to provision k8s cluster, On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

...

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Hi Nguyễn, Reopening this thread because I have tired your doc [1] and getting this error message message when I import image. # openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4 ERROR: ==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail: ~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it? On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hello. It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

...

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

...

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up. From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> Date: Thursday, December 14, 2023 at 4:58 PM To: Satish Patel <satish.txt@gmail.com> Cc: Mohammed Naser <mnaser@vexxhost.com>, OpenStack Discuss <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production Hello. you should miss We setup a k8s cluster to manage workload clusters which were created by Magnum. We need get /root/.kube/config from cluster management. Copy /root/.kube/config from "cluster management" to /var/lib/magnum/.kube/config Nguyen Huu Khoi On Thu, Dec 14, 2023 at 7:31 PM Satish Patel <satish.txt@gmail.com<mailto:satish.txt@gmail.com>> wrote: Hi Nguyễn, Reopening this thread because I have tired your doc [1] and getting this error message message when I import image. # openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4 ERROR: ==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail: ~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it? On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Hello guys. This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible.. https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20... Feel free to ask. If I can help, I will. Nguyen Huu Khoi On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Hello. It uses prebuild Ubuntu to provision k8s cluster, On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com<mailto:satish.txt@gmail.com>> wrote: Hi Folks, Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/ Do I need to install anything else to make it work? On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Thanks! Happy to see that it is working smoothly 😊 Appreciate any docs, comments or issues. From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Date: Friday, November 17, 2023 at 8:57 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello guys. I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it. Thank you vexxhost.com<http://vexxhost.com/> and contributors for very nice production. I will keep testing and reporting to help it be much better in the future. Nguyen Huu Khoi On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Hello. I get it now; Thank you very much. Nguyen Huu Khoi On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there, Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu Thanks! Mohammed From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Date: Monday, November 13, 2023 at 1:58 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello Mohammed, I found that https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon? Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> wrote: Awesome, thank you so much! Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Sounds good, thank you. We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :) Thanks! Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Monday, October 30, 2023 8:23:07 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello. Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there! It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine! We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it. Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Monday, October 30, 2023 1:09:10 AM To: Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: about magnum capi for production Hello, Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI. Nguyen Huu Khoi On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com<mailto:mnaser@vexxhost.com>> wrote: Hi there. We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. Let me know if you have any questions Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>> Sent: Sunday, October 29, 2023 10:22:22 PM To: OpenStack Discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: about magnum capi for production Hello guys. Could you share with me some experience about using Magnum CAPI in production? https://github.com/vexxhost/magnum-cluster-api Thank you so much. Nguyen Huu Khoi

Thanks for your reply, I have some doubts and questions inline with your response. On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here? You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel <satish.txt@gmail.com> *Cc: *Mohammed Naser <mnaser@vexxhost.com>, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel <satish.txt@gmail.com> wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Oh!! That link is very informative. Lots of good stuff there and especially diagrams make more sense. Finally I need a small k8s cluster outside kolla-ansible. @Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> But how to plan this in production and fit this in kolla-ansible? Now I have to maintain another k8s cluster to use with magnum. Did you deploy k8s inside kolla-ansible or outside nodes? How did you make it work and talk to kolla-ansible if its outside On Fri, Dec 15, 2023 at 4:35 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hi Satish.

It will help you understand how magnum cluster works.

https://github.com/vexxhost/magnum-cluster-api/issues/56

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 3:21 AM Satish Patel <satish.txt@gmail.com> wrote:

...

Thanks for your reply, I have some doubts and questions inline with your response.

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

...

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here?

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

...

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel <satish.txt@gmail.com> *Cc: *Mohammed Naser <mnaser@vexxhost.com>, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel <satish.txt@gmail.com> wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

I am playing with a kind cluster because it's easy to play. (I know this kind isn't for production load. What do you prefer for production deployment for a large network?) Does this cluster management k8s be required to be highly available and how much load is it going to take when the cloud grows? Trying to understand a single point of failure scenario. On Fri, Dec 15, 2023 at 5:27 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

We have many tools for k8s deployment,

I manage cluster management via kubespray.

Pls read my docs step by step,

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 4:54 AM Satish Patel <satish.txt@gmail.com> wrote:

...

Oh!! That link is very informative. Lots of good stuff there and especially diagrams make more sense. Finally I need a small k8s cluster outside kolla-ansible.

@Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> But how to plan this in production and fit this in kolla-ansible? Now I have to maintain another k8s cluster to use with magnum. Did you deploy k8s inside kolla-ansible or outside nodes? How did you make it work and talk to kolla-ansible if its outside

On Fri, Dec 15, 2023 at 4:35 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hi Satish.

It will help you understand how magnum cluster works.

https://github.com/vexxhost/magnum-cluster-api/issues/56

Nguyen Huu Khoi

On Sat, Dec 16, 2023 at 3:21 AM Satish Patel <satish.txt@gmail.com> wrote:

...

Thanks for your reply, I have some doubts and questions inline with your response.

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

...

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.

Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here?

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers?

...

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Thursday, December 14, 2023 at 4:58 PM *To: *Satish Patel <satish.txt@gmail.com> *Cc: *Mohammed Naser <mnaser@vexxhost.com>, OpenStack Discuss < openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello.

you should miss

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from * cluster management*.

Copy /root/.kube/config from "*cluster management*" to /var/lib/magnum/.kube/config

Nguyen Huu Khoi

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel <satish.txt@gmail.com> wrote:

Hi Nguyễn,

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image.

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

ERROR:

==> /var/log/kolla/magnum/magnum-api.log <== 2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance. 2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it?

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

https://github.com/ngyenhuukhoi/openstack-note/blob/main/Magnum%20Cluster%20...

Feel free to ask. If I can help, I will.

Nguyen Huu Khoi

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

Hi Folks,

Tell me if I am wrong. CAPI is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/

Do I need to install anything else to make it work?

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Thanks! Happy to see that it is working smoothly 😊

Appreciate any docs, comments or issues.

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Friday, November 17, 2023 at 8:57 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello guys.

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it.

Thank you vexxhost.com and contributors for very nice production.

I will keep testing and reporting to help it be much better in the future.

Nguyen Huu Khoi

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,

Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver. Otherwise, it will use the Cluster API if the image is marked as Ubuntu

Thanks!

Mohammed

*From: *Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Date: *Monday, November 13, 2023 at 1:58 AM *To: *Mohammed Naser <mnaser@vexxhost.com> *Cc: *OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject: *Re: about magnum capi for production

Hello Mohammed,

I found that

https://vexxhost.github.io/magnum-cluster-api/user/getting-started/#creating

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much!

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

Thanks!

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 8:23:07 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello.

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it.

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Monday, October 30, 2023 1:09:10 AM *To:* Mohammed Naser <mnaser@vexxhost.com> *Cc:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* Re: about magnum capi for production

Hello,

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

Nguyen Huu Khoi

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there.

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here.

Let me know if you have any questions

Thanks

Mohammed

Get Outlook for iOS <https://aka.ms/o0ukef> ------------------------------

*From:* Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> *Sent:* Sunday, October 29, 2023 10:22:22 PM *To:* OpenStack Discuss <openstack-discuss@lists.openstack.org> *Subject:* about magnum capi for production

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

https://github.com/vexxhost/magnum-cluster-api

Thank you so much.

Nguyen Huu Khoi

Thank you, I am stuck here.. I have build kind cluster outside kolla-ansible and copy ~/.kube/config to magnum_api and conductor container as per documented and when trying to create cluster getting following error # openstack coe cluster show mycluster2 +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | status | CREATE_FAILED | | health_status | None | | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | node_addresses | [] | | uuid | abf42808-d67c-450e-88e0-a20e65f35232 | | stack_id | kube-a0lo8 | | status_reason | 404 Client Error: Not Found for url: https://192.168.18.234:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha7/na... | | | system/openstackmachinetemplates/magnum-v0.13.0?fieldManager=atmosphere-operator&force=True | | created_at | 2023-12-17T09:16:05+00:00 | | updated_at | 2023-12-17T09:16:11+00:00 | | coe_version | None | | labels | {'kube_tag': 'v1.27.4'} | | labels_overridden | {} | | labels_skipped | {} | | labels_added | {} | | fixed_network | None | | fixed_subnet | None | | floating_ip_enabled | True | | faults | {} | | keypair | None | | api_address | None | | master_addresses | [] | | master_lb_enabled | False | | create_timeout | 60 | | node_count | 1 | | discovery_url | None | | docker_volume_size | None | | master_count | 1 | | container_version | None | | name | mycluster2 | | master_flavor_id | m1.medium | | flavor_id | m1.medium | | health_status_reason | {} | | project_id | 08cae850a5bb47d998da180a7f0e2660 | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ I have kind cluster configured as per documented # kubectl get namespaces NAME STATUS AGE capi-kubeadm-bootstrap-system Active 11h capi-kubeadm-control-plane-system Active 11h capi-system Active 11h capo-system Active 11h cert-manager Active 11h default Active 11h kube-node-lease Active 11h kube-public Active 11h kube-system Active 11h local-path-storage Active 11h magnum-system Active 11h # kubectl get deployment --all-namespaces NAMESPACE NAME READY UP-TO-DATE AVAILABLE AGE capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager 1/1 1 1 11h capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager 1/1 1 1 11h capi-system capi-controller-manager 1/1 1 1 11h capo-system capo-controller-manager 1/1 1 1 11h cert-manager cert-manager 1/1 1 1 11h cert-manager cert-manager-cainjector 1/1 1 1 11h cert-manager cert-manager-webhook 1/1 1 1 11h kube-system coredns 2/2 2 2 11h local-path-storage local-path-provisioner 1/1 1 1 11h What did I miss? On Sun, Dec 17, 2023 at 4:12 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hi. I setup a k8s cluster managent by kubespray.

About load, we can scale up or scale out our k8s node. just monitor it and you will know how to do.

It inside /var/lib/magnum/.kube/config If you see error saying URL 404 error so look like it reaching out to correct k8s cluster but application isn't there On Sun, Dec 17, 2023 at 4:35 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hi.

Where you put "/.kube/config" inside the containers.

Nguyen Huu Khoi

On Sun, Dec 17, 2023 at 4:25 PM Satish Patel <satish.txt@gmail.com> wrote:

...

Thank you,

I am stuck here.. I have build kind cluster outside kolla-ansible and copy ~/.kube/config to magnum_api and conductor container as per documented and when trying to create cluster getting following error # openstack coe cluster show mycluster2

+----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+ | status | CREATE_FAILED | | health_status | None | | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | node_addresses | [] | | uuid | abf42808-d67c-450e-88e0-a20e65f35232 | | stack_id | kube-a0lo8 | | status_reason | 404 Client Error: Not Found for url: https://192.168.18.234:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha7/na... | | | system/openstackmachinetemplates/magnum-v0.13.0?fieldManager=atmosphere-operator&force=True | | created_at | 2023-12-17T09:16:05+00:00 | | updated_at | 2023-12-17T09:16:11+00:00 | | coe_version | None | | labels | {'kube_tag': 'v1.27.4'} | | labels_overridden | {} | | labels_skipped | {} | | labels_added | {} | | fixed_network | None | | fixed_subnet | None | | floating_ip_enabled | True | | faults | {} | | keypair | None | | api_address | None | | master_addresses | [] | | master_lb_enabled | False | | create_timeout | 60 | | node_count | 1 | | discovery_url | None | | docker_volume_size | None | | master_count | 1 | | container_version | None | | name | mycluster2 | | master_flavor_id | m1.medium | | flavor_id | m1.medium | | health_status_reason | {} | | project_id | 08cae850a5bb47d998da180a7f0e2660 | +----------------------+-----------------------------------------------------------------------------------------------------------------------------------------+

I have kind cluster configured as per documented

# kubectl get namespaces NAME STATUS AGE capi-kubeadm-bootstrap-system Active 11h capi-kubeadm-control-plane-system Active 11h capi-system Active 11h capo-system Active 11h cert-manager Active 11h default Active 11h kube-node-lease Active 11h kube-public Active 11h kube-system Active 11h local-path-storage Active 11h magnum-system Active 11h

# kubectl get deployment --all-namespaces NAMESPACE NAME READY UP-TO-DATE AVAILABLE AGE capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager 1/1 1 1 11h capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager 1/1 1 1 11h capi-system capi-controller-manager 1/1 1 1 11h capo-system capo-controller-manager 1/1 1 1 11h cert-manager cert-manager 1/1 1 1 11h cert-manager cert-manager-cainjector 1/1 1 1 11h cert-manager cert-manager-webhook 1/1 1 1 11h kube-system coredns 2/2 2 2 11h local-path-storage local-path-provisioner 1/1 1 1 11h

What did I miss?

On Sun, Dec 17, 2023 at 4:12 AM Nguyễn Hữu Khôi < nguyenhuukhoinw@gmail.com> wrote:

...

Hi. I setup a k8s cluster managent by kubespray.

About load, we can scale up or scale out our k8s node. just monitor it and you will know how to do.

Little progress here. Looks like there is an issue in my CAPI deployment. I have tried the following which changed my error mesg but still my cluster build process failed. CAPI_VERSION=${CAPI_VERSION:-v1.5.1} CAPO_VERSION=${CAPO_VERSION:-v0.8.0} # Install the `clusterctl` CLI sudo curl -Lo /usr/local/bin/clusterctl https://github.com/kubernetes-sigs/cluster-api/releases/download/${CAPI_VERSION}/clusterctl-linux-amd64 sudo chmod +x /usr/local/bin/clusterctl # Initialize the `clusterctl` CLI export EXP_CLUSTER_RESOURCE_SET=true export EXP_KUBEADM_BOOTSTRAP_FORMAT_IGNITION=true export CLUSTER_TOPOLOGY=true clusterctl init \ --core cluster-api:${CAPI_VERSION} \ --bootstrap kubeadm:${CAPI_VERSION} \ --control-plane kubeadm:${CAPI_VERSION} \ --infrastructure openstack:${CAPO_VERSION} # ./kubectl get provider -A NAMESPACE NAME AGE TYPE PROVIDER VERSION capi-kubeadm-bootstrap-system bootstrap-kubeadm 17m BootstrapProvider kubeadm v1.5.1 capi-kubeadm-control-plane-system control-plane-kubeadm 17m ControlPlaneProvider kubeadm v1.5.1 capi-system cluster-api 17m CoreProvider cluster-api v1.5.1 capo-system infrastructure-openstack 17m InfrastructureProvider openstack v0.8.0 # Here is my template # openstack coe cluster template show k8s-v1.27.4 +-----------------------+--------------------------------------+ | Field | Value | +-----------------------+--------------------------------------+ | insecure_registry | - | | labels | {'kube_tag': 'v1.27.4'} | | updated_at | - | | floating_ip_enabled | True | | fixed_subnet | - | | master_flavor_id | m1.medium | | uuid | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | no_proxy | - | | https_proxy | - | | tls_disabled | False | | keypair_id | - | | public | False | | http_proxy | - | | docker_volume_size | - | | server_type | vm | | external_network_id | public-network-201 | | cluster_distro | ubuntu | | image_id | 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd | | volume_driver | - | | registry_enabled | False | | docker_storage_driver | overlay2 | | apiserver_port | - | | name | k8s-v1.27.4 | | created_at | 2023-12-16T21:50:21+00:00 | | network_driver | calico | | fixed_network | - | | coe | kubernetes | | flavor_id | m1.medium | | master_lb_enabled | False | | dns_nameserver | 8.8.8.8 | | hidden | False | | tags | - | +-----------------------+--------------------------------------+ ### create a cluster but there isn't any ERROR message. in status_reason # openstack coe cluster create --cluster-template k8s-v1.27.4 mycluster4 # openstack coe cluster show mycluster4 +----------------------+--------------------------------------+ | Field | Value | +----------------------+--------------------------------------+ | status | CREATE_FAILED | | health_status | None | | cluster_template_id | 2ddfdf2a-5962-42ee-a2e2-ff9e0b19dbe5 | | node_addresses | [] | | uuid | 8eaf2db3-d13c-4849-a517-5528219fc32f | | stack_id | kube-8kyrq | | status_reason | | | created_at | 2023-12-17T20:54:01+00:00 | | updated_at | 2023-12-17T20:54:08+00:00 | | coe_version | None | | labels | {'kube_tag': 'v1.27.4'} | | labels_overridden | {} | | labels_skipped | {} | | labels_added | {} | | fixed_network | None | | fixed_subnet | None | | floating_ip_enabled | True | | faults | {} | | keypair | None | | api_address | None | | master_addresses | [] | | master_lb_enabled | False | | create_timeout | 60 | | node_count | 1 | | discovery_url | None | | docker_volume_size | None | | master_count | 1 | | container_version | None | | name | mycluster4 | | master_flavor_id | m1.medium | | flavor_id | m1.medium | | health_status_reason | {} | | project_id | 08cae850a5bb47d998da180a7f0e2660 | +----------------------+--------------------------------------+ Can someone share their CAPI deployment code if I am missing anything? On Sun, Dec 17, 2023 at 8:54 AM <kmceliker@gmail.com> wrote:

Hey Nguyen,

I'm sorry to hear that you are stuck with your OpenStack cluster.

It seems that you are getting a 404 Client Error when trying to create a cluster using the magnum API. This could be due to several reasons, such as:

- The cluster template ID that you are using is not valid or does not exist. You can check the list of available cluster templates by running “openstack coe cluster“ template list

- The image ID that you are using is not compatible with the COE that you have selected. You can check the supported COEs and images by running “openstack coe list”

- The network driver or volume driver that you are using is not supported by the COE or the image. You can check the supported drivers and options by running “openstack coe driver list” and “openstack image show <image-id>”

- The security group or firewall rules that you have configured on your OpenStack instance or network are blocking the access to the magnum API endpoint. You can check the security group settings by running “openstack security group show <security-group-id>” and “openstack firewall show <firewall-id>”

To troubleshoot your issue, I suggest that you try the following steps below:

- Verify that your cluster template ID, image ID, network driver, volume driver, and security group settings are correct and match your requirements.

- Restart your OpenStack instance and/or network to apply any changes.

- Run “openstack coe cluster show <cluster-id>” to see if your cluster is in a valid state.

- Run “kubectl version --certificate-authority=ca.pem \\ --client-key=key.pem \\ --client-certificate=cert.pem -s <kubernetes-url>” to see if your Kubernetes client can connect to your cluster.

- If none of these steps resolve your issue, you may need to contact OpenStack support if you have a Premium License instead of Commercial one :)

I hope this helps you fix your problem. Please let me know if you have any other questions or feedback. 😊

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values # Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl # Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15 # Initialize clusterctl clusterctl init --infrastructure openstack # Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hey Oliver, it seems that the error is caused by a node group ID not being found in the database. This could happen if the node group was deleted or never created in the first place. Here are some possible ways to fix this issue: • You can try to recreate the node group using the nova-manage nodegroup create command with the same name and UUID as the one you are trying to use. • if the node group exists in the database by using the nova-manage nodegroup list command and look for the one with the matching UUID. • verify that you have created a cluster template with a valid node group ID and that it matches the one you are trying to use.You can • check if there are any other processes or services that are using or locking the node group ID and terminate them. I hope this helps you resolve your problem, mate :) Cheers, Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hey Oliver: It seems that the error message you’re sharing is because of the delete of a node group l, not related to the creation Feel free to join our Slack channel for help there too. Thanks Mohammed Get Outlook for iOS<https://aka.ms/o0ukef> ________________________________ From: Oliver Weinmann <oliver.weinmann@me.com> Sent: Monday, December 18, 2023 2:30:20 AM To: kmceliker@gmail.com <kmceliker@gmail.com> Cc: openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production You don't often get email from oliver.weinmann@me.com. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification> Hi all, I’m also trying to get the Vexxhost CAPI driver working under Kolla-Ansible. Many thanks to Nguyen Huu Khoi Github page. This was a very good starting point. My goal is to collect all the info to get it working in a single place (my blog). Currently the info is pretty much scattered on different websites, I managed to create the cluster template but the creation fails immediately. This is the error that I get in magnum-conductor.log: ==> /var/log/kolla/magnum/magnum-conductor.log <== 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/service/periodic.py", line 100, in update_status 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall ng.destroy() 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall return fn(self, *args, **kwargs) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/objects/nodegroup.py", line 175, in destroy 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall self.dbapi.destroy_nodegroup(self.cluster_id, self.uuid) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/db/sqlalchemy/api.py", line 832, in destroy_nodegroup 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall raise exception.NodeGroupNotFound(nodegroup=nodegroup_id) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall magnum.common.exception.NodeGroupNotFound: Nodegroup 4277e9e6-5c3e-4cce-a1cf-1f5e8c2f0689 could not be found. 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall (2023.1) [vagrant@seed ~]$ openstack coe cluster list +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | uuid | name | keypair | node_count | master_count | status | health_status | +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | b4ce540f-78a9-4c5d-a687-e992b3bd19a7 | k8s-flan-small-37-v1.23.3-containerd | mykey | 2 | 1 | CREATE_COMPLETE | HEALTHY | | e8acc6da-f937-4e8f-9df8-1728a8079ed0 | k8s-v1.24.16 | mykey | 2 | 1 | CREATE_FAILED | None | +--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ (2023.1) [vagrant@seed ~]$ openstack coe nodegroup list k8s-v1.24.16 +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | uuid | name | flavor_id | image_id | node_count | status | role | +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | 21c10537-e3d3-44cf-8e58-731cfeb5b9fe | default-master | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 1 | CREATE_IN_PROGRESS | master | | 12dec017-38cc-42d9-b944-649ae356907d | default-worker | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 2 | CREATE_IN_PROGRESS | worker | +--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+————+ Cheers, Oliver [On 17. Dec 2023, at 22:43, kmceliker@gmail.com wrote: Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values # Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl # Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15 # Initialize clusterctl clusterctl init --infrastructure openstack # Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

This is not about doc much. Because we have too many cloud environments. If we have a good blog, are you sure what you write will work well with all environments? Nguyen Huu Khoi On Mon, Dec 18, 2023 at 5:01 PM Satish Patel <satish.txt@gmail.com> wrote:

Hi Oliver,

I am 100% with you, There isn't any good technical blog or document about integration with magnum-capi drivers. There is good information but not good technical details with simple steps to follow. How to troubleshoot components etc. for the last few days I am struggling and still have no luck. I have tried all possible combinations. If my setup works then I will surely write good blogs.

On Mon, Dec 18, 2023 at 3:33 AM Oliver Weinmann <oliver.weinmann@me.com> wrote:

...

Hi all,

I’m also trying to get the Vexxhost CAPI driver working under Kolla-Ansible. Many thanks to Nguyen Huu Khoi Github page. This was a very good starting point. My goal is to collect all the info to get it working in a single place (my blog). Currently the info is pretty much scattered on different websites, I managed to create the cluster template but the creation fails immediately. This is the error that I get in magnum-conductor.log:

==> /var/log/kolla/magnum/magnum-conductor.log <== 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/service/periodic.py", line 100, in update_status 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall ng.destroy() 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall return fn(self, *args, **kwargs) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/objects/nodegroup.py", line 175, in destroy 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall self.dbapi.destroy_nodegroup(self.cluster_id, self.uuid) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall File "/var/lib/kolla/venv/lib64/python3.9/site-packages/magnum/db/sqlalchemy/api.py", line 832, in destroy_nodegroup 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall raise exception.NodeGroupNotFound(nodegroup=nodegroup_id) 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall magnum.common.exception.NodeGroupNotFound: Nodegroup 4277e9e6-5c3e-4cce-a1cf-1f5e8c2f0689 could not be found. 2023-12-17 23:27:03.482 7 ERROR oslo.service.loopingcall

(2023.1) [vagrant@seed ~]$ openstack coe cluster list

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | uuid | name | keypair | node_count | master_count | status | health_status |

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ | b4ce540f-78a9-4c5d-a687-e992b3bd19a7 | k8s-flan-small-37-v1.23.3-containerd | mykey | 2 | 1 | CREATE_COMPLETE | HEALTHY | | e8acc6da-f937-4e8f-9df8-1728a8079ed0 | k8s-v1.24.16 | mykey | 2 | 1 | CREATE_FAILED | None |

+--------------------------------------+--------------------------------------+---------+------------+--------------+-----------------+---------------+ (2023.1) [vagrant@seed ~]$ openstack coe nodegroup list k8s-v1.24.16

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | uuid | name | flavor_id | image_id | node_count | status | role |

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+--------+ | 21c10537-e3d3-44cf-8e58-731cfeb5b9fe | default-master | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 1 | CREATE_IN_PROGRESS | master | | 12dec017-38cc-42d9-b944-649ae356907d | default-worker | m1.kubernetes.small | 9d989f56-359b-4d6a-a914-926e0ea938d7 | 2 | CREATE_IN_PROGRESS | worker |

+--------------------------------------+----------------+---------------------+--------------------------------------+------------+--------------------+————+

Cheers, Oliver

[On 17. Dec 2023, at 22:43, kmceliker@gmail.com wrote:

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Closing the loop here. I have successfully set up CAPI and it works great. Build k8s cluster 1 Master and 1 Worker node in less than 3 minutes. I will blog out my stuff for people looking for help like me :) On Sun, Dec 17, 2023 at 4:53 PM <kmceliker@gmail.com> wrote:

Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values

# Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl

# Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15

# Initialize clusterctl clusterctl init --infrastructure openstack

# Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml

Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack

Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker

Hi Satish, Is it okay if we link that blog post to our documentation as a reference? Thanks, Mohammed ________________________________ From: Satish Patel <satish.txt@gmail.com> Sent: December 26, 2023 5:45 PM To: Oliver Weinmann <oliver.weinmann@me.com> Cc: kmceliker@gmail.com <kmceliker@gmail.com>; openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org> Subject: Re: about magnum capi for production Folks, I have created blog of what I did to deploy Magnum-capi driver, Please let me know if any issue or missing stuff - https://satishdotpatel.github.io/openstack-magnum-capi/ On Wed, Dec 20, 2023 at 1:23 AM Oliver Weinmann <oliver.weinmann@me.com<mailto:oliver.weinmann@me.com>> wrote: I would also like to know how managed to get it working. Still not working for me. :( Von meinem iPhone gesendet Am 20.12.2023 um 00:25 schrieb Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com<mailto:nguyenhuukhoinw@gmail.com>>:  Hello. I would like to recommend you should update something about your problem when it is finished. It may be good infonation for communication. Nguyen Huu Khoi On Wed, Dec 20, 2023 at 6:12 AM Satish Patel <satish.txt@gmail.com<mailto:satish.txt@gmail.com>> wrote: Closing the loop here. I have successfully set up CAPI and it works great. Build k8s cluster 1 Master and 1 Worker node in less than 3 minutes. I will blog out my stuff for people looking for help like me :) On Sun, Dec 17, 2023 at 4:53 PM <kmceliker@gmail.com<mailto:kmceliker@gmail.com>> wrote: Here is an example of a CAPI deployment code for OpenStack, mate - using the clusterctl tool and the cluster-template.yaml file. This code will create a cluster named capi-openstack with one control plane node and three worker nodes, using the ubuntu-2204 image and the m1.medium flavor. You need to replace the placeholders with your own values # Install clusterctl curl -L https://github.com/kubernetes-sigs/cluster-api/releases/download/v1.0.1/clus... -o clusterctl chmod +x ./clusterctl sudo mv ./clusterctl /usr/local/bin/clusterctl # Set environment variables export OPENSTACK_CLOUD=<openstack-cloud> export OPENSTACK_USERNAME=<openstack-username> export OPENSTACK_PASSWORD=<openstack-password> export OPENSTACK_DOMAIN_NAME=<openstack-domain-name> export OPENSTACK_PROJECT_ID=<openstack-project-id> export OPENSTACK_SSH_KEY_NAME=<openstack-ssh-key-name> export OPENSTACK_DNS_NAMESERVERS=<openstack-dns-nameservers> export OPENSTACK_EXTERNAL_NETWORK_ID=<openstack-external-network-id> export OPENSTACK_CONTROL_PLANE_MACHINE_FLAVOR=m1.medium export OPENSTACK_NODE_MACHINE_FLAVOR=m1.medium export OPENSTACK_IMAGE_NAME=ubuntu-2204 export KUBERNETES_VERSION=v1.23.15 # Initialize clusterctl clusterctl init --infrastructure openstack # Create cluster clusterctl config cluster capi-openstack --kubernetes-version $KUBERNETES_VERSION --control-plane-machine-count=1 --worker-machine-count=3 > cluster-template.yaml clusterctl create cluster --kubeconfig ~/.kube/config --infrastructure openstack:v0.6.0 --bootstrap kubeadm:v0.4.4 --control-plane kubeadm:v0.4.4 --cluster capi-openstack --namespace default --from cluster-template.yaml Also you can turn on Enable to Magnum Report Log on OpenStack to provide with us or Take a look deep dively as the following link; https://github.com/kubernetes-sigs/cluster-api-provider-openstack Best, Kerem Çeliker Head of Cloud Architecture tr.linkedin.com/in/keremceliker<http://tr.linkedin.com/in/keremceliker>