Oh!! That link is very informative. Lots of good stuff there and especially diagrams make more sense. Finally I need a small k8s cluster outside kolla-ansible. 

@Nguyễn Hữu Khôi But how to plan this in production and fit this in kolla-ansible? Now I have to maintain another k8s cluster to use with magnum. Did you deploy k8s inside kolla-ansible or outside nodes? How did you make it work and talk to kolla-ansible if its outside 

On Fri, Dec 15, 2023 at 4:35 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:
Hi Satish.

It will help you understand how magnum cluster works.

https://github.com/vexxhost/magnum-cluster-api/issues/56

Nguyen Huu Khoi


On Sat, Dec 16, 2023 at 3:21 AM Satish Patel <satish.txt@gmail.com> wrote:

Thanks for your reply, I have some doubts and questions inline with your response. 

On Thu, Dec 14, 2023 at 6:14 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

FYI, this can just be any Kubernetes cluster that you can stand up on any node using `kind` or any other way of getting a cluster up.


Maybe I missed something in the document or not clearly mentioned that I need k8s cluster first to run magnum with CAPI. I am still confused how the workload works here? 

You are saying I have to spin up the first k8s cluster somewhere outside kolla-ansible and then use that k8s cluster config file to copy into kolla-ansible mangum containers? 


 

 

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Date: Thursday, December 14, 2023 at 4:58 PM
To: Satish Patel <satish.txt@gmail.com>
Cc: Mohammed Naser <mnaser@vexxhost.com>, OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: Re: about magnum capi for production

Hello.

you should miss

 

We setup a k8s cluster to manage workload clusters which were created by Magnum.

We need get /root/.kube/config from cluster management.

Copy /root/.kube/config from "cluster management" to /var/lib/magnum/.kube/config


Nguyen Huu Khoi

 

 

On Thu, Dec 14, 2023 at 7:31 PM Satish Patel <satish.txt@gmail.com> wrote:

Hi Nguyễn,

 

Reopening this thread because I have tired your doc [1] and getting this error message message when I import image. 

 

# openstack coe cluster template create --image 7b6130b4-8374-4dd7-b6ff-91e06e6a9afd --external-network public-network-201 --dns-nameserver 8.8.8.8 --master-flavor m1.medium --flavor m1.medium --network-driver calico --docker-storage-driver overlay2 --coe kubernetes --label kube_tag=v1.27.4 k8s-v1.27.4

 

ERROR:

 

==> /var/log/kolla/magnum/magnum-api.log <==
2023-12-14 12:24:04.022 456 WARNING oslo_messaging.rpc.client [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Using RPCClient manually to instantiate client. Please use get_rpc_client to obtain an RPC client instance.
2023-12-14 12:24:04.634 456 ERROR wsme.api [None req-62487543-3622-4623-bba0-97162e748472 93e2d918bc7a4d92a93df927743d00ff 08cae850a5bb47d998da180a7f0e2660 default - - -] Server-side error: "Configuration file ~/.kube/config not found". Detail:

 

 

 ~/.kube/config not found but I am confused that from where I am going to find this file? how do I generate it? 

 

On Mon, Nov 20, 2023 at 12:16 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hello guys.

 

This is a doc which is about how to make Magnum CAPI to work with Openstack deployed by Kolla Ansible..

 

 

Feel free to ask. If I can help, I will.


Nguyen Huu Khoi

 

 

On Mon, Nov 20, 2023 at 12:09 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hello.

It uses prebuild Ubuntu to provision k8s cluster,

 

On Mon, Nov 20, 2023 at 11:47 AM Satish Patel <satish.txt@gmail.com> wrote:

Hi Folks, 

 

Tell me if I am wrong. CAPI  is just kubernetes images to build k8s clusters instead using coreOS and install a bunch of stuff via heat. In documentation all I can see are imported images. Reference doc: https://vexxhost.github.io/magnum-cluster-api/user/getting-started/ 

 

Do I need to install anything else to make it work? 

 

On Fri, Nov 17, 2023 at 11:30 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Thanks!  Happy to see that it is working smoothly 😊

 

Appreciate any docs, comments or issues.

 

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Date: Friday, November 17, 2023 at 8:57 AM
To: Mohammed Naser <mnaser@vexxhost.com>
Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: Re: about magnum capi for production

Hello guys.

 

I have successfully implemented Magnum CAPI on my openstack system. My deployment tool for Openstack is Kolla-Ansible. It worked greatly, I am testing with create, delete and resize k8s cluster. It is smooth when compared with Heat Driver. I will make some docs for new users to use it. 

 

Thank you vexxhost.com and contributors for very nice production.

 

I will keep testing and reporting to help it be much better in the future.


Nguyen Huu Khoi

 

 

On Tue, Nov 14, 2023 at 5:50 AM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Hello.

I get it now;

Thank you very much.

Nguyen Huu Khoi

 

 

On Mon, Nov 13, 2023 at 11:20 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there,


Nope – it is simply a different driver, so if you try to create Fedora CoreOS clusters – it’ll use the old heat driver.  Otherwise, it will use the Cluster API if the image is marked as Ubuntu

 

Thanks!

Mohammed

 

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Date: Monday, November 13, 2023 at 1:58 AM
To: Mohammed Naser <mnaser@vexxhost.com>
Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: Re: about magnum capi for production

Hello Mohammed,

 

I found that 

 

 

I would like to know that if we use cluster api, does it overwrite heat when deploying new k8s cluster from horizon?


Nguyen Huu Khoi

 

 

On Mon, Oct 30, 2023 at 7:49 PM Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> wrote:

Awesome, thank you so much! 

Nguyen Huu Khoi

 

 

On Mon, Oct 30, 2023 at 7:31 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Sounds good, thank you.

 

We also have a channel on the Kubernetes Slack that is relatively active if you need help — it’s in the README :)

 

Thanks!

Mohammed

 

Get Outlook for iOS

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Sent: Monday, October 30, 2023 8:23:07 AM
To: Mohammed Naser <mnaser@vexxhost.com>
Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: Re: about magnum capi for production

 

Hello. 

Thank you very much. I am planning to use Magnum CAPI for my system. I will feedback later.

Nguyen Huu Khoi

 

 

On Mon, Oct 30, 2023 at 7:03 PM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there!

 

It works out of the box since the goal is to have an API that is compatible so that all the ecosystem tools such as Terraform, Ansible, CLI, Horizon all continue to work just fine!

 

We’ve even made some quality of life improvements to the Magnum plugin like letting you download KUBECONFIG from it. 

 

Thanks

Mohammed

 

Get Outlook for iOS

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Sent: Monday, October 30, 2023 1:09:10 AM
To: Mohammed Naser <mnaser@vexxhost.com>
Cc: OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: Re: about magnum capi for production

 

Hello, 

 

Thank you for your sharing, Could you tell me how we use it with Horizon or we need custom Horizon to use Magnum CAPI.

 

Nguyen Huu Khoi

 

 

On Mon, Oct 30, 2023 at 11:10 AM Mohammed Naser <mnaser@vexxhost.com> wrote:

Hi there. 

 

We deploy this driver in production in our public cloud as well as many private clouds and as part of Atmosphere and we’ve been fully maintaining it on our side here. 

 

Let me know if you have any questions

 

Thanks

Mohammed

 

Get Outlook for iOS

From: Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com>
Sent: Sunday, October 29, 2023 10:22:22 PM
To: OpenStack Discuss <openstack-discuss@lists.openstack.org>
Subject: about magnum capi for production

 

Hello guys.

Could you share with me some experience about using Magnum CAPI in production?

 

 

Thank you so much.


Nguyen Huu Khoi