<div dir="ltr">Thank you for reply folks, <div><br></div><div>But after attempting so many images I settled on fedora-coreos-31.20200517.3.0-openstack.x86_64.qcow2 for Xena release. Now everything is working fine. Look like magnum/openstack/fedoracore all should be aligned on specific versions. </div><div><br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Aug 3, 2023 at 3:51 AM Oliver Weinmann <<a href="mailto:oliver.weinmann@me.com">oliver.weinmann@me.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto"><div dir="ltr"><div dir="ltr"><span style="background-color:rgb(44,44,46)">Hi satish,</span><div><br></div><div>For me it is working fine when using the following template:</div><div><br></div><div><pre style="box-sizing:inherit;margin-top:0.5em;margin-bottom:0.5em;padding:1em;border:1px solid rgb(0,0,0);font-stretch:inherit;line-height:1;font-family:Consolas,Monaco,"Andale Mono","Ubuntu Mono",monospace;font-kerning:inherit;font-variant-alternates:inherit;font-variant-ligatures:inherit;font-variant-numeric:inherit;font-variant-east-asian:inherit;font-feature-settings:inherit;font-size:18px;vertical-align:baseline;min-width:100%;overflow:auto;max-width:100%;color:rgb(15,15,8);background:rgb(255,255,255);border-radius:0.3em;white-space:pre-wrap;word-break:normal"><code style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:0.7;font-family:Consolas,Monaco,"Andale Mono","Ubuntu Mono",monospace;font-kerning:inherit;font-feature-settings:inherit;font-size:0.7em;vertical-align:baseline;background-image:none;background-position:0% 50%;background-size:auto;background-repeat:repeat;background-origin:padding-box;background-clip:border-box;border-radius:3px;white-space:pre-wrap;word-spacing:normal;word-break:normal">openstack coe cluster template create k8s-flan-small-35-1.21.11 <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--image Fedora-CoreOS-35 <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--keypair mykey <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--external-network ext-net <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--dns-nameserver <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline;color:rgb(72,16,174)">8.8</span>.8.8 <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--flavor m1.small <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--master-flavor m1.small <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--volume-driver cinder <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--docker-volume-size <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline;color:rgb(72,16,174)">10</span> <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--network-driver flannel <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--docker-storage-driver overlay2 <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--coe kubernetes <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">\</span>
--labels <span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">kube_tag</span><span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">=</span>v1.21.11-rancher1,hyperkube_prefix<span style="box-sizing:inherit;margin:0px;padding:0px;border:0px;font-style:inherit;font-variant:inherit;font-stretch:inherit;line-height:inherit;font-family:inherit;font-kerning:inherit;font-feature-settings:inherit;font-size:12.6px;vertical-align:baseline">=</span><span dir="ltr"><a href="http://docker.io/rancher/" target="_blank">docker.io/rancher/</a></span></code></pre></div><div dir="ltr"><div style="color:rgb(0,0,0)"><br></div><div style="color:rgb(0,0,0)">I just recently deployed Antelope 2023.1 with kolla-Ansible and here magnum works much better out of the box using the default settings. I have never managed to get containerd working in Yoga or Zed.</div><div style="color:rgb(0,0,0)"><br></div><div style="color:rgb(0,0,0)">You can find more info on my blog:</div><div style="color:rgb(0,0,0)"><br></div><div style="color:rgb(0,0,0)">((<a href="https://www.roksblog.de/deploy-kubernetes-clusters-in-openstack-within-minutes-with-magnum/" target="_blank">https://www.roksblog.de/deploy-kubernetes-clusters-in-openstack-within-minutes-with-magnum/</a>))</div><div style="color:rgb(0,0,0)"><br></div><div style="color:rgb(0,0,0)">Cheers,</div><div style="color:rgb(0,0,0)">Oliver</div></div><br><div dir="ltr">Von meinem iPhone gesendet</div><div dir="ltr"><br><blockquote type="cite">Am 03.08.2023 um 02:04 schrieb Nguyễn Hữu Khôi <<a href="mailto:nguyenhuukhoinw@gmail.com" target="_blank">nguyenhuukhoinw@gmail.com</a>>:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><div dir="ltr">Hello Satish,<div>You need install k8s from tar files by using labels below. I think our Magnum too old to use. Just my experience.</div><div><br></div><div>containerd_tarball_url<br></div><div>containerd_tarball_sha256<br></div><div><br></div><div><br></div><div><br clear="all"><div><div dir="ltr" class="gmail_signature"><div dir="ltr">Nguyen Huu Khoi<br></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 2, 2023 at 5:23 AM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hmm, what the heck is going on here. Wallaby? (I am running openstack Xena, Am I using the wrong image?) <div><br></div><div>[root@mycluster31-bw5yi3lzkw45-master-0 ~]# podman ps<br>CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES<br>e8b9a439194e <a href="http://docker.io/openstackmagnum/heat-container-agent:wallaby-stable-1" target="_blank">docker.io/openstackmagnum/heat-container-agent:wallaby-stable-1</a> /usr/bin/start-he... 30 minutes ago Up 30 minutes ago heat-container-agent<br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Aug 1, 2023 at 5:27 PM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">After some spelunking I found some error messages on instance in journalctl. Why error logs showing podman? <div><br></div><div><a href="https://paste.opendev.org/show/bp1iEBV2meihZmRtH2M1/" target="_blank">https://paste.opendev.org/show/bp1iEBV2meihZmRtH2M1/</a> <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Aug 1, 2023 at 5:20 PM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Folks,<br><div><br></div><div>I am running the Xena release and fedora-coreos-31.X image. My cluster is always throwing an error kube_masters CREATE_FAILED. </div><div><br></div><div>This is my template:</div><div><br></div><div>openstack coe cluster template create --coe kubernetes --image "fedora-coreos-35.20220116" --flavor gen.medium --master-flavor gen.medium --docker-storage-driver overlay2 --keypair jmp1-key --external-network net_eng_vlan_39 --network-driver flannel --dns-nameserver 8.8.8.8 --labels="container_runtime=containerd,cinder_csi_enabled=false" --labels kube_tag=v1.21.11-rancher1,hyperkube_prefix=<a href="http://docker.io/rancher/" target="_blank">docker.io/rancher/</a> k8s-new-template-31<br></div><div><br></div><div>Command to create cluster:</div><div><br></div><div>openstack coe cluster create --cluster-template k8s-new-template-31 --master-count 1 --node-count 2 --keypair jmp1-key mycluster31<br></div><div><br></div><div>Here is the output of heat stack </div><div><br></div><div>[root@ostack-eng-osa images]# heat resource-list mycluster31-bw5yi3lzkw45<br>WARNING (shell) "heat resource-list" is deprecated, please use "openstack stack resource list" instead<br>+-------------------------------+--------------------------------------+----------------------------------------------------------------------------------------------------------------+-----------------+----------------------+<br>| resource_name | physical_resource_id | resource_type | resource_status | updated_time |<br>+-------------------------------+--------------------------------------+----------------------------------------------------------------------------------------------------------------+-----------------+----------------------+<br>| api_address_floating_switch | | Magnum::FloatingIPAddressSwitcher | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| api_address_lb_switch | | Magnum::ApiGatewaySwitcher | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| api_lb | 99e0f887-fbe2-4b2f-b3a1-b1834c9a21c2 | file:///openstack/venvs/magnum-24.5.1/lib/python3.8/site-packages/magnum/drivers/common/templates/lb_api.yaml | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| etcd_address_lb_switch | | Magnum::ApiGatewaySwitcher | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| etcd_lb | d4ba15f3-8862-4f2b-a2cf-53eafd36d286 | file:///openstack/venvs/magnum-24.5.1/lib/python3.8/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| kube_cluster_config | | OS::Heat::SoftwareConfig | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| kube_cluster_deploy | | OS::Heat::SoftwareDeployment | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| kube_masters | 9ac8fc3e-a7d8-4eca-90c6-f66a8e0c43f0 | OS::Heat::ResourceGroup | CREATE_FAILED | 2023-08-01T20:55:49Z |<br>| kube_minions | | OS::Heat::ResourceGroup | INIT_COMPLETE | 2023-08-01T20:55:49Z |<br>| master_nodes_server_group | 19c9b300-f655-4db4-b03e-ea1479c541db | OS::Nova::ServerGroup | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| network | a908f229-fe8f-4ab8-b245-e8cf90c1b233 | file:///openstack/venvs/magnum-24.5.1/lib/python3.8/site-packages/magnum/drivers/common/templates/network.yaml | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| secgroup_kube_master | 79e6b233-1a18-48c4-8a4f-766819eb945f | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| secgroup_kube_minion | 2a908ffb-15bf-45c5-adad-6930b0313e94 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| secgroup_rule_tcp_kube_minion | 95779e79-a8bc-4ed4-b035-fc21758bd241 | OS::Neutron::SecurityGroupRule | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| secgroup_rule_udp_kube_minion | 2a630b3e-51ca-4504-9013-353cbe7c581b | OS::Neutron::SecurityGroupRule | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>| worker_nodes_server_group | d14b0630-95fa-46dc-81e3-2f90e62c7943 | OS::Nova::ServerGroup | CREATE_COMPLETE | 2023-08-01T20:55:49Z |<br>+-------------------------------+--------------------------------------+----------------------------------------------------------------------------------------------------------------+-----------------+----------------------+<br></div><div><br></div><div><br></div><div>I can ssh into an instance but am not sure what logs I should be chasing to find the proper issue. Any kind of help appreciated </div><div><br></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>
</div></blockquote></div></div></div></blockquote></div>