<html><body><div><div>Hi Jay,<br></div></div><div><br></div><div>K8s 1.24 needs containerd so you need to add an additional label. You also need to cange the hyperkube prefix.<br></div><div><br></div><div>labels:<br></div><div> container_runtime: containerd<br></div><div> hyperkube_prefix: <a rel="noopener noreferrer" href="http://docker.io/rancher/">docker.io/rancher/</a><br></div><div> kube_tag: v1.24.16-rancher1<br></div><div><br></div><div>The following template works just fine for me under Antelope 2023.1 deployed with Kolla-Ansible:<br></div><div><br></div><div>openstack coe cluster template create k8s-flan-small-37-v1.24.16-containerd --image Fedora-CoreOS-37 --keypair mykey --external-network public --fixed-network demo-net --fixed-subnet demo-subnet --dns-nameserver <ip_of_your_dns> --flavor m1.kubernetes.small --master-flavor m1.kubernetes.small --volume-driver cinder --docker-volume-size 10 --network-driver flannel --docker-storage-driver overlay2 --coe kubernetes --labels kube_tag=v1.24.16-rancher1,hyperkube_prefix=<a rel="noopener noreferrer" href="http://docker.io/rancher/,container_runtime=containerd">docker.io/rancher/,container_runtime=containerd</a><br></div><div><br></div><div>(2023.1) [vagrant@seed ~]$ openstack coe cluster template show k8s-flan-small-37-v1.24.16-containerd -f yaml<br></div><div>insecure_registry: '-'<br></div><div>labels:<br></div><div> container_runtime: containerd<br></div><div> hyperkube_prefix: <a rel="noopener noreferrer" href="http://docker.io/rancher/">docker.io/rancher/</a><br></div><div> kube_tag: v1.24.16-rancher1<br></div><div>updated_at: '2023-08-14T07:25:09+00:00'<br></div><div>floating_ip_enabled: true<br></div><div>fixed_subnet: demo-subnet<br></div><div>master_flavor_id: m1.kubernetes.small<br></div><div>uuid: bce946ef-6cf7-4153-b858-72b943c499a2<br></div><div>no_proxy: '-'<br></div><div>https_proxy: '-'<br></div><div>tls_disabled: false<br></div><div>keypair_id: mykey<br></div><div>public: false<br></div><div>http_proxy: '-'<br></div><div>docker_volume_size: 10<br></div><div>server_type: vm<br></div><div>external_network_id: 60335752-0c01-40b0-b152-365b23576309<br></div><div>cluster_distro: fedora-coreos<br></div><div>image_id: Fedora-CoreOS-37<br></div><div>volume_driver: cinder<br></div><div>registry_enabled: false<br></div><div>docker_storage_driver: overlay2<br></div><div>apiserver_port: '-'<br></div><div>name: k8s-flan-small-37-v1.24.16-containerd<br></div><div>created_at: '2023-08-10T15:16:00+00:00'<br></div><div>network_driver: flannel<br></div><div>fixed_network: demo-net<br></div><div>coe: kubernetes<br></div><div>flavor_id: m1.kubernetes.small<br></div><div>master_lb_enabled: false<br></div><div>dns_nameserver:<br></div><div>hidden: false<br></div><div>tags: '-'<br></div><div><br></div><div>(2023.1) [vagrant@seed ~]$ kubectl get nodes -o wide<br></div><div>NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME<br></div><div>containerd-j5ob3gd2dvqo-master-0 Ready master 78m v1.24.16 10.0.0.125 192.168.4.134 Fedora CoreOS 37.20221127.3.0 6.0.9-300.fc37.x86_64 <a>containerd://1.4.4</a><br></div><div>containerd-j5ob3gd2dvqo-node-0 Ready <none> 71m v1.24.16 10.0.0.71 192.168.4.132 Fedora CoreOS 37.20221127.3.0 6.0.9-300.fc37.x86_64 <a>containerd://1.4.4</a><br></div><div><br></div><div>(2023.1) [vagrant@seed ~]$ kubectl get pods -A<br></div><div>NAMESPACE NAME READY STATUS RESTARTS AGE<br></div><div>kube-system coredns-7f4bcd98d7-9vjzk 1/1 Running 0 77m<br></div><div>kube-system coredns-7f4bcd98d7-wnc7h 1/1 Running 0 77m<br></div><div>kube-system csi-cinder-controllerplugin-dc7889b4f-vk4jd 6/6 Running 0 77m<br></div><div>kube-system csi-cinder-nodeplugin-l8dqq 3/3 Running 0 71m<br></div><div>kube-system csi-cinder-nodeplugin-zdjg6 3/3 Running 0 77m<br></div><div>kube-system dashboard-metrics-scraper-7866c78b8-d66mg 1/1 Running 0 77m<br></div><div>kube-system k8s-keystone-auth-c9xjs 1/1 Running 0 77m<br></div><div>kube-system kube-dns-autoscaler-8f9cf4c99-kq6j5 1/1 Running 0 77m<br></div><div>kube-system kube-flannel-ds-qbw9l 1/1 Running 0 71m<br></div><div>kube-system kube-flannel-ds-xrbmp 1/1 Running 0 77m<br></div><div>kube-system kubernetes-dashboard-d78dc6f78-2qklq 1/1 Running 0 77m<br></div><div>kube-system magnum-metrics-server-564c9cdd6d-2rxpc 1/1 Running 0 77m<br></div><div>kube-system npd-8xkbk 1/1 Running 0 70m<br></div><div>kube-system openstack-cloud-controller-manager-46qsl 1/1 Running 0 78m<br></div><div><br></div><div>I have a blog where I blog about OpenStack related stuff. One of my older blog posts is also about deploying K8s via Magnum:<br></div><div><br></div><div><a rel="noopener noreferrer" href="https://www.roksblog.de/deploy-kubernetes-clusters-in-openstack-within-minutes-with-magnum/">https://www.roksblog.de/deploy-kubernetes-clusters-in-openstack-within-minutes-with-magnum/</a><br></div><div><br></div><div>Cheers,<br></div><div>Oliver<br></div><div><br></div></body></html>