Hi Jake,

Many thanks for the list. Using my local registry I can at least deploy a K8s cluster, but there is still an issue I think with the default version of the csi_snapshotter container in stable/yoga and stable/zed. I had a look at the magnum source code and v4.2.1 is only defined in master:

type: string
description: tag of csi snapshotter
default: v4.2.1
csi_snapshotter_tag:

That would explain why it used to be working in my staging openstack kolla-ansible cluster. Because I deployed latest and not a specific release. At least in my case I'm not able to deploy a fully functional K8s cluster without specifying the csi_snapshotter tag version of v4.2.1 and using a local registry. By just specifying the csi snapshotter tag it will try to download the container image from the wrong source. Can someone from the magnum team please check and clarify?

Cheers,

Oliver

Am 14.02.2023 um 13:57 schrieb Jake Yip:
On 11/2/2023 5:57 am, Oliver Weinmann wrote:

BTW for the local registry, It seems that the list of images needed described here:

https://docs.openstack.org/magnum/yoga/user/

is incomplete and outdated. I had to pull a couple more. No complaint, just mentioning it. :)


Yeah that may be incomplete. Maybe you can reference the following which works for us.

Labels

[
              "kube_tag=v1.23.8",
              "flannel_tag=v0.18.1",
              "master_lb_floating_ip_enabled=true",
              "cinder_csi_enabled=true",
              "docker_volume_type=standard",
              "ingress_controller=octavia",
              "container_runtime=containerd",
              "containerd_version=1.6.6",

"containerd_tarball_sha256=a64568c8ce792dd73859ce5f336d5485fcbceab15dc3e06d5d1bc1c3353fa20f",
              "cloud_provider_tag=v1.23.4",
              "cinder_csi_plugin_tag=v1.23.4",
              "k8s_keystone_auth_tag=v1.23.4",
              "magnum_auto_healer_tag=v1.23.4",
              "octavia_ingress_controller_tag=v1.23.4",
              "autoscaler_tag=v1.23.0",
              "coredns_tag=1.9.3",
              "csi_snapshotter_tag=v4.2.1",
              "csi_attacher_tag=v3.3.0",
              "csi_resizer_tag=v1.3.0",
              "csi_provisioner_tag=v3.0.0",
              "csi_node_driver_registrar_tag=v2.4.0",
             ]


Containers

k8scloudprovider/openstack-cloud-controller-manager:v1.23.4
k8scloudprovider/k8s-keystone-auth:v1.23.4
k8scloudprovider/cinder-csi-plugin:v1.23.4
k8scloudprovider/magnum-auto-healer:v1.23.4
k8scloudprovider/octavia-ingress-controller:v1.23.4
k8s.gcr.io/sig-storage/csi-attacher:v3.3.0
k8s.gcr.io/sig-storage/csi-provisioner:v3.0.0
k8s.gcr.io/sig-storage/csi-resizer:v1.3.0
k8s.gcr.io/sig-storage/csi-snapshotter:v4.2.1
k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.4.0
k8s.gcr.io/sig-storage/livenessprobe:v2.5.0
openstackmagnum/cluster-autoscaler:v1.22.0


Regards,
Jake