[openstack-helm][neutron] neutron-dhcp-agent stuck in Init state
Hi All, I am trying to deploy openstack services using helm charts in my k8s cluster. My cluster is having 4 nodes - 1 k8s master, 1 controller and 2 compute nodes. I am using helm v3.0.3 for openstack stein. I have already deployed the below charts in my cluster successfully in the respective order - ingress, mariadb, rabbitmq, memcached, keystone, glance and then neutron. For mariadb, rabbitmq and glance, I am using PV and PVC in my local storage while deploying. All are ok until I deploy neutron. After deployment, all neutron pods works well except *neutron-dhcp-agent-default pod *which remains in Init:0/2 state. The pod description shows it has dependencies shown as - DEPENDENCY_SERVICE: openstack:rabbitmq,openstack:neutron-server,openstack:nova-api DEPENDENCY_JOBS: neutron-rabbit-init pods state- NAME READY STATUS RESTARTS AGE glance-api-b575ff7c-qp7wt 1/1 Running 0 132m glance-bootstrap-zjtw9 0/1 Completed 0 132m glance-db-init-86xgk 0/1 Completed 0 132m glance-db-sync-z9p9l 0/1 Completed 0 132m glance-ks-endpoints-wwm59 0/3 Completed 0 132m glance-ks-service-vs92t 0/1 Completed 0 132m glance-ks-user-znn88 0/1 Completed 0 132m glance-metadefs-load-g685b 0/1 Completed 0 132m glance-rabbit-init-648w8 0/1 Completed 0 132m glance-storage-init-jdlx2 0/1 Completed 0 132m ingress-8f98f7d96-llkwl 1/1 Running 0 3h42m ingress-error-pages-84647d8fcb-6j6bz 1/1 Running 0 3h42m keystone-api-5785f4787-lz296 1/1 Running 0 154m keystone-bootstrap-6tcdx 0/1 Completed 0 154m keystone-credential-setup-d9js5 0/1 Completed 0 154m keystone-db-init-zsgbj 0/1 Completed 0 154m keystone-db-sync-z8hfk 0/1 Completed 0 154m keystone-domain-manage-nk48h 0/1 Completed 0 154m keystone-fernet-setup-4pzlj 0/1 Completed 0 154m keystone-rabbit-init-mlpsn 0/1 Completed 0 154m mariadb-ingress-669c67b6b5-w8jxb 1/1 Running 0 3h32m mariadb-ingress-error-pages-d77467d69-9njgt 1/1 Running 0 3h32m mariadb-server-0 1/1 Running 0 3h32m memcached-memcached-7b49f48865-tf6xc 1/1 Running 0 3h11m neutron-db-init-zpl87 0/1 Completed 0 109m neutron-db-sync-plsnc 0/1 Completed 0 109m neutron-dhcp-agent-default-sf76z 0/1 Init:0/2 0 109m neutron-ks-endpoints-jgmdv 0/3 Completed 0 109m neutron-ks-service-nr5w2 0/1 Completed 0 109m neutron-ks-user-lw4p4 0/1 Completed 0 109m neutron-l3-agent-default-lnzk8 1/1 Running 0 109m neutron-lb-agent-default-44v9x 1/1 Running 0 109m neutron-lb-agent-default-94xw4 1/1 Running 0 109m neutron-lb-agent-default-whms2 1/1 Running 0 109m neutron-metadata-agent-default-7rbrh 1/1 Running 0 109m neutron-rabbit-init-qkhqm 0/1 Completed 0 109m neutron-server-964fcffcb-gvv4k 1/1 Running 0 109m rabbitmq-cluster-wait-vjbzq 0/1 Completed 0 3h18m rabbitmq-rabbitmq-0 1/1 Running 0 3h18m Please guide me how to resolve this neutron-dhcp-agent pod so that I can deploy other services after that. I have plan to deploy libvirt, nova, cinder, horizon and ceilometer charts into my cluster. thank you for your help and support. best regards, Sanjay
Hello Sanjay, Do you have logs and detailed info for the neutron-dhcp-agent-default pod and possibly containers inside it which are stuck in Init phase? neutron-server and rabbitmq seem to be running fine. Here are some docs and code you could get hints from: - https://docs.openstack.org/openstack-helm/latest/devref/networking.html#neut... <https://docs.openstack.org/openstack-helm/latest/devref/networking.html#neutron-dhcp-agent> - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/da... <https://github.com/openstack/openstack-helm/blob/master/neutron/templates/daemonset-dhcp-agent.yaml> - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bi... <https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bin/_neutron-dhcp-agent-init.sh.tpl> - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bi... <https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bin/_neutron-dhcp-agent.sh.tpl> Best regards, — Roman Gorshunov
You’ll need to deploy the nova chart, as the neutron dhcp agent has a dependency on the nova compute service. For reference, see: https://github.com/openstack/openstack-helm/blob/master/neutron/values.yaml#... In the future, you can get the logs from the init container to provide more insight into what’s preventing the containers from starting. Cheers, srwilkers On Fri, Feb 21, 2020 at 8:46 AM Roman Gorshunov <paye600@gmail.com> wrote:
Hello Sanjay,
Do you have logs and detailed info for the neutron-dhcp-agent-default pod and possibly containers inside it which are stuck in Init phase? neutron-server and rabbitmq seem to be running fine.
Here are some docs and code you could get hints from: - https://docs.openstack.org/openstack-helm/latest/devref/networking.html#neut... - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/da... - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bi... - https://github.com/openstack/openstack-helm/blob/master/neutron/templates/bi...
Best regards, — Roman Gorshunov
participants (3)
-
Roman Gorshunov
-
Sanjay K
-
Steve Wilkerson