[kolla-ansible][Yoga][Magnum] How to delete a cluster containing errors
Hi, I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out) Is there a way to force the deletion to proceed even with those errors? Regards.
Do u use multi master. If yes,u need delete octavia. On Mon, Nov 28, 2022, 10:16 PM wodel youchi <wodel.youchi@gmail.com> wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
Hi, I do have both, simple and multi-master, and I can't get rid of them. What do you mean by delete octavia? delete the LB VMs manually? Regards. Le lun. 28 nov. 2022 à 16:18, Nguyễn Hữu Khôi <nguyenhuukhoinw@gmail.com> a écrit :
Do u use multi master. If yes,u need delete octavia.
On Mon, Nov 28, 2022, 10:16 PM wodel youchi <wodel.youchi@gmail.com> wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
Hi, Can you see what resource it is failing at with `openstack stack resource list -n5 <stack_id>`? You can also abandon the stack with `openstack stack abandon`. That will leave stray resources lying around though. Regards, Jake On 29/11/2022 2:09 am, wodel youchi wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
Hi, Here are two examples of stack which fail to be deleted Stack 1: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 c1801318-c0b8-4438-9c85-41cf5c7812f1 +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name | +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+ *| kube_minions | ffc19ead-94f0-4ff3-b496-b454a156f1f7 | OS::Heat::ResourceGroup | DELETE_FAILED | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | * | api_address_lb_switch | d0b7f19c-7b66-4c07-a60a-cb6e62c48876 | Magnum::ApiGatewaySwitcher | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_address_lb_switch | 8c2a7952-e2aa-42d5-9da9-3a9881e69211 | Magnum::ApiGatewaySwitcher | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | worker_nodes_server_group | cf3601c0-3876-4d91-8fa0-0f87e6b43eca | OS::Nova::ServerGroup | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | kube_masters | ebbccf6a-40bf-4cbc-badd-fbafbb255337 | OS::Heat::ResourceGroup | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_lb | 65fd17e5-5e54-406d-bbba-7d56a8d4eb93 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | master_nodes_server_group | b0c9c49a-9160-4b33-af90-c2c16392b22e | OS::Nova::ServerGroup | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | api_lb | b48e0ade-52ec-409f-9212-ce231318d4df | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | network | 29549cda-d294-4031-90c0-a8e50cdf31dc | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_minion | 1123a7cd-080c-49a9-a7e8-81e162f07fa0 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_master | 5e2286d4-eadc-46ee-91db-ac79485d92b2 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | *| 1 | 713fd534-f3ac-4fc4-a3e9-9a8a67bfe549 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | | 0 | 009bf512-7d67-4db0-9e63-264a320d23ab | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | * | docker_volume_attach | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube-minion | eca4b475-12f7-4a67-8192-ac9d99db1a65 | OS::Nova::Server | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube_minion_eth0 | 17c7474d-8a63-43f7-a9cd-30ae22b4b153 | OS::Neutron::Port | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | agent_config | 09d6d11f-0623-49ab-a12e-653241d54d0b | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume_attach | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube-minion | 37e7921a-03c8-40a2-ad80-2b006fb79c22 | OS::Nova::Server | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | agent_config | 05fcc72e-0561-497d-98e2-6b92c109db0f | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube_minion_eth0 | beb8bf56-e5e1-4c7a-94ce-fe650e5902c6 | OS::Neutron::Port | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | docker_volume | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | 0 | ff2d9839-9584-4f25-b4dd-869456635201 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | 1 | e57c70ea-c165-4f0a-b680-a4344b97779d | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | etcd_pool_member | cc587c78-a756-4720-9683-8f2564a5031d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume_attach | ce25bf02-e20f-458e-b8e5-f3e3eb94064b | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_pool_member | 8b406579-f31c-4eed-8d88-4fa829db62af | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes | c66e6546-1cb5-4d13-a617-c2e3fd502f97 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume_attach | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config_deployment | 40f798e8-e505-431e-af92-fe04d3a60c17 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config | 706cead9-113a-40f5-b76c-6c24ad825720 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume | b36dcb9c-6960-42c9-86d9-c56f41e45f50 | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_address_switch | 9d76cd95-9c17-418b-9eeb-6ab5b6824995 | Magnum::ApiGatewaySwitcher | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_floating | db987622-fa06-4ee4-ab4a-70c710552afb | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube-master | 2baede5b-335b-4509-a165-45e742316fe4 | OS::Nova::Server | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_eth0 | 84ce8ff0-e0de-4b6c-885d-28dc7f2becc1 | OS::Neutron::Port | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | agent_config | 0456f77d-f9c5-4db2-82bd-db72dd49c023 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_pool_member | c5f9cc21-c951-43c4-b35c-53dc1b579697 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume_attach | 92d65782-a3ef-4938-9d9b-7ca8f965dc76 | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_pool_member | c86a539d-863c-4f73-a8fb-976593f78110 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes | 0ee8cb5b-deb1-48c2-9323-1558c31c7dfc | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume_attach | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config_deployment | 0c17ecc1-b676-4af5-a86c-1f86971080cf | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config | 1eb9d15d-ed09-417a-8fac-1c4e1424ed6a | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume | 5fe87023-8ff4-4381-b543-4f15edadc61b | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_address_switch | 5bbab773-1c9e-4104-ad2f-39f52401ab05 | Magnum::ApiGatewaySwitcher | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_floating | 6fd94160-d49a-41b7-b936-8f682466c614 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube-master | 41c198bb-114a-4baa-9a56-322f8f345fcd | OS::Nova::Server | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_eth0 | 7be6a71a-4448-4f8f-97fb-56e739a457db | OS::Neutron::Port | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | agent_config | ad2d8d64-3919-4b61-9a51-71cc81345220 | OS::Heat::SoftwareConfig | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | monitor | 73a7e0b6-4d3d-497c-9ab1-cd9fcaee398a | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | pool | 061c047c-8990-45b1-8ef3-86f1f8207fa0 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | listener | 112c04c4-a0a7-4770-84fb-df3ef630bb51 | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | loadbalancer | 6ce77c54-d7a5-41ac-af14-ee9993c255d6 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | floating | 06ab733d-45d4-42e8-9aa2-e9ecc00e3d44 | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | monitor | 51cdc4dd-d0f0-4361-9c86-1f519951c957 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | pool | 67f7372d-8d60-4693-8809-56075a6ad326 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | listener | 7193aa59-43f9-45a8-aa7e-c5a5f86beced | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | loadbalancer | 04bc48ad-0884-4eae-b6ee-48b4a1b9cab3 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | extrouter_inside | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd:subnet_id=a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::RouterInte rface | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | extrouter | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd | Magnum::Optional::Neutron::Router | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | network_switch | bc89bc1b-cf84-4760-83e9-e73c1cb1d786 | Magnum::NetworkSwitcher | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_subnet | a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::Subnet | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_network | 8cea85b5-9fb0-4578-9295-8d362526da2e | Magnum::Optional::Neutron::Net | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+ Stack2: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 85b6ce8b-5c4c-4cab-b69f-aed69a96018f +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name | +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+ *| kube_minions | 225fb4e7-8ae0-42a8-95a5-9dbe63f54650 | OS::Heat::ResourceGroup | DELETE_FAILED | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | * | etcd_address_lb_switch | 762b3454-629f-4f21-b8fb-9ae896a3a010 | Magnum::ApiGatewaySwitcher | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_address_lb_switch | 8a8935d4-8762-4fbc-bf25-4866ce0a53a7 | Magnum::ApiGatewaySwitcher | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | kube_masters | d724aa3d-780b-414e-a080-3a501becdaae | OS::Heat::ResourceGroup | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | etcd_lb | 2281b6f9-46e0-411b-833e-853a4994ad96 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_lb | 586477b3-8a25-4740-865c-5d682f3fb4f3 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | network | b747ad8b-b592-4a8f-afcd-b76017a1f68c | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | master_nodes_server_group | d0e3eea2-7776-4e57-9651-2799751a3dbc | OS::Nova::ServerGroup | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_minion | 320ace66-73af-4518-8852-abcac7233e0c | OS::Neutron::SecurityGroup | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_master | 3c0778ef-2fb0-4de6-97a2-603e4e753c58 | OS::Neutron::SecurityGroup | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | worker_nodes_server_group | 75d9263d-3187-4256-9506-732cee98799a | OS::Nova::ServerGroup | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | *| 1 | 6d31d728-61f7-4383-95e5-24800de91162 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-11T10:40:16Z | testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn * | | docker_volume_attach | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | docker_volume | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::Volume | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube-minion | 1a605e7b-aafc-4113-90a7-98d8d8fe5f96 | OS::Nova::Server | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube_minion_eth0 | 05bf8eb4-f2ca-4234-8497-c5b13c977a32 | OS::Neutron::Port | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | agent_config | ad560f63-94b2-4287-8a4c-6ac66042cc35 | OS::Heat::SoftwareConfig | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | 1 | 3f4cff1f-28f4-4276-b676-e707a42465b8 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | 0 | 412844d4-a864-47c2-b9cf-6eecee186338 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | api_pool_member | dd1c1021-67fd-4fe9-b2a0-e481f906c79d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_pool_member | b11fae15-1869-4d49-b939-c63d683d1a9f | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes | 5ef86e19-94c5-48fe-88ab-5962ef03f63a | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume_attach | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume_attach | 4be01f1a-b386-421e-963a-f75425bff4b3 | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config_deployment | d4b740e2-1cfc-4569-a1d5-eabbf1285229 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config | 574d9330-5ac0-4f7b-8bea-8b46b4966e14 | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume | a47316ff-16ba-4fc9-b2d0-840d691400aa | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_address_switch | dbeb0fff-b974-4fe7-9451-d0c2eabffc03 | Magnum::ApiGatewaySwitcher | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_floating | 99047ae9-39dd-4196-a507-fbc82dc4375a | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube-master | 4fde1552-ce13-4546-9d8f-1e9ea25352a5 | OS::Nova::Server | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_eth0 | d442fcef-43e6-4fe2-9390-991bf827c221 | OS::Neutron::Port | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | agent_config | 802300e7-8f19-4694-b2fc-2cb5ad55eb25 | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_pool_member | 98264ea6-ea88-4132-8cca-7f0a049d8cee | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_pool_member | 458d8d42-6994-4dc6-8517-d3486ad42d67 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume_attach | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes | 725193f9-c222-4ad9-8097-df88656e5d9f | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config_deployment | 3994e5a7-c7df-48e7-a562-70d690310d06 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config | 94978b0e-4d00-4ced-9212-eb19da22875e | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | api_address_switch | 17692180-d5cc-4f1b-80a5-7a64c61d512a | Magnum::ApiGatewaySwitcher | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_floating | 6ffa46aa-4cc9-43a8-9dbe-4246d4d167d0 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume_attach | 50d479d5-ea54-40b1-927a-6287fbef277d | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume | 6e32c307-8645-4a93-bd68-f6a5172a54b8 | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube-master | 6515ad5d-cc35-46d9-b554-31836e41d59e | OS::Nova::Server | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_eth0 | 3c9390d2-5d07-4a02-9110-6551e743ee32 | OS::Neutron::Port | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | agent_config | 25cdf836-a317-45ff-aa18-262b933c3e4b | OS::Heat::SoftwareConfig | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | monitor | eed43fb4-b6fa-41c8-b612-e15aae185488 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | pool | cdf18e7c-b823-4c45-9f79-400c0f5f15bd | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | listener | 4437d207-03fb-4c75-8a6c-eb6a4946f6cd | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | loadbalancer | 075c3e23-79be-4a95-8875-7235db051d24 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | floating | 3ffc5f32-a1fe-4948-857b-d304a56ee48c | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | monitor | 6fde29bd-a607-464c-a54b-7c38132efb2d | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | pool | 62f92f0e-51dd-4a34-b9b8-f267b745ebd1 | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | listener | 7d805d71-e811-422d-b81a-8941ece42bff | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | loadbalancer | c7599c6f-b9c0-4ed5-9b20-ed4cd3ee1326 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | network_switch | 0dda301f-9d35-432b-a010-618b8ca62f3b | Magnum::NetworkSwitcher | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter_inside | e2f8b157-60b5-40ab-aa0a-9e7888900cd9:subnet_id=3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::RouterInte rface | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_subnet | 3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::Subnet | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_network | eaedb3a2-1619-42af-9fd7-81e02e6537df | Magnum::Optional::Neutron::Net | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter | e2f8b157-60b5-40ab-aa0a-9e7888900cd9 | Magnum::Optional::Neutron::Router | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | +-------------------------------+-------------------------------------------------------------------------------------+-------------------------------------- --------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+ We had a problem on the platform, and some VMs have gone to error state, in reality they have disappeared, we tried to delete the stack and resources that no longer exists are making these errors. We are searching for a way to delete the stack even if the corresponding resource does not exist anymore. Regards. Le mar. 29 nov. 2022 à 10:36, Jake Yip <jake.yip@ardc.edu.au> a écrit :
Hi,
Can you see what resource it is failing at with `openstack stack resource list -n5 <stack_id>`?
You can also abandon the stack with `openstack stack abandon`. That will leave stray resources lying around though.
Regards, Jake
On 29/11/2022 2:09 am, wodel youchi wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
Hi, Here are some other details : (yogavenv) [deployer@rcdndeployer2 ~]$* openstack stack failures list 85b6ce8b-5c4c-4cab-b69f-aed69a96018f* testmulti-r37u5recibdq.kube_minions.1.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: 63cd097c-9877-40c0-968f-52b58bdaedf9 status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [63cd097c-9877-40c0-968f-52b58bdaedf9] Stack "testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn-1-pkoi6mf32khj" [6d31d728-61f7-4383-95e5-24800de91162] Timed out) (yogavenv) [deployer@rcdndeployer2 ~]$* openstack stack failures list c1801318-c0b8-4438-9c85-41cf5c7812f1* mymultik8-ub6qbaarl74z.kube_minions.1.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: 07e2e175-bf0b-498c-8f0d-531f49ec183c status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [07e2e175-bf0b-498c-8f0d-531f49ec183c] Stack "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-1-oq7v4edmmj4e" [713fd534-f3ac-4fc4-a3e9-9a8a67bfe549] Timed out) mymultik8-ub6qbaarl74z.kube_minions.0.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: c9efd934-679c-4e7d-8258-e7c1c65b2b95 status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [c9efd934-679c-4e7d-8258-e7c1c65b2b95] Stack "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-0-3zue4xpnyzep" [009bf512-7d67-4db0-9e63-264a320d23ab] Timed out) PS : (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack abandon 85b6ce8b-5c4c-4cab-b69f-aed69a96018f *ERROR: Stack Abandon is not supported.* Regards. Le mar. 29 nov. 2022 à 11:04, wodel youchi <wodel.youchi@gmail.com> a écrit :
Hi,
Here are two examples of stack which fail to be deleted Stack 1: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 c1801318-c0b8-4438-9c85-41cf5c7812f1
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+
*| kube_minions | ffc19ead-94f0-4ff3-b496-b454a156f1f7 | OS::Heat::ResourceGroup
| DELETE_FAILED | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | * | api_address_lb_switch | d0b7f19c-7b66-4c07-a60a-cb6e62c48876 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_address_lb_switch | 8c2a7952-e2aa-42d5-9da9-3a9881e69211 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | worker_nodes_server_group | cf3601c0-3876-4d91-8fa0-0f87e6b43eca | OS::Nova::ServerGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | kube_masters | ebbccf6a-40bf-4cbc-badd-fbafbb255337 | OS::Heat::ResourceGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_lb | 65fd17e5-5e54-406d-bbba-7d56a8d4eb93 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | master_nodes_server_group | b0c9c49a-9160-4b33-af90-c2c16392b22e | OS::Nova::ServerGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | api_lb | b48e0ade-52ec-409f-9212-ce231318d4df | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | network | 29549cda-d294-4031-90c0-a8e50cdf31dc | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_minion | 1123a7cd-080c-49a9-a7e8-81e162f07fa0 | OS::Neutron::SecurityGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_master | 5e2286d4-eadc-46ee-91db-ac79485d92b2 | OS::Neutron::SecurityGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z |
*| 1 | 713fd534-f3ac-4fc4-a3e9-9a8a67bfe549 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | | 0 | 009bf512-7d67-4db0-9e63-264a320d23ab | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | * | docker_volume_attach | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube-minion | eca4b475-12f7-4a67-8192-ac9d99db1a65 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube_minion_eth0 | 17c7474d-8a63-43f7-a9cd-30ae22b4b153 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | agent_config | 09d6d11f-0623-49ab-a12e-653241d54d0b | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume_attach | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube-minion | 37e7921a-03c8-40a2-ad80-2b006fb79c22 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | agent_config | 05fcc72e-0561-497d-98e2-6b92c109db0f | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube_minion_eth0 | beb8bf56-e5e1-4c7a-94ce-fe650e5902c6 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | docker_volume | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | 0 | ff2d9839-9584-4f25-b4dd-869456635201 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | 1 | e57c70ea-c165-4f0a-b680-a4344b97779d | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | etcd_pool_member | cc587c78-a756-4720-9683-8f2564a5031d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume_attach | ce25bf02-e20f-458e-b8e5-f3e3eb94064b | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_pool_member | 8b406579-f31c-4eed-8d88-4fa829db62af | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes | c66e6546-1cb5-4d13-a617-c2e3fd502f97 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume_attach | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config_deployment | 40f798e8-e505-431e-af92-fe04d3a60c17 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config | 706cead9-113a-40f5-b76c-6c24ad825720 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume | b36dcb9c-6960-42c9-86d9-c56f41e45f50 | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_address_switch | 9d76cd95-9c17-418b-9eeb-6ab5b6824995 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_floating | db987622-fa06-4ee4-ab4a-70c710552afb | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube-master | 2baede5b-335b-4509-a165-45e742316fe4 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_eth0 | 84ce8ff0-e0de-4b6c-885d-28dc7f2becc1 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | agent_config | 0456f77d-f9c5-4db2-82bd-db72dd49c023 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_pool_member | c5f9cc21-c951-43c4-b35c-53dc1b579697 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume_attach | 92d65782-a3ef-4938-9d9b-7ca8f965dc76 | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_pool_member | c86a539d-863c-4f73-a8fb-976593f78110 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes | 0ee8cb5b-deb1-48c2-9323-1558c31c7dfc | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume_attach | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config_deployment | 0c17ecc1-b676-4af5-a86c-1f86971080cf | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config | 1eb9d15d-ed09-417a-8fac-1c4e1424ed6a | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume | 5fe87023-8ff4-4381-b543-4f15edadc61b | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_address_switch | 5bbab773-1c9e-4104-ad2f-39f52401ab05 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_floating | 6fd94160-d49a-41b7-b936-8f682466c614 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube-master | 41c198bb-114a-4baa-9a56-322f8f345fcd | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_eth0 | 7be6a71a-4448-4f8f-97fb-56e739a457db | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | agent_config | ad2d8d64-3919-4b61-9a51-71cc81345220 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | monitor | 73a7e0b6-4d3d-497c-9ab1-cd9fcaee398a | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | pool | 061c047c-8990-45b1-8ef3-86f1f8207fa0 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | listener | 112c04c4-a0a7-4770-84fb-df3ef630bb51 | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | loadbalancer | 6ce77c54-d7a5-41ac-af14-ee9993c255d6 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | floating | 06ab733d-45d4-42e8-9aa2-e9ecc00e3d44 | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | monitor | 51cdc4dd-d0f0-4361-9c86-1f519951c957 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | pool | 67f7372d-8d60-4693-8809-56075a6ad326 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | listener | 7193aa59-43f9-45a8-aa7e-c5a5f86beced | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | loadbalancer | 04bc48ad-0884-4eae-b6ee-48b4a1b9cab3 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | extrouter_inside | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd:subnet_id=a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::RouterInte rface | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | extrouter | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd | Magnum::Optional::Neutron::Router | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | network_switch | bc89bc1b-cf84-4760-83e9-e73c1cb1d786 | Magnum::NetworkSwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_subnet | a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::Subnet | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_network | 8cea85b5-9fb0-4578-9295-8d362526da2e | Magnum::Optional::Neutron::Net | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+
Stack2: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 85b6ce8b-5c4c-4cab-b69f-aed69a96018f
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+
*| kube_minions | 225fb4e7-8ae0-42a8-95a5-9dbe63f54650 | OS::Heat::ResourceGroup
| DELETE_FAILED | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | * | etcd_address_lb_switch | 762b3454-629f-4f21-b8fb-9ae896a3a010 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_address_lb_switch | 8a8935d4-8762-4fbc-bf25-4866ce0a53a7 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | kube_masters | d724aa3d-780b-414e-a080-3a501becdaae | OS::Heat::ResourceGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | etcd_lb | 2281b6f9-46e0-411b-833e-853a4994ad96 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_lb | 586477b3-8a25-4740-865c-5d682f3fb4f3 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | network | b747ad8b-b592-4a8f-afcd-b76017a1f68c | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | master_nodes_server_group | d0e3eea2-7776-4e57-9651-2799751a3dbc | OS::Nova::ServerGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_minion | 320ace66-73af-4518-8852-abcac7233e0c | OS::Neutron::SecurityGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_master | 3c0778ef-2fb0-4de6-97a2-603e4e753c58 | OS::Neutron::SecurityGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | worker_nodes_server_group | 75d9263d-3187-4256-9506-732cee98799a | OS::Nova::ServerGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq |
*| 1 | 6d31d728-61f7-4383-95e5-24800de91162 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-11T10:40:16Z | testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn * | | docker_volume_attach | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | docker_volume | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::Volume | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube-minion | 1a605e7b-aafc-4113-90a7-98d8d8fe5f96 | OS::Nova::Server
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube_minion_eth0 | 05bf8eb4-f2ca-4234-8497-c5b13c977a32 | OS::Neutron::Port
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | agent_config | ad560f63-94b2-4287-8a4c-6ac66042cc35 | OS::Heat::SoftwareConfig
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | 1 | 3f4cff1f-28f4-4276-b676-e707a42465b8 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | 0 | 412844d4-a864-47c2-b9cf-6eecee186338 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | api_pool_member | dd1c1021-67fd-4fe9-b2a0-e481f906c79d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_pool_member | b11fae15-1869-4d49-b939-c63d683d1a9f | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes | 5ef86e19-94c5-48fe-88ab-5962ef03f63a | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume_attach | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume_attach | 4be01f1a-b386-421e-963a-f75425bff4b3 | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config_deployment | d4b740e2-1cfc-4569-a1d5-eabbf1285229 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config | 574d9330-5ac0-4f7b-8bea-8b46b4966e14 | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume | a47316ff-16ba-4fc9-b2d0-840d691400aa | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_address_switch | dbeb0fff-b974-4fe7-9451-d0c2eabffc03 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_floating | 99047ae9-39dd-4196-a507-fbc82dc4375a | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube-master | 4fde1552-ce13-4546-9d8f-1e9ea25352a5 | OS::Nova::Server
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_eth0 | d442fcef-43e6-4fe2-9390-991bf827c221 | OS::Neutron::Port
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | agent_config | 802300e7-8f19-4694-b2fc-2cb5ad55eb25 | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_pool_member | 98264ea6-ea88-4132-8cca-7f0a049d8cee | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_pool_member | 458d8d42-6994-4dc6-8517-d3486ad42d67 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume_attach | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes | 725193f9-c222-4ad9-8097-df88656e5d9f | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config_deployment | 3994e5a7-c7df-48e7-a562-70d690310d06 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config | 94978b0e-4d00-4ced-9212-eb19da22875e | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | api_address_switch | 17692180-d5cc-4f1b-80a5-7a64c61d512a | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_floating | 6ffa46aa-4cc9-43a8-9dbe-4246d4d167d0 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume_attach | 50d479d5-ea54-40b1-927a-6287fbef277d | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume | 6e32c307-8645-4a93-bd68-f6a5172a54b8 | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube-master | 6515ad5d-cc35-46d9-b554-31836e41d59e | OS::Nova::Server
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_eth0 | 3c9390d2-5d07-4a02-9110-6551e743ee32 | OS::Neutron::Port
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | agent_config | 25cdf836-a317-45ff-aa18-262b933c3e4b | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | monitor | eed43fb4-b6fa-41c8-b612-e15aae185488 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | pool | cdf18e7c-b823-4c45-9f79-400c0f5f15bd | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | listener | 4437d207-03fb-4c75-8a6c-eb6a4946f6cd | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | loadbalancer | 075c3e23-79be-4a95-8875-7235db051d24 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | floating | 3ffc5f32-a1fe-4948-857b-d304a56ee48c | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | monitor | 6fde29bd-a607-464c-a54b-7c38132efb2d | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | pool | 62f92f0e-51dd-4a34-b9b8-f267b745ebd1 | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | listener | 7d805d71-e811-422d-b81a-8941ece42bff | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | loadbalancer | c7599c6f-b9c0-4ed5-9b20-ed4cd3ee1326 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | network_switch | 0dda301f-9d35-432b-a010-618b8ca62f3b | Magnum::NetworkSwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter_inside | e2f8b157-60b5-40ab-aa0a-9e7888900cd9:subnet_id=3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::RouterInte rface | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_subnet | 3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::Subnet | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_network | eaedb3a2-1619-42af-9fd7-81e02e6537df | Magnum::Optional::Neutron::Net | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter | e2f8b157-60b5-40ab-aa0a-9e7888900cd9 | Magnum::Optional::Neutron::Router | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+
We had a problem on the platform, and some VMs have gone to error state, in reality they have disappeared, we tried to delete the stack and resources that no longer exists are making these errors. We are searching for a way to delete the stack even if the corresponding resource does not exist anymore.
Regards.
Le mar. 29 nov. 2022 à 10:36, Jake Yip <jake.yip@ardc.edu.au> a écrit :
Hi,
Can you see what resource it is failing at with `openstack stack resource list -n5 <stack_id>`?
You can also abandon the stack with `openstack stack abandon`. That will leave stray resources lying around though.
Regards, Jake
On 29/11/2022 2:09 am, wodel youchi wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
Hope It helps: https://platform9.com/kb/openstack/unable-to-delete-stacks-stuck-in-delete_f... If u still cannot remove k8s. pls go to delete k8s instances and volumes. In my case, it works. Nguyen Huu Khoi On Wed, Nov 30, 2022 at 8:00 PM wodel youchi <wodel.youchi@gmail.com> wrote:
Hi,
Here are some other details : (yogavenv) [deployer@rcdndeployer2 ~]$* openstack stack failures list 85b6ce8b-5c4c-4cab-b69f-aed69a96018f* testmulti-r37u5recibdq.kube_minions.1.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: 63cd097c-9877-40c0-968f-52b58bdaedf9 status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [63cd097c-9877-40c0-968f-52b58bdaedf9] Stack "testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn-1-pkoi6mf32khj" [6d31d728-61f7-4383-95e5-24800de91162] Timed out)
(yogavenv) [deployer@rcdndeployer2 ~]$* openstack stack failures list c1801318-c0b8-4438-9c85-41cf5c7812f1* mymultik8-ub6qbaarl74z.kube_minions.1.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: 07e2e175-bf0b-498c-8f0d-531f49ec183c status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [07e2e175-bf0b-498c-8f0d-531f49ec183c] Stack "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-1-oq7v4edmmj4e" [713fd534-f3ac-4fc4-a3e9-9a8a67bfe549] Timed out) mymultik8-ub6qbaarl74z.kube_minions.0.docker_volume_attach: resource_type: Magnum::Optional::Cinder::VolumeAttachment physical_resource_id: c9efd934-679c-4e7d-8258-e7c1c65b2b95 status: DELETE_FAILED status_reason: | DELETE aborted (Task delete from CinderVolumeAttachment "docker_volume_attach" [c9efd934-679c-4e7d-8258-e7c1c65b2b95] Stack "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-0-3zue4xpnyzep" [009bf512-7d67-4db0-9e63-264a320d23ab] Timed out)
PS : (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack abandon 85b6ce8b-5c4c-4cab-b69f-aed69a96018f
*ERROR: Stack Abandon is not supported.*
Regards.
Le mar. 29 nov. 2022 à 11:04, wodel youchi <wodel.youchi@gmail.com> a écrit :
Hi,
Here are two examples of stack which fail to be deleted Stack 1: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 c1801318-c0b8-4438-9c85-41cf5c7812f1
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+
*| kube_minions | ffc19ead-94f0-4ff3-b496-b454a156f1f7 | OS::Heat::ResourceGroup
| DELETE_FAILED | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | * | api_address_lb_switch | d0b7f19c-7b66-4c07-a60a-cb6e62c48876 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_address_lb_switch | 8c2a7952-e2aa-42d5-9da9-3a9881e69211 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | worker_nodes_server_group | cf3601c0-3876-4d91-8fa0-0f87e6b43eca | OS::Nova::ServerGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | kube_masters | ebbccf6a-40bf-4cbc-badd-fbafbb255337 | OS::Heat::ResourceGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | etcd_lb | 65fd17e5-5e54-406d-bbba-7d56a8d4eb93 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | master_nodes_server_group | b0c9c49a-9160-4b33-af90-c2c16392b22e | OS::Nova::ServerGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | api_lb | b48e0ade-52ec-409f-9212-ce231318d4df | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | network | 29549cda-d294-4031-90c0-a8e50cdf31dc | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_minion | 1123a7cd-080c-49a9-a7e8-81e162f07fa0 | OS::Neutron::SecurityGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z | | secgroup_kube_master | 5e2286d4-eadc-46ee-91db-ac79485d92b2 | OS::Neutron::SecurityGroup
| CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z |
*| 1 | 713fd534-f3ac-4fc4-a3e9-9a8a67bfe549 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | | 0 | 009bf512-7d67-4db0-9e63-264a320d23ab | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v | * | docker_volume_attach | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube-minion | eca4b475-12f7-4a67-8192-ac9d99db1a65 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | kube_minion_eth0 | 17c7474d-8a63-43f7-a9cd-30ae22b4b153 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume | 07e2e175-bf0b-498c-8f0d-531f49ec183c | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | agent_config | 09d6d11f-0623-49ab-a12e-653241d54d0b | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-1-oq7v4edmmj4e | | docker_volume_attach | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube-minion | 37e7921a-03c8-40a2-ad80-2b006fb79c22 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | agent_config | 05fcc72e-0561-497d-98e2-6b92c109db0f | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | kube_minion_eth0 | beb8bf56-e5e1-4c7a-94ce-fe650e5902c6 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | docker_volume | c9efd934-679c-4e7d-8258-e7c1c65b2b95 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion s-wlu4j5as6u4v-0-3zue4xpnyzep | | 0 | ff2d9839-9584-4f25-b4dd-869456635201 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | 1 | e57c70ea-c165-4f0a-b680-a4344b97779d | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CREATE_COMPLETE | 2022-05-08T12:00:11Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz | | etcd_pool_member | cc587c78-a756-4720-9683-8f2564a5031d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume_attach | ce25bf02-e20f-458e-b8e5-f3e3eb94064b | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_pool_member | 8b406579-f31c-4eed-8d88-4fa829db62af | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | upgrade_kubernetes | c66e6546-1cb5-4d13-a617-c2e3fd502f97 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume_attach | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config_deployment | 40f798e8-e505-431e-af92-fe04d3a60c17 | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | master_config | 706cead9-113a-40f5-b76c-6c24ad825720 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | docker_volume | 440b7e09-b45a-4abb-b814-2bf52a262d06 | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_volume | b36dcb9c-6960-42c9-86d9-c56f41e45f50 | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | api_address_switch | 9d76cd95-9c17-418b-9eeb-6ab5b6824995 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_floating | db987622-fa06-4ee4-ab4a-70c710552afb | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube-master | 2baede5b-335b-4509-a165-45e742316fe4 | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | kube_master_eth0 | 84ce8ff0-e0de-4b6c-885d-28dc7f2becc1 | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | agent_config | 0456f77d-f9c5-4db2-82bd-db72dd49c023 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-0-r4srfjnthzxr | | etcd_pool_member | c5f9cc21-c951-43c4-b35c-53dc1b579697 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume_attach | 92d65782-a3ef-4938-9d9b-7ca8f965dc76 | Magnum::Optional::Etcd::VolumeAttachm ent | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_pool_member | c86a539d-863c-4f73-a8fb-976593f78110 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | upgrade_kubernetes | 0ee8cb5b-deb1-48c2-9323-1558c31c7dfc | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume_attach | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::VolumeAttac hment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config_deployment | 0c17ecc1-b676-4af5-a86c-1f86971080cf | OS::Heat::SoftwareDeployment | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | master_config | 1eb9d15d-ed09-417a-8fac-1c4e1424ed6a | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | docker_volume | 02430b0e-c9d0-455d-9f3f-084b808f9ddf | Magnum::Optional::Cinder::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | etcd_volume | 5fe87023-8ff4-4381-b543-4f15edadc61b | Magnum::Optional::Etcd::Volume | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | api_address_switch | 5bbab773-1c9e-4104-ad2f-39f52401ab05 | Magnum::ApiGatewaySwitcher
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_floating | 6fd94160-d49a-41b7-b936-8f682466c614 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube-master | 41c198bb-114a-4baa-9a56-322f8f345fcd | OS::Nova::Server
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | kube_master_eth0 | 7be6a71a-4448-4f8f-97fb-56e739a457db | OS::Neutron::Port
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | agent_config | ad2d8d64-3919-4b61-9a51-71cc81345220 | OS::Heat::SoftwareConfig
| CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master s-vfy2f6qbw2lz-1-phcfygifbg3o | | monitor | 73a7e0b6-4d3d-497c-9ab1-cd9fcaee398a | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | pool | 061c047c-8990-45b1-8ef3-86f1f8207fa0 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | listener | 112c04c4-a0a7-4770-84fb-df3ef630bb51 | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | loadbalancer | 6ce77c54-d7a5-41ac-af14-ee9993c255d6 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp rw4iculpj | | floating | 06ab733d-45d4-42e8-9aa2-e9ecc00e3d44 | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | monitor | 51cdc4dd-d0f0-4361-9c86-1f519951c957 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | pool | 67f7372d-8d60-4693-8809-56075a6ad326 | Magnum::Optional::Neutron::LBaaS::Poo l | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | listener | 7193aa59-43f9-45a8-aa7e-c5a5f86beced | Magnum::Optional::Neutron::LBaaS::Lis tener | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | loadbalancer | 04bc48ad-0884-4eae-b6ee-48b4a1b9cab3 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7 aup7jtig | | extrouter_inside | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd:subnet_id=a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::RouterInte rface | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | extrouter | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd | Magnum::Optional::Neutron::Router | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | network_switch | bc89bc1b-cf84-4760-83e9-e73c1cb1d786 | Magnum::NetworkSwitcher
| CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_subnet | a704ec6f-1f29-431f-88c4-aae3c328ce2e | Magnum::Optional::Neutron::Subnet | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi | | private_network | 8cea85b5-9fb0-4578-9295-8d362526da2e | Magnum::Optional::Neutron::Net | CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4 tldcepeoi |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------- ------------------------------+
Stack2: (yogavenv) [deployer@rcdndeployer2 ~]$ openstack stack resource list -n5 85b6ce8b-5c4c-4cab-b69f-aed69a96018f
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+ | resource_name | physical_resource_id | resource_type | resource_status | updated_time | stack_name |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+
*| kube_minions | 225fb4e7-8ae0-42a8-95a5-9dbe63f54650 | OS::Heat::ResourceGroup
| DELETE_FAILED | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | * | etcd_address_lb_switch | 762b3454-629f-4f21-b8fb-9ae896a3a010 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_address_lb_switch | 8a8935d4-8762-4fbc-bf25-4866ce0a53a7 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | kube_masters | d724aa3d-780b-414e-a080-3a501becdaae | OS::Heat::ResourceGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | etcd_lb | 2281b6f9-46e0-411b-833e-853a4994ad96 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | api_lb | 586477b3-8a25-4740-865c-5d682f3fb4f3 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | network | b747ad8b-b592-4a8f-afcd-b76017a1f68c | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/common/templates/network.yaml | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | master_nodes_server_group | d0e3eea2-7776-4e57-9651-2799751a3dbc | OS::Nova::ServerGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_minion | 320ace66-73af-4518-8852-abcac7233e0c | OS::Neutron::SecurityGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | secgroup_kube_master | 3c0778ef-2fb0-4de6-97a2-603e4e753c58 | OS::Neutron::SecurityGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq | | worker_nodes_server_group | 75d9263d-3187-4256-9506-732cee98799a | OS::Nova::ServerGroup
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq |
*| 1 | 6d31d728-61f7-4383-95e5-24800de91162 | file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml | DELETE_FAILED | 2022-05-11T10:40:16Z | testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn * | | docker_volume_attach | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::VolumeAttac hment | DELETE_FAILED | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | docker_volume | 63cd097c-9877-40c0-968f-52b58bdaedf9 | Magnum::Optional::Cinder::Volume | SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube-minion | 1a605e7b-aafc-4113-90a7-98d8d8fe5f96 | OS::Nova::Server
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | kube_minion_eth0 | 05bf8eb4-f2ca-4234-8497-c5b13c977a32 | OS::Neutron::Port
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | agent_config | ad560f63-94b2-4287-8a4c-6ac66042cc35 | OS::Heat::SoftwareConfig
| SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio ns-uakw7w4mnepn-1-pkoi6mf32khj | | 1 | 3f4cff1f-28f4-4276-b676-e707a42465b8 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | 0 | 412844d4-a864-47c2-b9cf-6eecee186338 | file:///var/lib/kolla/venv/lib/python 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml | CHECK_COMPLETE | 2022-05-11T10:36:12Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g | | api_pool_member | dd1c1021-67fd-4fe9-b2a0-e481f906c79d | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_pool_member | b11fae15-1869-4d49-b939-c63d683d1a9f | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | upgrade_kubernetes | 5ef86e19-94c5-48fe-88ab-5962ef03f63a | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume_attach | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume_attach | 4be01f1a-b386-421e-963a-f75425bff4b3 | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config_deployment | d4b740e2-1cfc-4569-a1d5-eabbf1285229 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | master_config | 574d9330-5ac0-4f7b-8bea-8b46b4966e14 | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | docker_volume | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75 | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | etcd_volume | a47316ff-16ba-4fc9-b2d0-840d691400aa | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_address_switch | dbeb0fff-b974-4fe7-9451-d0c2eabffc03 | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_floating | 99047ae9-39dd-4196-a507-fbc82dc4375a | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube-master | 4fde1552-ce13-4546-9d8f-1e9ea25352a5 | OS::Nova::Server
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | kube_master_eth0 | d442fcef-43e6-4fe2-9390-991bf827c221 | OS::Neutron::Port
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | agent_config | 802300e7-8f19-4694-b2fc-2cb5ad55eb25 | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-1-gfoenmdqijvt | | api_pool_member | 98264ea6-ea88-4132-8cca-7f0a049d8cee | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_pool_member | 458d8d42-6994-4dc6-8517-d3486ad42d67 | Magnum::Optional::Neutron::LBaaS::Poo lMember | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume_attach | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::VolumeAttac hment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes_deployment | | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | upgrade_kubernetes | 725193f9-c222-4ad9-8097-df88656e5d9f | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config_deployment | 3994e5a7-c7df-48e7-a562-70d690310d06 | OS::Heat::SoftwareDeployment | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | master_config | 94978b0e-4d00-4ced-9212-eb19da22875e | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | api_address_switch | 17692180-d5cc-4f1b-80a5-7a64c61d512a | Magnum::ApiGatewaySwitcher
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | docker_volume | 37f3721a-81b7-41b6-beb1-9860e9265f6c | Magnum::Optional::Cinder::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_floating | 6ffa46aa-4cc9-43a8-9dbe-4246d4d167d0 | Magnum::Optional::KubeMaster::Neutron ::FloatingIP | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume_attach | 50d479d5-ea54-40b1-927a-6287fbef277d | Magnum::Optional::Etcd::VolumeAttachm ent | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | etcd_volume | 6e32c307-8645-4a93-bd68-f6a5172a54b8 | Magnum::Optional::Etcd::Volume | CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube-master | 6515ad5d-cc35-46d9-b554-31836e41d59e | OS::Nova::Server
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | kube_master_eth0 | 3c9390d2-5d07-4a02-9110-6551e743ee32 | OS::Neutron::Port
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | agent_config | 25cdf836-a317-45ff-aa18-262b933c3e4b | OS::Heat::SoftwareConfig
| CHECK_COMPLETE | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste rs-2rwfudiqoi5g-0-omoqeuv5oreq | | monitor | eed43fb4-b6fa-41c8-b612-e15aae185488 | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | pool | cdf18e7c-b823-4c45-9f79-400c0f5f15bd | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | listener | 4437d207-03fb-4c75-8a6c-eb6a4946f6cd | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | loadbalancer | 075c3e23-79be-4a95-8875-7235db051d24 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k tdtic4o56a | | floating | 3ffc5f32-a1fe-4948-857b-d304a56ee48c | Magnum::Optional::Neutron::LBaaS::Flo atingIP | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | monitor | 6fde29bd-a607-464c-a54b-7c38132efb2d | Magnum::Optional::Neutron::LBaaS::Hea lthMonitor | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | pool | 62f92f0e-51dd-4a34-b9b8-f267b745ebd1 | Magnum::Optional::Neutron::LBaaS::Poo l | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | listener | 7d805d71-e811-422d-b81a-8941ece42bff | Magnum::Optional::Neutron::LBaaS::Lis tener | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | loadbalancer | c7599c6f-b9c0-4ed5-9b20-ed4cd3ee1326 | Magnum::Optional::Neutron::LBaaS::Loa dBalancer | CHECK_COMPLETE | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5 ckf7fomri | | network_switch | 0dda301f-9d35-432b-a010-618b8ca62f3b | Magnum::NetworkSwitcher
| CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter_inside | e2f8b157-60b5-40ab-aa0a-9e7888900cd9:subnet_id=3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::RouterInte rface | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_subnet | 3f85b8a4-43fc-43a3-abc2-58982006a1c4 | Magnum::Optional::Neutron::Subnet | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | private_network | eaedb3a2-1619-42af-9fd7-81e02e6537df | Magnum::Optional::Neutron::Net | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq | | extrouter | e2f8b157-60b5-40ab-aa0a-9e7888900cd9 | Magnum::Optional::Neutron::Router | CHECK_COMPLETE | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh l3pe5z4pqq |
+-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
--------------------------------------------------------------------------------+------------------+----------------------+---------------------------------- -------------------------------+
We had a problem on the platform, and some VMs have gone to error state, in reality they have disappeared, we tried to delete the stack and resources that no longer exists are making these errors. We are searching for a way to delete the stack even if the corresponding resource does not exist anymore.
Regards.
Le mar. 29 nov. 2022 à 10:36, Jake Yip <jake.yip@ardc.edu.au> a écrit :
Hi,
Can you see what resource it is failing at with `openstack stack resource list -n5 <stack_id>`?
You can also abandon the stack with `openstack stack abandon`. That will leave stray resources lying around though.
Regards, Jake
On 29/11/2022 2:09 am, wodel youchi wrote:
Hi,
I have a magnum cluster stack which contains errors in its constituents, some of the VMs (minions) that belong to that cluster do longer exist. When I try to delete the stack it fails, and I get
DELETE aborted (Task delete from ResourceGroup "kube_minions" [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack "testcluter01-puf45b6dxmrn" [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
Is there a way to force the deletion to proceed even with those errors?
Regards.
participants (3)
-
Jake Yip
-
Nguyễn Hữu Khôi
-
wodel youchi