[kolla-ansible][Yoga][Magnum] How to delete a cluster containing errors

Nguyễn Hữu Khôi nguyenhuukhoinw at gmail.com
Wed Nov 30 14:34:04 UTC 2022


Hope It helps:
https://platform9.com/kb/openstack/unable-to-delete-stacks-stuck-in-delete_failed-state
If u still cannot remove k8s. pls go to delete k8s instances and volumes.
In my case, it works.
Nguyen Huu Khoi


On Wed, Nov 30, 2022 at 8:00 PM wodel youchi <wodel.youchi at gmail.com> wrote:

> Hi,
>
> Here are some other details :
> (yogavenv) [deployer at rcdndeployer2 ~]$* openstack stack failures list
> 85b6ce8b-5c4c-4cab-b69f-aed69a96018f*
> testmulti-r37u5recibdq.kube_minions.1.docker_volume_attach:
>   resource_type: Magnum::Optional::Cinder::VolumeAttachment
>   physical_resource_id: 63cd097c-9877-40c0-968f-52b58bdaedf9
>   status: DELETE_FAILED
>   status_reason: |
>     DELETE aborted (Task delete from CinderVolumeAttachment
> "docker_volume_attach" [63cd097c-9877-40c0-968f-52b58bdaedf9] Stack
> "testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn-1-pkoi6mf32khj"
> [6d31d728-61f7-4383-95e5-24800de91162] Timed out)
>
> (yogavenv) [deployer at rcdndeployer2 ~]$* openstack stack failures list
> c1801318-c0b8-4438-9c85-41cf5c7812f1*
> mymultik8-ub6qbaarl74z.kube_minions.1.docker_volume_attach:
>   resource_type: Magnum::Optional::Cinder::VolumeAttachment
>   physical_resource_id: 07e2e175-bf0b-498c-8f0d-531f49ec183c
>   status: DELETE_FAILED
>   status_reason: |
>     DELETE aborted (Task delete from CinderVolumeAttachment
> "docker_volume_attach" [07e2e175-bf0b-498c-8f0d-531f49ec183c] Stack
> "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-1-oq7v4edmmj4e"
> [713fd534-f3ac-4fc4-a3e9-9a8a67bfe549] Timed out)
> mymultik8-ub6qbaarl74z.kube_minions.0.docker_volume_attach:
>   resource_type: Magnum::Optional::Cinder::VolumeAttachment
>   physical_resource_id: c9efd934-679c-4e7d-8258-e7c1c65b2b95
>   status: DELETE_FAILED
>   status_reason: |
>     DELETE aborted (Task delete from CinderVolumeAttachment
> "docker_volume_attach" [c9efd934-679c-4e7d-8258-e7c1c65b2b95] Stack
> "mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v-0-3zue4xpnyzep"
> [009bf512-7d67-4db0-9e63-264a320d23ab] Timed out)
>
>
>
> PS :
>  (yogavenv) [deployer at rcdndeployer2 ~]$ openstack stack abandon
> 85b6ce8b-5c4c-4cab-b69f-aed69a96018f
>
> *ERROR: Stack Abandon is not supported.*
>
> Regards.
>
> Le mar. 29 nov. 2022 à 11:04, wodel youchi <wodel.youchi at gmail.com> a
> écrit :
>
>> Hi,
>>
>> Here are two examples of stack which fail to be deleted
>> Stack 1:
>> (yogavenv) [deployer at rcdndeployer2 ~]$ openstack stack resource list -n5
>> c1801318-c0b8-4438-9c85-41cf5c7812f1
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+-----------------+----------------------+-----------------------------------
>> ------------------------------+
>> | resource_name                 | physical_resource_id
>>                                                                |
>> resource_type
>>                                                                                |
>> resource_status | updated_time         | stack_name
>>                              |
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+-----------------+----------------------+-----------------------------------
>> ------------------------------+
>>
>>
>> *| kube_minions                  | ffc19ead-94f0-4ff3-b496-b454a156f1f7
>>                                                | OS::Heat::ResourceGroup
>>
>>                                                                                |
>> DELETE_FAILED   | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              | *
>> | api_address_lb_switch         | d0b7f19c-7b66-4c07-a60a-cb6e62c48876
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | etcd_address_lb_switch        | 8c2a7952-e2aa-42d5-9da9-3a9881e69211
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | worker_nodes_server_group     | cf3601c0-3876-4d91-8fa0-0f87e6b43eca
>>                                                | OS::Nova::ServerGroup
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | kube_masters                  | ebbccf6a-40bf-4cbc-badd-fbafbb255337
>>                                                | OS::Heat::ResourceGroup
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | etcd_lb                       | 65fd17e5-5e54-406d-bbba-7d56a8d4eb93
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml
>>                  | CREATE_COMPLETE | 2022-05-08T11:59:09Z |
>> mymultik8-ub6qbaarl74z
>>                              |
>> | master_nodes_server_group     | b0c9c49a-9160-4b33-af90-c2c16392b22e
>>                                                | OS::Nova::ServerGroup
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | api_lb                        | b48e0ade-52ec-409f-9212-ce231318d4df
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml
>>                   | CREATE_COMPLETE | 2022-05-08T11:59:09Z |
>> mymultik8-ub6qbaarl74z
>>                              |
>> | network                       | 29549cda-d294-4031-90c0-a8e50cdf31dc
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/network.yaml
>>                  | CREATE_COMPLETE | 2022-05-08T11:59:09Z |
>> mymultik8-ub6qbaarl74z
>>                              |
>> | secgroup_kube_minion          | 1123a7cd-080c-49a9-a7e8-81e162f07fa0
>>                                                | OS::Neutron::SecurityGroup
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>> | secgroup_kube_master          | 5e2286d4-eadc-46ee-91db-ac79485d92b2
>>                                                | OS::Neutron::SecurityGroup
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:09Z | mymultik8-ub6qbaarl74z
>>                              |
>>
>>
>>
>>
>>
>> *| 1                             | 713fd534-f3ac-4fc4-a3e9-9a8a67bfe549
>>                                                |
>> file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml
>> | DELETE_FAILED   | 2022-05-08T12:04:22Z |
>> mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v                | | 0
>>                             | 009bf512-7d67-4db0-9e63-264a320d23ab
>>                                                |
>> file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml
>> | DELETE_FAILED   | 2022-05-08T12:04:22Z |
>> mymultik8-ub6qbaarl74z-kube_minions-wlu4j5as6u4v                | *
>> | docker_volume_attach          | 07e2e175-bf0b-498c-8f0d-531f49ec183c
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> DELETE_FAILED   | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-1-oq7v4edmmj4e |
>> | kube-minion                   | eca4b475-12f7-4a67-8192-ac9d99db1a65
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-1-oq7v4edmmj4e |
>> | kube_minion_eth0              | 17c7474d-8a63-43f7-a9cd-30ae22b4b153
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-1-oq7v4edmmj4e |
>> | docker_volume                 | 07e2e175-bf0b-498c-8f0d-531f49ec183c
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-1-oq7v4edmmj4e |
>> | agent_config                  | 09d6d11f-0623-49ab-a12e-653241d54d0b
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:23Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-1-oq7v4edmmj4e |
>> | docker_volume_attach          | c9efd934-679c-4e7d-8258-e7c1c65b2b95
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> DELETE_FAILED   | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-0-3zue4xpnyzep |
>> | kube-minion                   | 37e7921a-03c8-40a2-ad80-2b006fb79c22
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-0-3zue4xpnyzep |
>> | agent_config                  | 05fcc72e-0561-497d-98e2-6b92c109db0f
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-0-3zue4xpnyzep |
>> | kube_minion_eth0              | beb8bf56-e5e1-4c7a-94ce-fe650e5902c6
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-0-3zue4xpnyzep |
>> | docker_volume                 | c9efd934-679c-4e7d-8258-e7c1c65b2b95
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:04:22Z | mymultik8-ub6qbaarl74z-kube_minion
>> s-wlu4j5as6u4v-0-3zue4xpnyzep |
>> | 0                             | ff2d9839-9584-4f25-b4dd-869456635201
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml
>> | CREATE_COMPLETE | 2022-05-08T12:00:11Z |
>> mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz                |
>> | 1                             | e57c70ea-c165-4f0a-b680-a4344b97779d
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml
>> | CREATE_COMPLETE | 2022-05-08T12:00:11Z |
>> mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz                |
>> | etcd_pool_member              | cc587c78-a756-4720-9683-8f2564a5031d
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | etcd_volume_attach            | ce25bf02-e20f-458e-b8e5-f3e3eb94064b
>>                                                |
>> Magnum::Optional::Etcd::VolumeAttachm
>> ent
>>                                                                             |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | api_pool_member               | 8b406579-f31c-4eed-8d88-4fa829db62af
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | upgrade_kubernetes_deployment |
>>                                                                                     |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | upgrade_kubernetes            | c66e6546-1cb5-4d13-a617-c2e3fd502f97
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | docker_volume_attach          | 440b7e09-b45a-4abb-b814-2bf52a262d06
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | master_config_deployment      | 40f798e8-e505-431e-af92-fe04d3a60c17
>>                                                |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | master_config                 | 706cead9-113a-40f5-b76c-6c24ad825720
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | docker_volume                 | 440b7e09-b45a-4abb-b814-2bf52a262d06
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | etcd_volume                   | b36dcb9c-6960-42c9-86d9-c56f41e45f50
>>                                                |
>> Magnum::Optional::Etcd::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | api_address_switch            | 9d76cd95-9c17-418b-9eeb-6ab5b6824995
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | kube_master_floating          | db987622-fa06-4ee4-ab4a-70c710552afb
>>                                                |
>> Magnum::Optional::KubeMaster::Neutron
>> ::FloatingIP
>>                                                                    |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | kube-master                   | 2baede5b-335b-4509-a165-45e742316fe4
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | kube_master_eth0              | 84ce8ff0-e0de-4b6c-885d-28dc7f2becc1
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | agent_config                  | 0456f77d-f9c5-4db2-82bd-db72dd49c023
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:13Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-0-r4srfjnthzxr |
>> | etcd_pool_member              | c5f9cc21-c951-43c4-b35c-53dc1b579697
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | etcd_volume_attach            | 92d65782-a3ef-4938-9d9b-7ca8f965dc76
>>                                                |
>> Magnum::Optional::Etcd::VolumeAttachm
>> ent
>>                                                                             |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | api_pool_member               | c86a539d-863c-4f73-a8fb-976593f78110
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | upgrade_kubernetes_deployment |
>>                                                                                     |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | upgrade_kubernetes            | 0ee8cb5b-deb1-48c2-9323-1558c31c7dfc
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | docker_volume_attach          | 02430b0e-c9d0-455d-9f3f-084b808f9ddf
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | master_config_deployment      | 0c17ecc1-b676-4af5-a86c-1f86971080cf
>>                                                |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | master_config                 | 1eb9d15d-ed09-417a-8fac-1c4e1424ed6a
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | docker_volume                 | 02430b0e-c9d0-455d-9f3f-084b808f9ddf
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | etcd_volume                   | 5fe87023-8ff4-4381-b543-4f15edadc61b
>>                                                |
>> Magnum::Optional::Etcd::Volume
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | api_address_switch            | 5bbab773-1c9e-4104-ad2f-39f52401ab05
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | kube_master_floating          | 6fd94160-d49a-41b7-b936-8f682466c614
>>                                                |
>> Magnum::Optional::KubeMaster::Neutron
>> ::FloatingIP
>>                                                                    |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | kube-master                   | 41c198bb-114a-4baa-9a56-322f8f345fcd
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | kube_master_eth0              | 7be6a71a-4448-4f8f-97fb-56e739a457db
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | agent_config                  | ad2d8d64-3919-4b61-9a51-71cc81345220
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T12:00:12Z | mymultik8-ub6qbaarl74z-kube_master
>> s-vfy2f6qbw2lz-1-phcfygifbg3o |
>> | monitor                       | 73a7e0b6-4d3d-497c-9ab1-cd9fcaee398a
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Hea
>> lthMonitor
>>                                                                      |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp
>> rw4iculpj                     |
>> | pool                          | 061c047c-8990-45b1-8ef3-86f1f8207fa0
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> l
>>                                                                               |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp
>> rw4iculpj                     |
>> | listener                      | 112c04c4-a0a7-4770-84fb-df3ef630bb51
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Lis
>> tener
>>                                                                           |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp
>> rw4iculpj                     |
>> | loadbalancer                  | 6ce77c54-d7a5-41ac-af14-ee9993c255d6
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Loa
>> dBalancer
>>                                                                       |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-etcd_lb-ogp
>> rw4iculpj                     |
>> | floating                      | 06ab733d-45d4-42e8-9aa2-e9ecc00e3d44
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Flo
>> atingIP
>>                                                                         |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7
>> aup7jtig                      |
>> | monitor                       | 51cdc4dd-d0f0-4361-9c86-1f519951c957
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Hea
>> lthMonitor
>>                                                                      |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7
>> aup7jtig                      |
>> | pool                          | 67f7372d-8d60-4693-8809-56075a6ad326
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> l
>>                                                                               |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7
>> aup7jtig                      |
>> | listener                      | 7193aa59-43f9-45a8-aa7e-c5a5f86beced
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Lis
>> tener
>>                                                                           |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7
>> aup7jtig                      |
>> | loadbalancer                  | 04bc48ad-0884-4eae-b6ee-48b4a1b9cab3
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Loa
>> dBalancer
>>                                                                       |
>> CREATE_COMPLETE | 2022-05-08T11:59:15Z | mymultik8-ub6qbaarl74z-api_lb-lce7
>> aup7jtig                      |
>> | extrouter_inside              |
>> 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd:subnet_id=a704ec6f-1f29-431f-88c4-aae3c328ce2e
>> | Magnum::Optional::Neutron::RouterInte
>> rface
>>                                                                           |
>> CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4
>> tldcepeoi                     |
>> | extrouter                     | 6a4cbb2b-6fdb-4edb-9f3d-075ee6f934fd
>>                                                |
>> Magnum::Optional::Neutron::Router
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4
>> tldcepeoi                     |
>> | network_switch                | bc89bc1b-cf84-4760-83e9-e73c1cb1d786
>>                                                | Magnum::NetworkSwitcher
>>
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4
>> tldcepeoi                     |
>> | private_subnet                | a704ec6f-1f29-431f-88c4-aae3c328ce2e
>>                                                |
>> Magnum::Optional::Neutron::Subnet
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4
>> tldcepeoi                     |
>> | private_network               | 8cea85b5-9fb0-4578-9295-8d362526da2e
>>                                                |
>> Magnum::Optional::Neutron::Net
>>                                                                                |
>> CREATE_COMPLETE | 2022-05-08T11:59:11Z | mymultik8-ub6qbaarl74z-network-lt4
>> tldcepeoi                     |
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+-----------------+----------------------+-----------------------------------
>> ------------------------------+
>>
>> Stack2:
>> (yogavenv) [deployer at rcdndeployer2 ~]$ openstack stack resource list -n5
>> 85b6ce8b-5c4c-4cab-b69f-aed69a96018f
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+------------------+----------------------+----------------------------------
>> -------------------------------+
>> | resource_name                 | physical_resource_id
>>                                                                |
>> resource_type
>>                                                                                |
>> resource_status  | updated_time         | stack_name
>>                               |
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+------------------+----------------------+----------------------------------
>> -------------------------------+
>>
>>
>> *| kube_minions                  | 225fb4e7-8ae0-42a8-95a5-9dbe63f54650
>>                                                | OS::Heat::ResourceGroup
>>
>>                                                                                |
>> DELETE_FAILED    | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               | *
>> | etcd_address_lb_switch        | 762b3454-629f-4f21-b8fb-9ae896a3a010
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | api_address_lb_switch         | 8a8935d4-8762-4fbc-bf25-4866ce0a53a7
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | kube_masters                  | d724aa3d-780b-414e-a080-3a501becdaae
>>                                                | OS::Heat::ResourceGroup
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | etcd_lb                       | 2281b6f9-46e0-411b-833e-853a4994ad96
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/lb_etcd.yaml
>>                  | CHECK_COMPLETE   | 2022-05-11T10:35:10Z |
>> testmulti-r37u5recibdq
>>                               |
>> | api_lb                        | 586477b3-8a25-4740-865c-5d682f3fb4f3
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/lb_api.yaml
>>                   | CHECK_COMPLETE   | 2022-05-11T10:35:10Z |
>> testmulti-r37u5recibdq
>>                               |
>> | network                       | b747ad8b-b592-4a8f-afcd-b76017a1f68c
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/common/templates/network.yaml
>>                  | CHECK_COMPLETE   | 2022-05-11T10:35:10Z |
>> testmulti-r37u5recibdq
>>                               |
>> | master_nodes_server_group     | d0e3eea2-7776-4e57-9651-2799751a3dbc
>>                                                | OS::Nova::ServerGroup
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | secgroup_kube_minion          | 320ace66-73af-4518-8852-abcac7233e0c
>>                                                | OS::Neutron::SecurityGroup
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | secgroup_kube_master          | 3c0778ef-2fb0-4de6-97a2-603e4e753c58
>>                                                | OS::Neutron::SecurityGroup
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>> | worker_nodes_server_group     | 75d9263d-3187-4256-9506-732cee98799a
>>                                                | OS::Nova::ServerGroup
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq
>>                               |
>>
>>
>> *| 1                             | 6d31d728-61f7-4383-95e5-24800de91162
>>                                                |
>> file:///var/lib/kolla/venv/lib/python3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubeminion.yaml
>> | DELETE_FAILED    | 2022-05-11T10:40:16Z |
>> testmulti-r37u5recibdq-kube_minions-uakw7w4mnepn   *             |
>> | docker_volume_attach          | 63cd097c-9877-40c0-968f-52b58bdaedf9
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> DELETE_FAILED    | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio
>> ns-uakw7w4mnepn-1-pkoi6mf32khj |
>> | docker_volume                 | 63cd097c-9877-40c0-968f-52b58bdaedf9
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio
>> ns-uakw7w4mnepn-1-pkoi6mf32khj |
>> | kube-minion                   | 1a605e7b-aafc-4113-90a7-98d8d8fe5f96
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio
>> ns-uakw7w4mnepn-1-pkoi6mf32khj |
>> | kube_minion_eth0              | 05bf8eb4-f2ca-4234-8497-c5b13c977a32
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio
>> ns-uakw7w4mnepn-1-pkoi6mf32khj |
>> | agent_config                  | ad560f63-94b2-4287-8a4c-6ac66042cc35
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> SUSPEND_COMPLETE | 2022-05-11T10:40:18Z | testmulti-r37u5recibdq-kube_minio
>> ns-uakw7w4mnepn-1-pkoi6mf32khj |
>> | 1                             | 3f4cff1f-28f4-4276-b676-e707a42465b8
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml
>> | CHECK_COMPLETE   | 2022-05-11T10:36:12Z |
>> testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g                |
>> | 0                             | 412844d4-a864-47c2-b9cf-6eecee186338
>>                                                |
>> file:///var/lib/kolla/venv/lib/python
>> 3.6/site-packages/magnum/drivers/k8s_fedora_coreos_v1/templates/kubemaster.yaml
>> | CHECK_COMPLETE   | 2022-05-11T10:36:12Z |
>> testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g                |
>> | api_pool_member               | dd1c1021-67fd-4fe9-b2a0-e481f906c79d
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | etcd_pool_member              | b11fae15-1869-4d49-b939-c63d683d1a9f
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | upgrade_kubernetes_deployment |
>>                                                                                     |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | upgrade_kubernetes            | 5ef86e19-94c5-48fe-88ab-5962ef03f63a
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | docker_volume_attach          | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | etcd_volume_attach            | 4be01f1a-b386-421e-963a-f75425bff4b3
>>                                                |
>> Magnum::Optional::Etcd::VolumeAttachm
>> ent
>>                                                                             |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | master_config_deployment      | d4b740e2-1cfc-4569-a1d5-eabbf1285229
>>                                                |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | master_config                 | 574d9330-5ac0-4f7b-8bea-8b46b4966e14
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | docker_volume                 | 460a5a20-cbd1-4e4d-827b-ecf8876d1f75
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | etcd_volume                   | a47316ff-16ba-4fc9-b2d0-840d691400aa
>>                                                |
>> Magnum::Optional::Etcd::Volume
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | api_address_switch            | dbeb0fff-b974-4fe7-9451-d0c2eabffc03
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | kube_master_floating          | 99047ae9-39dd-4196-a507-fbc82dc4375a
>>                                                |
>> Magnum::Optional::KubeMaster::Neutron
>> ::FloatingIP
>>                                                                    |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | kube-master                   | 4fde1552-ce13-4546-9d8f-1e9ea25352a5
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | kube_master_eth0              | d442fcef-43e6-4fe2-9390-991bf827c221
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | agent_config                  | 802300e7-8f19-4694-b2fc-2cb5ad55eb25
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:14Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-1-gfoenmdqijvt |
>> | api_pool_member               | 98264ea6-ea88-4132-8cca-7f0a049d8cee
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | etcd_pool_member              | 458d8d42-6994-4dc6-8517-d3486ad42d67
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> lMember
>>                                                                         |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | docker_volume_attach          | 37f3721a-81b7-41b6-beb1-9860e9265f6c
>>                                                |
>> Magnum::Optional::Cinder::VolumeAttac
>> hment
>>                                                                           |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | upgrade_kubernetes_deployment |
>>                                                                                     |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | upgrade_kubernetes            | 725193f9-c222-4ad9-8097-df88656e5d9f
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | master_config_deployment      | 3994e5a7-c7df-48e7-a562-70d690310d06
>>                                                |
>> OS::Heat::SoftwareDeployment
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | master_config                 | 94978b0e-4d00-4ced-9212-eb19da22875e
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | api_address_switch            | 17692180-d5cc-4f1b-80a5-7a64c61d512a
>>                                                | Magnum::ApiGatewaySwitcher
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | docker_volume                 | 37f3721a-81b7-41b6-beb1-9860e9265f6c
>>                                                |
>> Magnum::Optional::Cinder::Volume
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | kube_master_floating          | 6ffa46aa-4cc9-43a8-9dbe-4246d4d167d0
>>                                                |
>> Magnum::Optional::KubeMaster::Neutron
>> ::FloatingIP
>>                                                                    |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | etcd_volume_attach            | 50d479d5-ea54-40b1-927a-6287fbef277d
>>                                                |
>> Magnum::Optional::Etcd::VolumeAttachm
>> ent
>>                                                                             |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | etcd_volume                   | 6e32c307-8645-4a93-bd68-f6a5172a54b8
>>                                                |
>> Magnum::Optional::Etcd::Volume
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | kube-master                   | 6515ad5d-cc35-46d9-b554-31836e41d59e
>>                                                | OS::Nova::Server
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | kube_master_eth0              | 3c9390d2-5d07-4a02-9110-6551e743ee32
>>                                                | OS::Neutron::Port
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | agent_config                  | 25cdf836-a317-45ff-aa18-262b933c3e4b
>>                                                | OS::Heat::SoftwareConfig
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:36:13Z | testmulti-r37u5recibdq-kube_maste
>> rs-2rwfudiqoi5g-0-omoqeuv5oreq |
>> | monitor                       | eed43fb4-b6fa-41c8-b612-e15aae185488
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Hea
>> lthMonitor
>>                                                                      |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k
>> tdtic4o56a                     |
>> | pool                          | cdf18e7c-b823-4c45-9f79-400c0f5f15bd
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> l
>>                                                                               |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k
>> tdtic4o56a                     |
>> | listener                      | 4437d207-03fb-4c75-8a6c-eb6a4946f6cd
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Lis
>> tener
>>                                                                           |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k
>> tdtic4o56a                     |
>> | loadbalancer                  | 075c3e23-79be-4a95-8875-7235db051d24
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Loa
>> dBalancer
>>                                                                       |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-etcd_lb-2k
>> tdtic4o56a                     |
>> | floating                      | 3ffc5f32-a1fe-4948-857b-d304a56ee48c
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Flo
>> atingIP
>>                                                                         |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5
>> ckf7fomri                      |
>> | monitor                       | 6fde29bd-a607-464c-a54b-7c38132efb2d
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Hea
>> lthMonitor
>>                                                                      |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5
>> ckf7fomri                      |
>> | pool                          | 62f92f0e-51dd-4a34-b9b8-f267b745ebd1
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Poo
>> l
>>                                                                               |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5
>> ckf7fomri                      |
>> | listener                      | 7d805d71-e811-422d-b81a-8941ece42bff
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Lis
>> tener
>>                                                                           |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5
>> ckf7fomri                      |
>> | loadbalancer                  | c7599c6f-b9c0-4ed5-9b20-ed4cd3ee1326
>>                                                |
>> Magnum::Optional::Neutron::LBaaS::Loa
>> dBalancer
>>                                                                       |
>> CHECK_COMPLETE   | 2022-05-11T10:35:16Z | testmulti-r37u5recibdq-api_lb-mk5
>> ckf7fomri                      |
>> | network_switch                | 0dda301f-9d35-432b-a010-618b8ca62f3b
>>                                                | Magnum::NetworkSwitcher
>>
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh
>> l3pe5z4pqq                     |
>> | extrouter_inside              |
>> e2f8b157-60b5-40ab-aa0a-9e7888900cd9:subnet_id=3f85b8a4-43fc-43a3-abc2-58982006a1c4
>> | Magnum::Optional::Neutron::RouterInte
>> rface
>>                                                                           |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh
>> l3pe5z4pqq                     |
>> | private_subnet                | 3f85b8a4-43fc-43a3-abc2-58982006a1c4
>>                                                |
>> Magnum::Optional::Neutron::Subnet
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh
>> l3pe5z4pqq                     |
>> | private_network               | eaedb3a2-1619-42af-9fd7-81e02e6537df
>>                                                |
>> Magnum::Optional::Neutron::Net
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh
>> l3pe5z4pqq                     |
>> | extrouter                     | e2f8b157-60b5-40ab-aa0a-9e7888900cd9
>>                                                |
>> Magnum::Optional::Neutron::Router
>>                                                                                |
>> CHECK_COMPLETE   | 2022-05-11T10:35:10Z | testmulti-r37u5recibdq-network-oh
>> l3pe5z4pqq                     |
>>
>> +-------------------------------+-------------------------------------------------------------------------------------+--------------------------------------
>>
>> --------------------------------------------------------------------------------+------------------+----------------------+----------------------------------
>> -------------------------------+
>>
>> We had a problem on the platform, and some VMs have gone to error state,
>> in reality they have disappeared, we tried to delete the stack and
>> resources that no longer exists are making these errors. We are searching
>> for a way to delete the stack even if the corresponding resource does not
>> exist anymore.
>>
>>
>> Regards.
>>
>> Le mar. 29 nov. 2022 à 10:36, Jake Yip <jake.yip at ardc.edu.au> a écrit :
>>
>>> Hi,
>>>
>>> Can you see what resource it is failing at with `openstack stack
>>> resource list -n5 <stack_id>`?
>>>
>>> You can also abandon the stack with `openstack stack abandon`. That will
>>> leave stray resources lying around though.
>>>
>>> Regards,
>>> Jake
>>>
>>> On 29/11/2022 2:09 am, wodel youchi wrote:
>>> > Hi,
>>> >
>>> > I have a magnum cluster stack which contains errors in its
>>> constituents,
>>> > some of the VMs (minions) that belong to that cluster do longer exist.
>>> > When I try to delete the stack it fails, and I get
>>> >
>>> > DELETE aborted (Task delete from ResourceGroup "kube_minions"
>>> > [fddb3056-9b00-4665-b0d6-c3d3f176814b] Stack
>>> "testcluter01-puf45b6dxmrn"
>>> > [d10af7f2-6ecd-442b-b1f9-140b79e58d13] Timed out)
>>> >
>>> > Is there a way to force the deletion to proceed even with those errors?
>>> >
>>> > Regards.
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20221130/5fbe88e1/attachment-0001.htm>


More information about the openstack-discuss mailing list