October 2021 - openstack-discuss - lists.openstack.org

[sdk]: Remove volumes stuck in error deleting status
by dmeng 09 Oct '21

09 Oct '21

Hello there, Hope everything is going well. I would like to know if there is any method that could remove the volume stuck in the "error-deleting" status? We are using the chameleon openstack cloud but we are not the admin user there, so couldn't use the "cinder force-delete" or "cinder reset-state" command. Wondering if there is any other method we could use to remove those volumes in our own project? And also wondering what might cause this "error-deleting" problem? We use openstacksdk block storage service, "cinder.delete_volume()" method to remove volumes, and it works fine before. Thanks and have a great day! Catherine

2 1

Why is kolla-kubernetes not maintained anymore？
by fusco lu 09 Oct '21

09 Oct '21

hi,everyone Can you tell me the reason for not being maintained?

1 0

[kolla][wallaby][cinder] netapp driver failed do create volume from images
by Ignazio Cassano 09 Oct '21

09 Oct '21

Hello, I've just updated my kolla wallaby with latest images. When I create volume from image on ceph it works. When I create volume from image on nfs netapp ontap, it does not work. The following is reported in cinder-volume.log: 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/cinder/volume/flows/manager/create_volume.py", line 950, in _create_from_image_cache_or_download 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server model_update = self._create_from_image_download( 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/cinder/volume/flows/manager/create_volume.py", line 766, in _create_from_image_download 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server volume_utils.copy_image_to_volume(self.driver, context, volume, 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server File "/var/lib/kolla/venv/lib/python3.8/site-packages/cinder/volume/volume_utils.py", line 1158, in copy_image_to_volume 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server raise exception.ImageCopyFailure(reason=ex.stderr) 2021-10-08 13:11:20.590 26 ERROR oslo_messaging.rpc.server cinder.exception.ImageCopyFailure: Failed to copy image to volume: qemu-img: /var/lib/cinder/mnt/55fcb53b884ca983ed3d6fa8aac57810/volume-68fd6214-c24a-4104-ae98-e9d0b60aa136: error while converting raw: Failed to lock byte 101 Any help please ? Ignazio

2 7

[all][tc] What's happening in Technical Committee: summary 8th Oct, 21: Reading: 5 min
by Ghanshyam Mann 08 Oct '21

08 Oct '21

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * TC this week video meeting held on Oct 7th Thursday. * Most of the meeting discussions are summarized below (Completed or in-progress activities section). We forgot to record the meeting, an apology for that. I am summarizing each topic discussion, or you can also check some summary and transcript (these are autogenerated and not so perfect, though) @ - https://meetings.opendev.org/meetings/tc/2021/tc.2021-10-07-15.01.log.html - https://review.opendev.org/c/openstack/governance/+/813112/1/reference/tc-m… * We will have next week's IRC meeting on Oct 14th, Thursday 15:00 UTC, feel free the topic in agenda[1] by Oct 13th. 2. What we completed this week: ========================= * Added the cinder-netapp charm to Openstack charms[2] * Retired puppet-freezer[3] 3. Activities In progress: ================== TC Tracker for Xena cycle ------------------------------ * TC is using the etherpad[4] for Xena cycle working item. We will be checking and updating the status biweekly on the same etherpad. * Current status is: 9 completed, 3 to-be-discussed in PTG, 1 in-progress Open Reviews ----------------- * Four open reviews for ongoing activities[5]. Place to maintain the external hosted ELK, E-R, O-H services ------------------------------------------------------------------------- * We continue the discussion[6] on final checks and updates from Allison. Below is the summary: * Allison updated on the offer of the donated credits (45k/year from AWS) to run the ELK services. * Current ELK stack will be migrated on OpenSearch (an open source fork of Elasticsearch) cluster on AWS managed services. * We discussed and agreed to start/move these ELK service work under TACT SIG with the help of Daniel Pawlik, Ross Tomlinson, and Allison (along with Jeremy, Clark as backup/helping in migration). * Allison will continue work on setting up the accounts. * A huge thanks to Allison for driving and arranging the required resources. Add project health check tool ----------------------------------- * Using stats of review/code should not be the only criteria to decide the project health as it depends on many other factors, including the nature of project. * We agreed to use the generated stats only as an early warning tool and not to publish those anywhere which can be wrongly interpreted as project health or so. * We will continue discussing it in PTG for the next steps on this and what to do on TC liaison things. * Meanwhile, we are reviewing Rico proposal on collecting stats tool[7]. Stable Core team process change --------------------------------------- * Current proposal is under review[8]. Feel free to provide early feedback if you have any. Call for 'Technical Writing' SIG Chair/Maintainers ---------------------------------------------------------- * As you might have read in the email from Elod[9], Stephen, who is the current chair for this SIG is not planning to continue to chair. * This SIG has accomplished the work for what it was formed, and now most of the documentation are managed on projects side. TC agreed to move this SIG to complete state and move the repos under TC (tc members will be added to core group in those repos). * Any advisory work on documentation which is what this SIG was doing, will be handle in TC. TC tags analysis ------------------- * Operator feedback is asked on open infra newsletter too, and we will continue the discussion in PTG and will take the final decision based on feedback we receive, if any[10]. Project updates ------------------- * Retiring js-openstack-lib [11] Yoga release community-wide goal ----------------------------------------- * Please add the possible candidates in this etherpad [12]. * Current status: "Secure RBAC" is selected for Yoga cycle[13]. PTG planning ---------------- * We are collecting the PTG topics in etherpad[14], feel free to add any topic you would like to discuss. * We discussed the live stream of one of the TC PTG sessions like we did last time. Once we have more topics in etherpad, then we can select the appropriate one. Test support for TLS default: ---------------------------------- * Rico has started a separate email thread over testing with tls-proxy enabled[15], we encourage projects to participate in that testing and help to enable the tls-proxy in gate testing. 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[16]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [17] 3. Office hours: The Technical Committee offers a weekly office hour every Tuesday at 0100 UTC [18] 4. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://review.opendev.org/c/openstack/governance/+/809011 [3] https://review.opendev.org/c/openstack/governance/+/808679 [4] https://etherpad.opendev.org/p/tc-xena-tracke [5] https://review.opendev.org/q/projects:openstack/governance+status:open [6] https://etherpad.opendev.org/p/elk-service-maintenance-plan [7] https://review.opendev.org/c/openstack/governance/+/810037 [8] https://review.opendev.org/c/openstack/governance/+/810721 [9] http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025161.… [10] https://governance.openstack.org/tc/reference/tags/index.html [11] https://review.opendev.org/c/openstack/governance/+/798540 [12] https://review.opendev.org/c/openstack/governance/+/807163 [13] https://etherpad.opendev.org/p/y-series-goals [14] https://etherpad.opendev.org/p/tc-yoga-ptg [15] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023000.html [16] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [17] http://eavesdrop.openstack.org/#Technical_Committee_Meeting [18] http://eavesdrop.openstack.org/#Technical_Committee_Office_hours -gmann

1 0

Introducing Hubtty, a Gertty fork for Github code reviews
by Martin André 08 Oct '21

08 Oct '21

Hi all, First off, apologies if this isn't the right forum, this has nothing to do with OpenStack development. I'm trying to reach out to the many Gertty users hiding here who might want a similar tool for their Github code reviews. I'm happy to announce the first release of Hubtty [1], a fork of Gertty that I adapted to the Github API and workflow. It has the same look and feel but differs in a few things I detailed in the release changelog [2]. This first version focuses on porting Gertty to Github and works reasonably well. Myself and other intrepid developers already use it every day and I personally find it very convenient for managing incoming PR reviews. In the coming versions I'd like to integrate better with the Github features and improve UX. Try it with `pip install hubtty` and let me know what you think of it. Note that Hubtty can't submit reviews to repositories for which the parent organization has enabled third-party application restrictions without explicitly allowing hubtty [3]. I'm working around the issue by using a token generated by the `gh` app. Martin [1] https://github.com/hubtty/hubtty [2] https://github.com/hubtty/hubtty/blob/v0.1/CHANGELOG.md [3] https://github.com/hubtty/hubtty/issues/20

1 0

[charms] Yoga PTG
by Alex Kavanagh 08 Oct '21

08 Oct '21

Hi all, The OpenStack charms PTG sessions are booked as: - Wednesday 20th October - 14.00 - 17.00 UTC in the Icehouse room - Thursday 21st October - 14.00 - 17.00 UTC also in the Icehouse room Please add your name and discussion topic proposals to the etherpad. [1]. The etherpad also has links to the PTG main site, schedule and Charms. Thank you in advance and see you soon! Alex (tinwood) [1] https://etherpad.opendev.org/p/charms-yoga-ptg

1 0

[heat] xena stack deployment failed
by Ammad Syed 08 Oct '21

08 Oct '21

Hi, I have upgraded my heat from wallaby to xena. When I am trying to create magnum cluster its giving below error in heat engine logs. Currently in whole stack, I have upgraded heat and magnum to latest release. Before upgrading heat from xena to wallaby, the stack deployment was successful. 2021-10-08 12:06:14.107 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] REQ: curl -g -i -X GET http://controller-khi04.rapid.pk:8774/v2.1/98687873a146418eaeeb54a01693669f -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ef71182888b7ad3b8719ee8d48e37c6cd526e1f25f8395f733770917aead9b7b" -H "X-OpenStack-Nova-API-Version: 2.1" _http_log_request /usr/lib/python3/dist-packages/keystoneauth1/session.py:519 2021-10-08 12:06:14.121 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] RESP: [404] Connection: keep-alive Content-Length: 112 Content-Type: application/json Date: Fri, 08 Oct 2021 07:06:14 GMT X-Compute-Request-Id: req-d07e25b0-375f-48e6-ac4b-d76b41848e6a X-Openstack-Request-Id: req-d07e25b0-375f-48e6-ac4b-d76b41848e6a _http_log_response /usr/lib/python3/dist-packages/keystoneauth1/session.py:550 2021-10-08 12:06:14.121 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] RESP BODY: {"message": "The resource could not be found.<br /><br />\n\n\n", "code": "404 Not Found", "title": "Not Found"} _http_log_response /usr/lib/python3/dist-packages/keystoneauth1/session.py:582 2021-10-08 12:06:14.122 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] GET call to compute for http://controller-khi04.rapid.pk:8774/v2.1/98687873a146418eaeeb54a01693669f used request id req-d07e25b0-375f-48e6-ac4b-d76b41848e6a request /usr/lib/python3/dist-packages/keystoneauth1/session.py:954 2021-10-08 12:06:14.122 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] REQ: curl -g -i -X GET http://controller-khi04.rapid.pk:8774/v2.1/ -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ef71182888b7ad3b8719ee8d48e37c6cd526e1f25f8395f733770917aead9b7b" -H "X-OpenStack-Nova-API-Version: 2.1" _http_log_request /usr/lib/python3/dist-packages/keystoneauth1/session.py:519 2021-10-08 12:06:14.128 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] RESP: [200] Connection: keep-alive Content-Length: 399 Content-Type: application/json Date: Fri, 08 Oct 2021 07:06:14 GMT Openstack-Api-Version: compute 2.1 Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-9b1f2443-fdee-41dd-9139-57376afd7bef X-Openstack-Nova-Api-Version: 2.1 X-Openstack-Request-Id: req-9b1f2443-fdee-41dd-9139-57376afd7bef _http_log_response /usr/lib/python3/dist-packages/keystoneauth1/session.py:550 2021-10-08 12:06:14.128 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] RESP BODY: {"version": {"id": "v2.1", "status": "CURRENT", "version": "2.88", "min_version": "2.1", "updated": "2013-07-23T11:33:21Z", "links": [{"rel": "self", "href": "http://controller-khi04.rapid.pk:8774/v2.1/"}, {"rel": "describedby", "type": "text/html", "href": "http://docs.openstack.org/"}], "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2.1"}]}} _http_log_response /usr/lib/python3/dist-packages/keystoneauth1/session.py:582 2021-10-08 12:06:14.128 2064 DEBUG novaclient.v2.client [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] GET call to compute for http://controller-khi04.rapid.pk:8774/v2.1/ used request id req-9b1f2443-fdee-41dd-9139-57376afd7bef request /usr/lib/python3/dist-packages/keystoneauth1/session.py:954 2021-10-08 12:06:14.129 2064 INFO heat.engine.resource [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] CREATE: ServerGroup "worker_nodes_server_group" Stack "k8s-cluster6-7cnnuz4hrfrz" [5501d6a4-59a6-4f76-b25e-ec43e0822361] 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource Traceback (most recent call last): 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource File "/usr/lib/python3/dist-packages/heat/engine/resource.py", line 916, in _action_recorder 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource yield 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource File "/usr/lib/python3/dist-packages/heat/engine/resource.py", line 1028, in _do_action 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource yield from self.action_handler_task(action, args=handler_args) 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource File "/usr/lib/python3/dist-packages/heat/engine/resource.py", line 970, in action_handler_task 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource handler_data = handler(*args) 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource File "/usr/lib/python3/dist-packages/heat/engine/resources/openstack/nova/server_group.py", line 98, in handle_create 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource server_group = client.server_groups.create(name=name, 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource File "/usr/lib/python3/dist-packages/novaclient/api_versions.py", line 393, in substitution 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource return methods[-1].func(obj, *args, **kwargs) 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource TypeError: create() got an unexpected keyword argument 'policies' 2021-10-08 12:06:14.129 2064 ERROR heat.engine.resource 2021-10-08 12:06:14.143 2064 INFO heat.engine.stack [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] Stack CREATE FAILED (k8s-cluster6-7cnnuz4hrfrz): Resource CREATE failed: TypeError: resources.worker_nodes_server_group: create() got an unexpected keyword argument 'policies' 2021-10-08 12:06:14.146 2064 DEBUG heat.engine.stack [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] Persisting stack k8s-cluster6-7cnnuz4hrfrz status CREATE FAILED _send_notification_and_add_event /usr/lib/python3/dist-packages/heat/engine/stack.py:1109 2021-10-08 12:06:15.009 2061 INFO heat.engine.stack [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] Triggering resource 2434 for update 2021-10-08 12:06:15.040 2063 DEBUG heat.engine.worker [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] [88ec8f6f-7e10-4c6a-be97-03de82938eb2] Traversal cancelled; re-trigerring. check_resource /usr/lib/python3/dist-packages/heat/engine/worker.py:193 2021-10-08 12:06:16.016 2061 INFO heat.engine.stack [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] Triggering resource 2437 for update 2021-10-08 12:06:16.048 2061 DEBUG heat.engine.worker [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] [88ec8f6f-7e10-4c6a-be97-03de82938eb2] Traversal cancelled; re-trigerring. check_resource /usr/lib/python3/dist-packages/heat/engine/worker.py:193 2021-10-08 12:06:17.026 2061 INFO heat.engine.stack [req-31d11ee8-fc47-4399-b424-97adabf31331 admin admin - - -] Triggering resource 2443 for update 2021-10-08 12:06:17.066 2062 DEBUG heat.engine.worker [req-61cb3eba-0cf0-47f7-8fdb-8e9375888dc4 - - - - -] [88ec8f6f-7e10-4c6a-be97-03de82938eb2] Traversal cancelled; re-trigerring. check_resource /usr/lib/python3/dist-packages/heat/engine/worker.py:193 - Ammad

3 2

[neutron] East-West networking issue on DVR after failed attempt at starting a new instance
by J-P Methot 07 Oct '21

07 Oct '21

Hi, We use Openstack Wallaby installed through Kolla-ansible on this setup. Here's a quick rundown of the issue we just noticed: -We try popping an instance which fails because of a storage issue. -Nova tries to create the instance on 3 different nodes before failing. -We notice that instances on these 3 nodes and only those instances cannot connect to each other anymore. -Doing Tcpdump tests, we realize that pings are received by each instance, but never replied to. -Restarting the neutron-openvswitch-agent container fixes this issue. I suspect l2population might have something to do with this. Is the ARP table rebuilt when the openvswitch-agent is restarted? -- Jean-Philippe Méthot Senior Openstack system administrator Administrateur système Openstack sénior PlanetHoster inc.

2 1

[neutron] Drivers meeting agenda - 08.10.2021
by Lajos Katona 07 Oct '21

07 Oct '21

Hi Neutrinos, The agenda for tomorrow's drivers meeting is at [1]. We have 1 RFE to discuss: * https://bugs.launchpad.net/neutron/+bug/1946251 API: allow to disable anti-spoofing but not SGs [1] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda See you at the meeting tomorrow. Lajos Katona (lajoskatona)

1 0

RDO vSocial during the PTG
by Amy Marrich 07 Oct '21

07 Oct '21

Hi Everyone, I'm pleased to announce that RDO will be sponsoring a virtual social during the PTG, Thursday at 17:00 during the break. Last PTG's Trivia Social was a great success, but to do something different this time around we will be doing a virtual Escape Room. The room is a mixture of text and images so should be bandwidth friendly and we'll use Meetpad for the breakout rooms. We'll be doing an Intermediate level room <https://trappedintheweb.com/escape-rooms/cabin-fever>and the team that finishes first will receive prizes! Because I need to purchase passes you will need to register in advance at: https://eventyay.com/e/e7299da7 There is a team signup page you'll receive after registering where you can add your name to a team of 5-8 people. While we can definitely have more people participating in the teams then passes, the intent is to allow everyone to actively participate. Thanks, Amy (spotz)

1 0