September 2024 - openstack-discuss

[oslo.db][magnum] QueuePool hangs in Caracal
by Mohammed Naser 25 Sep '24

25 Sep '24

Hi there! The community has identified a bug (https://bugs.launchpad.net/magnum/+bug/2067345) which makes Magnum unusable / entirely broken in Caracal. There is a proposed workaround here: https://bugs.launchpad.net/magnum/+bug/2067345/comments/35 The majority of the issue seems to be around when the changes to remove autocommit were done, I've attempted to switch to enginefacade to prevent these issues (same as Ironic) but with no avail: https://review.opendev.org/c/openstack/magnum/+/927446 There is also a greenthread stacktrace there which shows where/how it's hanging, would it be possible to have someone who might have a bit more insight to help point us in the right direction? I'm more than happy to take this on and keep pushing it forward but I'm not sure if I know where the fix can go at this point. Thanks, Mohammed

2 1

[release][zun][kuryr-libnetwork][kuryr-kubernetes] Immediate action required for 2024.2 (Dalmatian) release
by Dmitriy Rabotyagov 25 Sep '24

25 Sep '24

Hi, As you might know, R-2 week where Release Candidates for all projects following cycle-with-rc cadence should be created has already passed. Nevertheless there are a couple of projects, which do have broken Zuul Jobs[1], which prevents them from being released (tagged with RC1 and create a stable/2024.2 branch). There is a hard deadline by the end of this week (September 27, 2024) to merge required fixes into projects and update corresponsive release patches [2][3][4] in order to be included into the Dalmatian release. Otherwise the Technical Committee will have to take action on the mentioned projects, which can include preventing them from being released and marking them as Inactive ones. So everyone interested in the future of these projects - please take a look at the gate health and help core teams out fixing outstanding issues. Core teams - please prioritise review of proposed patches or come up with fixes during this week. [1] https://review.opendev.org/q/topic:dalmatian-rc1-deadline+is:open [2] https://review.opendev.org/c/openstack/releases/+/928531 [3] https://review.opendev.org/c/openstack/releases/+/928532 [4] https://review.opendev.org/c/openstack/releases/+/928575

1 0

[manila] Propose Gireesh Awasthi to manila core
by Carlos Silva 25 Sep '24

25 Sep '24

Hello everyone, I would like to add Gireesh Awasthi to the OpenStack Manila core team. Gireesh started his OpenStack journey a couple of cycles ago, and caused great impact from the get go while working on some complex features that impacted all of the manila code base. He's also been consistently participative in the latest PTGs. With the knowledge acquired in the code base, he then started contributing more to reviews, and became a go-to person for providing feedback on the NetApp ONTAP driver changes, and/or third party driver changes. It is important to note that this is yet another step into maintaining a healthy community with people from different affiliations sharing the responsibility of maintaining an open source project. In case there are no objections, I will add him to the core team in 1 week from now. [1] https://bit.ly/manila-reviews-90-days Thank you! Regards, carloss

2 2

[cyborg][zun][masakari][tacker][venus] Pending removal of LegacyEngineFacade
by Stephen Finucane 24 Sep '24

24 Sep '24

o/ Just a heads up to the listed projects that oslo.db's LegacyEngineFacade is pending removal in the Epoxy cycle. I would encourage you to migrate asap to avoid a broken CI. For a minimal example of how to do this, I'd encourage you to look at [1]. Cheers, Stephen [1] https://review.opendev.org/c/openstack/mistral/+/926420

1 0

Looking forward to work with Real-world project!
by Artemio Mendoza 24 Sep '24

24 Sep '24

Hi OpenStackers, As a new OpenStack community member, I read your email very carefully and looking for an opportunity that I can support. After graduating from university, I got a BS degree in computer science. I have been working on web/mobile app development for 10 years and have some reasonable experience in AWS, Azure, and other cloud environments. But I was really interested in OpenStack cloud computing so I started researching this last year and I'm actively keeping an eye on this community email, and trying to find some clues and new ideas about what I am going to do. I'm especially interested in Ceph and VDI development based on OpenStack. For my experience, I have tried to set up devstack on my laptop(20 core i7th, 32GB RAM), and tried run Bumblebee ( https://github.com/NeCTAR-RC/bumblebee) but failed. :( So for now, I'm still going to learn OpenStack doc. But I want to practice myself by jumping into real-world projects. If you are interested in me or looking for someone who can collaborate/research, then I will absolutely dedicate myself to that as a volunteer. Looking forward to hearing many good suggestions. Please feel free to reach out to me through Skype (huknamatata21) or this number (+15124877569) Regards, Artemio (Hony)

1 0

[Neutron] Bug deputy Sept 16 - 23
by Jakub Libosvar 23 Sep '24

23 Sep '24

Hi, I was the bug deputy last week. Was calm, only 3 bugs reported. Here is the breakdown: High ---- * security-groups-rules-belongs-to-default-sg slows down SG GET operations - https://bugs.launchpad.net/neutron/+bug/2081173 - I marked it as high because it’s a performance regression Medium ------ * Tighten / improve rally SG tests to catch performance regressions - mostly a placeholder to improve rally scenarios to prevent regressing in performance - https://bugs.launchpad.net/neutron/+bug/2081108 Wishlist -------- * Neutron OVN support for CARP - https://bugs.launchpad.net/neutron/+bug/2081643 - sounds like a new feature but it also requires some enhancements in the core OVN first

1 0

[publiccloud-sig] Heads-Up: next meeting September 25th - 0700 UTC
by Felix Kronlage-Dammers 23 Sep '24

23 Sep '24

Hi everyone, We are adjusting the schedule for the publiccloud-sig and will switch to odd instead of even weeks. This Wednesday (September 25th) the next meeting of the publiccloud-sig is going to happen. Thanks to Artem (gtema) and Joern (joek-office) who helped prepare the meeting agenda for this wednesday: - Housekeeping - Upcoming vPTG - Reminder to sign up for PTG: https://openinfra.dev/ptg/ - IAM Federation - combination of functional requirements (every CSP is having unique use case so we want to find similarities and differencies to determine the roadmap for Keystone) If you’re interesting in IAM federation, be sure to join! We’ll be meeting at 0700 UTC here: https://meetpad.opendev.org/publiccloud-sig <https://meetpad.opendev.org/publiccloud-sig> See also here for all other details: https://wiki.openstack.org/wiki/PublicCloudSIG <https://wiki.openstack.org/wiki/PublicCloudSIG> See you on Wednesday! felix -- Felix Kronlage-Dammers Sovereign Cloud Stack — standardized, built and operated by many Ein Projekt der Open Source Business Alliance - Bundesverband für digitale Souveränität e.V. Tel.: +49-30-206539-205 | Matrix: @fkronlage:matrix.org | fkr(a)osb-alliance.com

1 0

Openstack power off/on process
by Michael Knox 23 Sep '24

23 Sep '24

Hey Folks. I am working through a scenario that requires us to have Openstack in a Pelican Case and deployed in the "field" on a semi regular basis. I guess, portal "edge cloud" if you will? The problem I am trying to clean up is the startup process. We use kolla-ansible and rocky with zed (though we have one with ubuntu and wallaby) in this specific use case. We do the shutdown nicely, kolla-ansible -i inventory stop, then power off the control nodes (we have 3 in the setup). The problem is on the start up. All the containers start and then we still *have* to run the kolla-ansible -i inventory mariadb_recovery step to get the cloud back into a usable state. No matter the order of shut down or start up, MariaDB seems to always need a recovery. Are there any people here doing this or something similar? Is there a more efficient startup process I am not aware of or should consider? The folks in the field aren't Openstack admins, so hoping to figure out a solution that is less dependent on their knowledge of Openstack's undercloud tooling. Thanks in advance Michael

2 2

[cinder][CI] Can't start zuul service
by xuq.fnstxz＠fujitsu.com 23 Sep '24

23 Sep '24

Hello every one, I'm building a CI system on my ubuntu 22 system. Now I've installed the zuul using 'pip install zuul' and configured it. But after running command 'zuul-scheduler', I saw a lot of errors like following in the log. It seems that there is something error in my config file that prevents access to the repo. > 2024-09-20 13:05:06,010 ERROR zuul.TenantParser: Error processing cat job > Traceback (most recent call last): > File "/home/stack/.local/lib/python3.10/site-packages/zuul/configloader.py", line 2157, in _cacheTenantYAML > self._processCatJob(abide, tenant, loading_errors, job, > File "/home/stack/.local/lib/python3.10/site-packages/zuul/configloader.py", line 2249, in _processCatJob > raise TimeoutError(f"Cat job {job} timed out; consider setting " > TimeoutError: Cat job <zuul.zk.event_queues.JobResultFuture object at 0x7fb770341510> timed out; consider setting merger.git_timeout in zuul.conf Following is my zuul.conf. > [zookeeper] > hosts=ZOOKEEPER_HOST > tls_cert=/cert/client-cert.pem > tls_key=/cert/client-key.pem > tls_ca=/cert/ca-cert.pem > > [database] > # Use variable interpolation to supply the password from the > # docker-compose file. > # https://zuul-ci.org/docs/zuul/latest/configuration.html > dburi=mysql+pymysql://DB_USER:DB_PASS@DB_HOST/ZUUL_DB > > [keystore] > password=secret > > [web] > listen_address=0.0.0.0 > port=9000 > root=http://localhost:9000 > log_config=/etc/zuul/logging.conf > > [webclient] > url=http://localhost:9000 > verify_ssl=false > > [scheduler] > tenant_config=/etc/zuul/main.yaml > log_config=/etc/zuul/logging.conf > [merger] > git_user_email=git_user(a)example.com > git_user_name=git_user > log_config=/etc/zuul/logging.conf > > [executor] > private_key_file=/home/stack/.ssh/id_rsa > default_username=executor_user > trusted_rw_paths=/srv/static/logs > > [connection gerrit] > driver=gerrit > server=review.opendev.org > user=git_user > sshkey=/ssh/id_rsa And the following is the tenant_config file. > - tenant: > name: myCI > source: > gerrit: > untrusted-projects: > - openstack/cinder Could you please tell me what I need to modify or add in the config file? Thanks and Regards, Inori.

2 2

[kolla] Weird upgrade procudere ?
by Michal Arbet 23 Sep '24

23 Sep '24

Hi Koalas, I am not sure but is this normal ? In rabbitmq.yml is this +++ b/ansible/rabbitmq.yml @@ -0,0 +1,115 @@ +--- +# For RabbitMQ we need to be careful about restarting services, to avoid losing quorum. +- name: Apply role rabbitmq + gather_facts: false + hosts: + - rabbitmq + - '&enable_rabbitmq_True' But I can see during the upgrade restart every node at the same moment and then ther is some try to do it better ... I mean is that restart before OK ? Thanks TASK [rabbitmq : Enable all stable feature flags] ***************************************************************************************************************************************************************** ok: [controller1] ok: [controller0] ok: [controller2] TASK [rabbitmq : Check rabbitmq containers] *********************************************************************************************************************************************************************** changed: [controller0] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'dockerhub.ultimum.io/kolla-dev/debian-rabbitmq:KB-2023.1', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}, 'rabbitmq_outward_management': {'enabled': False, 'mode': 'http', 'port': '15674', 'host_group': 'outward-rabbitmq'}, 'rabbitmq_outward_external': {'enabled': False, 'mode': 'tcp', 'external': True, 'port': '5674', 'host_group': 'outward-rabbitmq', 'frontend_tcp_extra': ['timeout client 1h'], 'backend_tcp_extra': ['timeout server 1h']}}}}) changed: [controller2] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'dockerhub.ultimum.io/kolla-dev/debian-rabbitmq:KB-2023.1', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}, 'rabbitmq_outward_management': {'enabled': False, 'mode': 'http', 'port': '15674', 'host_group': 'outward-rabbitmq'}, 'rabbitmq_outward_external': {'enabled': False, 'mode': 'tcp', 'external': True, 'port': '5674', 'host_group': 'outward-rabbitmq', 'frontend_tcp_extra': ['timeout client 1h'], 'backend_tcp_extra': ['timeout server 1h']}}}}) changed: [controller1] => (item={'key': 'rabbitmq', 'value': {'container_name': 'rabbitmq', 'group': 'rabbitmq', 'enabled': True, 'image': 'dockerhub.ultimum.io/kolla-dev/debian-rabbitmq:KB-2023.1', 'bootstrap_environment': {'KOLLA_BOOTSTRAP': None, 'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'environment': {'KOLLA_CONFIG_STRATEGY': 'COPY_ALWAYS', 'RABBITMQ_CLUSTER_COOKIE': 'ultimum', 'RABBITMQ_LOG_DIR': '/var/log/kolla/rabbitmq'}, 'volumes': ['/etc/kolla/rabbitmq/:/var/lib/kolla/config_files/:ro', '/etc/localtime:/etc/localtime:ro', '/etc/timezone:/etc/timezone:ro', 'rabbitmq:/var/lib/rabbitmq/', 'kolla_logs:/var/log/kolla/'], 'dimensions': {}, 'healthcheck': {'interval': '30', 'retries': '3', 'start_period': '5', 'test': ['CMD-SHELL', 'healthcheck_rabbitmq'], 'timeout': '30'}, 'haproxy': {'rabbitmq_management': {'enabled': 'yes', 'mode': 'http', 'port': '15672', 'host_group': 'rabbitmq'}, 'rabbitmq_outward_management': {'enabled': False, 'mode': 'http', 'port': '15674', 'host_group': 'outward-rabbitmq'}, 'rabbitmq_outward_external': {'enabled': False, 'mode': 'tcp', 'external': True, 'port': '5674', 'host_group': 'outward-rabbitmq', 'frontend_tcp_extra': ['timeout client 1h'], 'backend_tcp_extra': ['timeout server 1h']}}}}) RUNNING HANDLER [rabbitmq : Restart rabbitmq container] *********************************************************************************************************************************************************** [WARNING]: Failure using method (v2_playbook_on_handler_task_start) in callback plugin (<ansible.plugins.callback.ara_default.CallbackModule object at 0x7f66542e0100>): 'NoneType' object is not subscriptable changed: [controller0] changed: [controller1] changed: [controller2] PLAY [Restart rabbitmq services] ********************************************************************************************************************************************************************************** TASK [rabbitmq : Get info on RabbitMQ container] ****************************************************************************************************************************************************************** ok: [controller0] TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************************************************************************************************************************************************* changed: [controller0] TASK [rabbitmq : Restart rabbitmq container] ********************************************************************************************************************************************************************** changed: [controller0] TASK [rabbitmq : Waiting for rabbitmq to start] ******************************************************************************************************************************************************************* changed: [controller0] PLAY [Restart rabbitmq services] ********************************************************************************************************************************************************************************** TASK [rabbitmq : Get info on RabbitMQ container] ****************************************************************************************************************************************************************** ok: [controller1] TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************************************************************************************************************************************************* changed: [controller1] TASK [rabbitmq : Restart rabbitmq container] ********************************************************************************************************************************************************************** changed: [controller1] TASK [rabbitmq : Waiting for rabbitmq to start] ******************************************************************************************************************************************************************* changed: [controller1] PLAY [Restart rabbitmq services] ********************************************************************************************************************************************************************************** TASK [rabbitmq : Get info on RabbitMQ container] ****************************************************************************************************************************************************************** ok: [controller2] TASK [rabbitmq : Put RabbitMQ node into maintenance mode] ********************************************************************************************************************************************************* changed: [controller2] TASK [rabbitmq : Restart rabbitmq container] ********************************************************************************************************************************************************************** changed: [controller2] TASK [rabbitmq : Waiting for rabbitmq to start] ******************************************************************************************************************************************************************* changed: [controller2] PLAY [Apply rabbitmq post-configuration] ************************************************************************************************************************************************************************** TASK [Include rabbitmq post-deploy.yml] *************************************************************************************************************************************************************************** TASK [rabbitmq : Enable all stable feature flags] ************************* Michal Arbet Openstack Engineer Ultimum Technologies a.s. Na Poříčí 1047/26, 11000 Praha 1 Czech Republic +420 604 228 897 michal.arbet(a)ultimum.io *https://ultimum.io <https://ultimum.io/>* LinkedIn <https://www.linkedin.com/company/ultimum-technologies> | Twitter <https://twitter.com/ultimumtech> | Facebook <https://www.facebook.com/ultimumtechnologies/timeline>

1 0