July 2022 - openstack-discuss - lists.openstack.org

[dev][requirements][tripleo] Return of the revenge of lockfile strikes back part II
by Jeremy Stanley 01 Aug '22

01 Aug '22

It became apparent in a Python community discussion[0] yesterday that lockfile has been designated as a "critical project" by PyPI, even though it was effectively abandoned in 2010. Because our release automation account is listed as one of its maintainers, I looked into whether we still need it for anything... For those who have been around here a while, you may recall that the OpenStack project temporarily assumed maintenance[1] of lockfile in late 2014 and uploaded a few new releases for it, as a stop-gap until we could replace our uses with oslo.concurrency. That work was completed[2] early in the Liberty development cycle. Unfortunately for us, that's not the end of the story. I looked yesterday expecting to see that we've not needed lockfile for 7 years, and was disappointed to discover it's still in our constraints list. Why? After much wailing and gnashing of teeth and manually installing multiple bisections of the requirements list, I narrowed it down to one dependency: ansible-runner. Apparently, ansible-runner currently depends[3] on python-daemon, which still has a dependency on lockfile[4]. Our uses of ansible-runner seem to be pretty much limited to TripleO repositories (hence tagging them in the subject), so it's possible they could find an alternative to it and solve this dilemma. Optionally, we could try to help the ansible-runner or python-daemon maintainers with new implementations of the problem dependencies as a way out. Whatever path we take, we're long overdue. The reasons we moved off lockfile ages ago are still there, and the risk to us has only continued to increase in the meantime. I'm open to suggestions, but we really ought to make sure we have it out of our constraints list by the Zed release. [0] https://discuss.python.org/t/17219 [1] https://lists.openstack.org/pipermail/openstack-dev/2014-June/038387.html [2] https://review.openstack.org/151224 [3] https://github.com/ansible/ansible-runner/issues/379 [4] https://pagure.io/python-daemon/issue/42 -- Jeremy Stanley

4 7

Openstack routed provider network
by Ignazio Cassano 31 Jul '22

31 Jul '22

Hello All, I am reading documentation about routed provider network. It reports: " Routed provider networks imply that compute nodes reside on different segments. " What does mean ? What is a segment it this case ? Thanks for helping me" Ignazio

3 7

[all][tc] What's happening in Technical Committee: summary 2022 July 31: Reading: 5 min
by Ghanshyam Mann 31 Jul '22

31 Jul '22

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * We had this week's meeting on July 28. Most of the meeting discussions are summarized in this email. Meeting full logs are available @https://meetings.opendev.org/meetings/tc/2022/tc.2022-07-28-15.00.log.html * Next TC weekly meeting will be on 4 Aug Thursday at 15:00 UTC, feel free to add the topic on the agenda[1] by Aug 3. 2. What we completed this week: ========================= * Updates to the RBAC community wide for focusing on 'reader' role[2] * Added Skyline as Emerging Technology[3]. 3. Activities In progress: ================== TC Tracker for Zed cycle ------------------------------ * Zed tracker etherpad includes the TC working items[4], Two are completed and others items are in-progress. Open Reviews ----------------- * Four open reviews for ongoing activities[5]. 2021 User Survey TC Question Analysis ----------------------------------------------- No update on this. The survey summary is up for review[6]. Feel free to check and provide feedback. Zed cycle Leaderless projects ---------------------------------- Dale Smith volunteer to be PTL for Adjutant project [7] Fixing Zuul config error ---------------------------- Requesting projects with zuul config error to look into those and fix them which should not take much time[8][9]. Project updates ------------------- * Add charmed k8s operators to OpenStack Charms[10] 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[11]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [12] 3. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://review.opendev.org/c/openstack/governance/+/847418 [3] https://review.opendev.org/c/openstack/governance/+/849155 [4] https://etherpad.opendev.org/p/tc-zed-tracker [5] https://review.opendev.org/q/projects:openstack/governance+status:open [6] https://review.opendev.org/c/openstack/governance/+/836888 [7] https://review.opendev.org/c/openstack/governance/+/849606 [8] https://etherpad.opendev.org/p/zuul-config-error-openstack [9] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html [10] https://review.opendev.org/c/openstack/governance/+/849997 [11] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [12] http://eavesdrop.openstack.org/#Technical_Committee_Meeting -gmann

1 0

Workflow based VM provisioning for Openstack
by KK CHN 29 Jul '22

29 Jul '22

List, 1. Does anybody using the workflow based front end tools for VM requisition, approval and provisioning for automating the requests from various users ? (The users can be or cannot be from backend AD/LDAP) 2. Or do we need to code from scratch to integrate such a mechanism(Do Horizon dashboard need to be customized for this workflow based approval and auto provisioning and de provisioning of VMs ? ) . Where to start ? Pls guide me on how to achieve this functionality for openstack IaaS cloud infrastructure. ( we are using Ussuri version). Thanks in advance, Krish

1 0

[TripleO] - Overcloud Wallaby Deployment Failing with SSL and DNS
by Anirudh Gupta 29 Jul '22

29 Jul '22

Hi Team, I was trying to install Openstack Wallaby Release with Tripleo. I need to enable SSL with DNS. Without DNS, I am able to install overcloud successfully. But using DNS I am facing some authentication issues although the public VIP is successfully resolved by my DNS Server. I found a similar issue at Bugzilla https://bugs.launchpad.net/tripleo/+bug/1982996 Has anyone tried installing Wallaby with SSL and DNS? If yes, can you please suggest some pointers to resolve this? Regards Anirudh Gupta

1 0

Ansible playbook failing
by Derek O keeffe 29 Jul '22

29 Jul '22

Hi all, I have ran the OSA playbooks to completion on more than one occasion but recently I'm having an issue I can't figure out so if anyone could shed some light on it it would be much appreciated. When running "openstack-ansible setup-openstack.yml" I get to the task named "TASK [python_venv_build : Create wheel directory on the build host]" and I get the following error: fatal: [infra1_gnocchi_container-7c40503c -> infra1_repo_container-017aea8f(xx.xx.xx.xx)]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "msg": "chown failed: failed to look up user nginx", "owner": "root", "path": "/var/www", "size": 4096, "state": "directory", "uid": 0} I cannot seem to find anything about this and didn't see this error when running the playbooks previously. Thanks in advance for any suggestions. Regards,Derek

3 2

[ops] tentative plans for ops meetup on Friday after PTG
by Chris Morgan 28 Jul '22

28 Jul '22

Hi All, Please see this tweet, we are in the early stages of planning an ops meetup on an extra day (Friday) of PTG at the same venue: https://twitter.com/osopsmeetup/status/1552788675632799744?s=20&t=aEBpjhm6t… Event link : https://openinfra.dev/ptg/ early bird pricing currently available! We ask interested openstack operators to follow that twitter account, we keep it lean and spam free. We are also experimenting with also sharing news on LinkedIn if that works better for some of you OpenStack operators. You can connect with me (Chris Morgan, Bloomberg) there if you wish. Chris -- Chris Morgan <mihalis68(a)gmail.com>

2 1

[all][stable] Propose to EOL Pike series
by Előd Illés 28 Jul '22

28 Jul '22

Hi, It seems that time has come to (mass)transition Pike to End of Life due to lack of maintainers (and backports + reviews; see the list of recent changes [1]). Some core projects have made this step already. Others are still open but not really maintained, which can be seen by the number of daily periodic stable job failures on pike branch, which is around 40 for several months now. (By the way, periodic stable job failures number is constantly high [2], due to some projects which seem to be abandoned completely (murano, *-powervm), but that is another story). Please let me know what do you think, or indicate if any of the projects wants to keep its pike branch open / in Extended Maintenance. [1] https://review.opendev.org/q/branch:stable/pike [2] http://lists.openstack.org/pipermail/openstack-stable-maint/2022-May/thread… Thanks, Előd

1 1

Regarding Application Credential in Open Stack XENA
by Adivya Singh 28 Jul '22

28 Jul '22

hi Team, There is a use case, where a user wants to Create CI/CD pipeline using Application Credentials of Open Stack, Henceforth we tried Create an application with a role with a secret Key. but it is failing with the below output, The user wants to push the qcow2 image from his system to Open Stack. Using auth plugin: v3 application credential /usr/lib/python3.7/socket.py:660: ResourceWarning: unclosed <socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.17.0.3', 55738), raddr=('10.188.2.9', 5000)> self._sock = None ResourceWarning: Enable tracemalloc to get the object allocation traceback Not Found (HTTP 404) (Request-ID: req-217c9f28-d6a6-4649-adf9-2d9a4b965b3f) END return value: 1 it failed with a below result Regards Adivya Singh

2 3

[Neutron] Aug 1 - Aug 15 - team and drivers meeting CANCELLED
by Lajos Katona 28 Jul '22

28 Jul '22

Hi, I will be on PTO for the next 2 weeks, so as we discussed at the last team meeting, let's cancel the meetings for these weeks. Have a great summer time :-) Lajos Katona (lajoskatona)

1 0

[all][tc] Technical Committee next weekly meeting on 28 July 2022 at 1500 UTC
by Ghanshyam Mann 28 Jul '22

28 Jul '22

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 28 July 2022, at 1500 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Wednesday, 27 July at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1

[neutron] Drivers meeting agenda - 29.07.2022.
by Lajos Katona 28 Jul '22

28 Jul '22

Hi Neutron Drivers, The agenda for tomorrow's drivers meeting is at [1]. * [RFE] OVN E/W routing for external (baremetal) VLAN ports (#link https://bugs.launchpad.net/neutron/+bug/1982541) [1] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda See you at the meeting tomorrow. Lajos Katona (lajoskatona)

1 0

[ironic] Revise Ironic Vision Meeting
by Iury Gregory 28 Jul '22

28 Jul '22

Hello ironicers, During the upstream meeting today we have scheduled the meeting to revise the vision of our project. The meeting will happen tomorrow at 15:00 UTC, details about the meeting are in the etherpad [1]. See you tomorrow! [1] https://etherpad.opendev.org/p/revise-ironic-vision -- *Att[]'s* *Iury Gregory Melo Ferreira * *MSc in Computer Science at UFCG* *Ironic PTL * *Senior Software Engineer at Red Hat Brazil* *Social*: https://www.linkedin.com/in/iurygregory *E-mail: iurygregory(a)gmail.com <iurygregory(a)gmail.com>*

1 1

openstack router with flat
by Parsa Aminian 28 Jul '22

28 Jul '22

hello is it possible to assign valid ip to openstack router directly without nat ? as I know openstack need invalid fix ip when using router and valid ip should be added as float ip .

2 3

Manila/NFS support for Zun
by Vaibhav 27 Jul '22

27 Jul '22

Hi, I want to mount my Manila shares on containers managed by Zun. I can see a Fuxi project and driver for this but it is discontinued now. I want to have a shared file system to be mounted on multiple containers simultaneously, it is not possible with cinder. Is there any alternative to Fuxi? Or can it work with yoga release ? Please advise and give a suggestion. Regards, Vaibhav

2 3

RAM and Storage requirements for Openstack cloud
by Mahendra Paipuri 27 Jul '22

27 Jul '22

Hello all, We are going to deploy Openstack cloud with researchers as primary target users. We will have around 100 GPUs with 12-15 servers with Infiniband interconnect. We still do not know the exact spec of servers nor GPUs but mostly we will have A100s and Intel Xeon processors. What sort of RAM and Storage requirements we need for a cluster of this size? Of course, this depends a lot on use cases and this cloud will be primarily used for HPC and AI. For the storage, we are mainly interested in the block storage requirements for provisioning VMs. We will most probably have a shared parallel file system as scratch and project spaces. Is there any rule of thumb to get to the RAM and storage requirement numbers based on compute infrastructure we will have? If we can estimate a sort of "lower bound" that would be really helpful for us. If anyone have clusters of this size at your organizations and if you can share the RAM ans storage details of your clouds, that would be very useful for us too. Thanks a lot and have a great day!! Regards Mahendra

3 3

Customization of scheduler manager
by Levon Melikbekjan 27 Jul '22

27 Jul '22

Hi all, as part of my thesis, I modified the Openstack version Train with the intention of sharing resources, which are not in use with other users to ensure maximum utilization. So far everything is working fine except for the last step. Let me first explain my work. The system works according to the following rules: 1. Users who own compute hosts within the private cloud have the highest priority on their hosts. 2. Users who do not own hosts within the private cloud are low priority users who can instantiate their virtual machine on unused resources (on the hosts that have an owner). 3. If the owner wants to use his resources that are currently occupied, the foreign VM must be suspended to free up resources for the owners VM. 4. An owner is a low priority user on foreign hosts. Everything works automatically and generically, but in step 3 I do not suspend those VMs, I delete them. I want the VMs to be suspended to be able to restart them with the intention of being able to continue processes that are paused, and I know there is maybe a REST API functions that provides this functionality. A user should be able to continue his work after resources become free again. It would be annoying if long-running processes were killed. My question is this: Is the suspend function the right choice? Are the resources released when I use the suspend function? Thank you & Best regards, Levon Melikbekjan

2 2

[dev][horizon][keystone]
by Sergey Drozdov 27 Jul '22

27 Jul '22

To whom it may concern, I have previously sen out an email about this topic but just wanted to run this by community again incase it was missed. I have the following issue. The firm I am currently working at is running OpenStack at sale with circa 6000 different projects. Whenever we try to access a projects tab via horizon we experience a timeout (accessing through the API works fine). For the horizon team, we were hoping to propose something akin to filtering/dynamic listing in order to rectify the issue. For the keystone team, we were wondering whether there is anything we can do with the API in order to simplify the aforementioned horizon proposal; we are hoping to get both teams on board. We are ready to open up a bug report and start subsequent development should this be supported by both teams! I am available on the both Openstack-horizon and Openstack-keystone irc channels under the nickname sdrozdov, please feel free to reach out. Best Regards, Sergey Drozdov Software Engineer The Hut Group

3 2

[cinder] Bug deputy report for week of 07-27-2022
by Sofia Enriquez 27 Jul '22

27 Jul '22

This is a bug report from 07-20-2022 to 07-27-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium - https://bugs.launchpad.net/cinder/+bug/1982436 "Reimage volume API image is invalid, the status should not be downloading." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982848 "Creating from source volume tries to create it multiple times if rekeying fails." Unassigned. Low - https://bugs.launchpad.net/cinder/+bug/1982350 "Infinidat Cinder driver multi-attach feature is broken." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982405 "Infinidat Cinder driver generic volume migration feature is broken." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982568 "PowerMax doesn´t work with the workload in extra specs." Unassigned. - https://bugs.launchpad.net/cinder/+bug/1982891 "NFS Attach Encrypted fails only on the first attempt." Unassigned. Cheers, -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[cinder] This week's meeting will be in video+IRC
by Rajat Dhasmana 27 Jul '22

27 Jul '22

Hello Argonauts, This week's meeting (today) will be held in video + IRC mode with details as follows: Date: 27th July, 2022 Time: 1400 UTC Meeting link: https://bluejeans.com/556681290 IRC Channel: #openstack-meeting-alt Make sure you're connected to both the bluejeans meeting and IRC since we do roll call and also (sometimes) summarize the discussion points on IRC. Thanks and regards Rajat Dhasmana

1 0

[Kolla][14.1.0][Yoga][Fluentd] fluentd container restarting indefinitely
by Vishwanath 26 Jul '22

26 Jul '22

Hello all, I have upgraded openstack, we are currently running on 14.1.0. I noticed fluentd container restarting indefinitely. The message I see under /var/log/kolla/fluentd/fluentd.log is as follows, Any thoughts on how to fix this ? I noticed a similar issue back in 2017 from this post - https://bugs.launchpad.net/kolla-ansible/+bug/1663126 *error log:* *2022-07-06 21:20:42 +0000 [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="'format' parameter is required"* *full logs:* 2022-07-06 21:20:42 +0000 [info]: parsing config file is succeeded path="/etc/td-agent/td-agent.conf" 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '5.2.3' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '4.1.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-grep' version '0.3.4' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-grok-parser' version '2.6.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-kafka' version '0.14.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-parser' version '0.6.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus' version '2.0.3' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.8.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus_pushgateway' version '0.0.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-record-modifier' version '2.1.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.3.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-s3' version '1.4.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-systemd' version '1.0.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-td' version '1.1.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.2.5' 2022-07-06 21:20:42 +0000 [info]: gem 'fluentd' version '1.11.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluentd' version '0.12.43' 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf97620 @keys="programname">, /^(cinder-api-access|cloudkitty-api-access|gnocchi-api-access|horizon-access|keystone-apache-admin-access|keystone-apache-public-access|monasca-api-access|octavia-api-access|placement-api-access)$/, "", "apache_access", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96f90 @keys="programname">, /^(aodh_wsgi_access|barbican_api_uwsgi_access|zun_api_wsgi_access|vitrage_wsgi_access)$/, "", "wsgi_access", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96950 @keys="programname">, /^(nova-api|nova-compute|nova-compute-ironic|nova-conductor|nova-manage|nova-novncproxy|nova-scheduler|nova-placement-api|placement-api|privsep-helper)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96310 @keys="programname">, /^(sahara-api|sahara-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95cd0 @keys="programname">, /^(neutron-server|neutron-openvswitch-agent|neutron-ns-metadata-proxy|neutron-metadata-agent|neutron-l3-agent|neutron-dhcp-agent)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95690 @keys="programname">, /^(magnum-conductor|magnum-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95050 @keys="programname">, /^(keystone)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf94a10 @keys="programname">, /^(heat-engine|heat-api|heat-api-cfn)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf943d0 @keys="programname">, /^(glance-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabf850 @keys="programname">, /^(cloudkitty-storage-init|cloudkitty-processor|cloudkitty-dbsync|cloudkitty-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabe978 @keys="programname">, /^(ceilometer-polling|ceilometer-agent-notification)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabdcd0 @keys="programname">, /^(barbican-api|barbican-worker|barbican-keystone-listener|barbican-db-manage|app)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabc4e8 @keys="programname">, /^(aodh-notifier|aodh-listener|aodh-evaluator|aodh-dbsync)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9fa50 @keys="programname">, /^(cyborg-api|cyborg-conductor|cyborg-agent)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9f410 @keys="programname">, /^(cinder-api|cinder-scheduler|cinder-manage|cinder-volume|cinder-backup|privsep-helper)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9edd0 @keys="programname">, /^(mistral-server|mistral-engine|mistral-executor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9e790 @keys="programname">, /^(designate-api|designate-central|designate-manage|designate-mdns|designate-sink|designate-worker)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9e150 @keys="programname">, /^(manila-api|manila-data|manila-manage|manila-share|manila-scheduler)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9db10 @keys="programname">, /^(trove-api|trove-conductor|trove-manage|trove-taskmanager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9d4d0 @keys="programname">, /^(murano-api|murano-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9ce90 @keys="programname">, /^(senlin-api|senlin-conductor|senlin-engine|senlin-health-manager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9c850 @keys="programname">, /^(watcher-api|watcher-applier|watcher-db-manage|watcher-decision-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9c210 @keys="programname">, /^(freezer-api|freezer-api_access|freezer-manage)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab7880 @keys="programname">, /^(octavia-api|octavia-health-manager|octavia-housekeeping|octavia-worker)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab6ef8 @keys="programname">, /^(zun-api|zun-compute|zun-cni-daemon)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab5918 @keys="programname">, /^(kuryr-server)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfabe90 @keys="programname">, /^(gnocchi-api|gnocchi-statsd|gnocchi-metricd|gnocchi-upgrade)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfab850 @keys="programname">, /^(ironic-api|ironic-conductor|ironic-inspector)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfab210 @keys="programname">, /^(tacker-server|tacker-conductor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfaabd0 @keys="programname">, /^(vitrage-ml|vitrage-notifier|vitrage-graph|vitrage-persistor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfaa590 @keys="programname">, /^(blazar-api|blazar-manager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa9f50 @keys="programname">, /^(monasca-api|monasca-notification|monasca-persister|agent-collector|agent-forwarder|agent-statsd)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa9910 @keys="programname">, /^(masakari-engine|masakari-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa92d0 @keys="programname">, /.+/, "", "unmatched", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: Payload [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfc9cb0 @keys="Payload">, /^\d{6}/, "", "infra.mariadb.mysqld_safe", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: Payload [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfc9670 @keys="Payload">, /^\d{4}-\d{2}-\d{2}/, "", "infra.mariadb.mysqld", nil] *2022-07-06 21:20:42 +0000 [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="'format' parameter is required"* Thanks Vish

3 4

[nova] hw_qemu_guest_agent image metadata property
by John Ratliff 26 Jul '22

26 Jul '22

We forgot to set this property on our image before creating several servers in our openstack cluster. I tried adding this property to the volume of one of the hosts and shutting it down / turning it back on, but it didn’t help. I found this blog post showing one way that worked, but it requires manual database editing. I was hoping for something a bit less typo-prone, like something in the openstack cli. https://www.thenoccave.com/2021/07/openstack-qemu-guest-tools-after-creatio… I can automate the above with ansible if that’s the only way, but if someone has a better suggestion that doesn’t involve recreating our instances, I would appreciate it. Thanks. --John Ratliff

3 3

[dev][security-sig][tc] Please follow up on privately reported defects
by Jeremy Stanley 26 Jul '22

26 Jul '22

First, a huge thank you to everyone who is staying on top of reports of suspected security vulnerabilities! Unfortunately, not everyone has been, which is the reason for this E-mail. It's common practice that, if someone finds a problem in software which they think might be an exploitable security vulnerability, they report it initially in private in order to give the project's maintainers an opportunity to correct things and have patches ready before it becomes common knowledge. This works okay as long as people actually look at these privately reported bugs (or at the project's bugs at all). For OpenStack deliverables whose maintainers opt them into VMT oversight[*], these private reports are initially handled by a vulnerability coordinator in order to make sure that they're probably reported against the correct project, that the project maintainers who have volunteered to handle those sorts of reports are correctly subscribed, and that everyone is reminded of the ground rules and timetable for resolving reports under such an embargo. For other OpenStack deliverables, VMT members may still weigh in on those private reports and offer assistance or guidance on handling and reporting procedures. Our VMT members do not, however, have sufficient time in their day to keep individually reaching out to project maintainers in order to remind them to do their part. OpenStack is a community which has optimized around transparency and public collaboration, so it's not surprising that confirming bugs and reviewing changes in private is clunky and unpleasant. This is, if anything, a reason to prioritize triaging private bug reports in order to make sure they're really a bug (not just a misunderstanding or misconfiguration), and represent a severe enough risk to warrant continued handling in secret. Many of the private bug reports currently pending could probably be switched to public and even perhaps closed today, if maintainers for their projects would just find a moment to take a look at them. For the ones which can't be handled right away, at least leave a quick comment letting the reporter and the VMT members know you're taking a look, or any first impressions or questions you might have. If you're interested in helping a project resolve reported vulnerabilities and aren't yet a member of their security review team in the appropriate bug tracker (usually *-coresec in LP or openstack-security-* in SB), then please reach out to the appropriate PTL and let them know. If you're a PTL and you were never made a member of the security review team for your project or are having trouble adding willing volunteers, please follow up here on the ML or feel free to reach out to me directly for assistance. For those who read this far, thank you for your time, and please remember to follow up on those bugs! [*] https://security.openstack.org/repos-overseen.html -- Jeremy Stanley

1 0

[nova] Hold your rechecks
by Sylvain Bauza 26 Jul '22

26 Jul '22

We're currently investigating a quite impacting issue in both nova-next and ovs-hybrid-plug jobs that prevent Zuul to be happy. https://bugs.launchpad.net/nova/+bug/1940425 In the meantime, as the failure rate is pretty high, doing rechecks (against this bug number of course, you already know to NOT do blind rechecks [1]) doen't help and just consumes constrained CI resources for a very little and unpredictable gain. Thanks, -Sylvain

2 3

[kolla] RabbitMQ High Availability
by Tan Tran Trong 26 Jul '22

26 Jul '22

Hello, I'm trying to figure out how to configure RabbitMQ to make it high available. I have 3 controller nodes and 2 compute nodes, deployed with kolla with mostly default configuration. The RabbitMQ set to ha-all for all queues on all nodes, amqp_durable_queues = True My problem is when I shutdown 1 controller node (or 1 RabbitMQ container) (master or slave) the whole cluster becomes unstable. Some instances can not be created, it is stuck on Scheduling, Block Device Mapping, the volumes not shown or are stuck on creating, the compute node reported dead randomly,... I'm looking for documentation to know how Openstack using RabbitMQ, Openstack behavior when RabbitMQ node down and way to make RabbitMQ HA in a stable way. Do you have any recommendation? TIA, Tan

5 6