- openstack-discuss - lists.openstack.org

[tacker] Critical bug report and backport the fix
by Yuta Kazato 06 Oct '22

06 Oct '22

Yasufumi, Ueha, Tacker and Release management team Hi, thanks for your agreements and supports it this issue. We could backport fix patches to stable/zed. I'm glad to release Openstack Zed:) https://releases.openstack.org/zed/ See you next Antelope vPTG! Yuta > Hi Yuta and Yasufumi, > > +1 > > And we have a patch for another critical bug related with pm interface. > The bug report [1] and the fix patch [2] have been already posted. > This patch also requires a backport to stable/zed. > > [1]https://bugs.launchpad.net/tacker/+bug/1990828 > [2]https://review.opendev.org/c/openstack/tacker/+/859377 > > Best Regards, > Ueha > > -----Original Message----- > From: Yasufumi Ogawa <yasufum.o at gmail.com> > Sent: Tuesday, September 27, 2022 10:42 AM > To: openstack-discuss at lists.openstack.org > Subject: Re: [tacker] Critical bug report and backport the fix > > Hi Yuta, > > On 2022/09/26 16:57, Yuta Kazato wrote: > > Hi tacker team, > > > > As you know, new bug report #1990793 [1] related to K8s resource name > > and v2 API is submitted by Masaki. > > The bug will appear if K8s resource name contains `-`. > > > > I think this is a critical issue because users often set resource > > names that contain `-`. > Agree. > > > Fortunately, the fix patch [2] has already been submitted. > > > > I suggest that we should backport the fix patch to the stable/zed > > branch before Zed release. > > What do you think? > We should fix the issue in stable/zed, or this k8s support doesn't work for many usecases. > > Yasufumi > > > > [1] https://bugs.launchpad.net/tacker/+bug/1990793 > > [2] https://review.opendev.org/c/openstack/tacker/+/859206 > > > > Yuta > > -- Yuta Kazato (風戸雄太) NTT Network Innovation Center. tel: +81-422-59-6754 mail:yuta.kazato.nw@hco.ntt.co.jp

1 0

OpenStack Zed is officially released!
by Előd Illés 05 Oct '22

05 Oct '22

Hello OpenStack community, The official OpenStack Zed release announcement has been sent out: http://lists.openstack.org/pipermail/openstack-announce/2022-October/002061… Thanks to all who were a part of the Zed development cycle! This marks the official opening of the openstack/releases repository for 2023.1 Antelope releases, and freezes are now lifted. stable/zed is now a fully normal stable branch, and the normal stable policy applies from now on. Thanks, Előd Illés and the Release Management team

5 4

[release][ironic] Release desired for Ironic bugfix/N branches
by Jay Faulkner 05 Oct '22

05 Oct '22

Hey all, I was attempting to perform a release of all maintained Ironic branches. The long term support branches cut as part of the integrated OpenStack release have been requested via gerrit, as documented ( https://review.opendev.org/c/openstack/releases/+/860125 ). We have intermediate bugfix releases as well, and I was hoping to get patch releases cut from these as well. As far as I can tell, there is no automation for performing these releases, or an official place to request them. If this is wrong; please correct me and I'm happy to go through the proper process. We know that the majority of consumers pull these from git directly; but checking pypi release notes, we had over 6000 downloads of the 21.0.0 and 20.2.0 releases during the 2/4 months of the Zed cycle they had respectively been released, so I do think there's value in releasing these even if it might be a small amount of manual effort. Below is a list of the Ironic projects, and associated bugfix/ branches I'd like to have a patch (bugfix) release cut for: ironic - bugfix/21.0 - bugfix/20.2 - bugfix/19.0 - bugfix/18.1 ironic-inspector - bugfix/11.0 - bugfix/10.12 - bugfix/10.9 - bugfix/10.7 ironic-python-agent - bugfix/9.0 - bugfix/8.6 - bugfix/8.3 - bugfix/8.1 Thanks, Jay Faulkner

5 8

[Swift][Ussuri] Erasure Coding Quarantines
by Reid Guyett 05 Oct '22

05 Oct '22

Hello, I'm not sure if it is related, but I am testing reimaging a node from Ubuntu 18.04 to 20.04 (Cloud Archive Ussuri 2.25.1 to Focal Repo Ussuri 2.25.2) in a 3-node cluster. I have a lot of servers to upgrade, and the environments will be mixed for a while, so I have left this mixed for a week. Now the 18.04 servers are starting to accumulate quarantined EC objects. The 20.04 server has log messages indicating that it is unable to get enough responses from the reconstructor. The 18.04 servers have a couple EC messages. "...liberasurecode[30807]: Invalid fragment header information!" followed by "...object-server: Quarantined object /srv/node/d9/objects-4/10321/b2e/50a3dce515aafc6f222824ec5c7dfb2e/1664002866.33100#8#d.data: Invalid EC metadata at offset 0x0 Is there any thing you can think of that would cause this issue? My steps to reproduce: 1. Create a container in an EC policy 2. Upload object to EC container 3. Wait a bit of time (It looks like the object-server is quarantining but not sure on the trigger) 4. Try to download the file and it will give a 504 Looking at python3-swift dependencies and the package versions I thought may affect this: 20.04 libjerasure2 = 2.0.0+2017.04.10.git.de1739cc84-1 python3-pyeclib = 1.6.0-6build1 python3-xattr = 0.9.6-1.1 18.04 libjerasure2 = 2.0.0+2017.04.10.git.de1739cc84-1 python3-pyeclib = 1.3.1-1ubuntu3 python3-xattr = 0.9.2-0ubuntu1 Thanks! Reid Important Notice: This email is intended to be received only by persons entitled to receive the confidential and legally privileged information it presumptively contains, and this notice constitutes identification as such. Any reading, disclosure, copying, distribution or use of this information by or to someone who is not the intended recipient, is prohibited. If you received this email in error, please notify us immediately at legal(a)kaseya.com, and then delete it. To opt-out of receiving emails Please click here<https://info.kaseya.com/email-subscription-center.html>. The term 'this e-mail' includes any and all attachments.

3 6

Bug Report - 10-05-2022
by Sofia Enriquez 05 Oct '22

05 Oct '22

This is a bug report from 09-28-2022 to 10-05-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Low - https://bugs.launchpad.net/cinder/+bug/1991634 "Toyou drivers report allocated_capacity_gb." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1991217 "[docs] Unsupported option in docs for cinder-manage quota check/sync." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1991154 "[docs] Service tokens documentation is misleading." Fix proposed to master. Cheers, -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[kolla-ansible] How to recover from unfinished upgrade
by wodel youchi 05 Oct '22

05 Oct '22

Hi, I am testing the upgrade from xena to yoga and I made a mistake in globals.yml, I forgot to specify the correct name of gnocchi ceph pool, so my deployment went wrong. I interrupted the deployment Ctrl+C I corrected the mistake, then I restarted the upgrade and it got stuck somewhere else, but I couldn't find where, I interrupted then restarted the deployment again and it got stuck at the same place. My questions : - Is there a way to rollback the upgrade in case of a problem, then start over? - What is the best way to restart a broken upgrade process? Regards.

2 2

[barbican] New team meeting time
by Grzegorz Grasza 05 Oct '22

05 Oct '22

Hi Team, At our last meeting, it was proposed to move the meeting forward 1 hour (an hour early), from 1300 to 1200 UTC. [1] If there are no objections, I'll be making the change by the end of the week, before the next meeting takes place. / Greg [1] https://meetings.opendev.org/meetings/barbican/2022/barbican.2022-10-04-13.…

1 0

[horizon] Cancelling Today's Weekly meeting
by vishal manchanda 05 Oct '22

05 Oct '22

Hello Team, Since there are no agenda items [1] to discuss for today's horizon weekly meeting. Also, Today is a holiday for me. So let's cancel today's weekly meeting. Thanks & regards, Vishal Manchanda(irc:vishalmanchanda) [1] https://etherpad.opendev.org/p/horizon-release-priorities#L38

1 0

[TripleO] TripleO Antelope PTG Topics
by Rabi Mishra 05 Oct '22

05 Oct '22

Hi All, Please add your session proposals to this etherpad[1]. We'll reserve time allocation based on proposed topics and work out a schedule in the coming weeks. [1] https://etherpad.opendev.org/p/tripleo-antelope-topics -- Regards, Rabi Mishra

2 4

[I18n] Zanata status + call for volunteers on Weblate migration
by Ian Y. Choi 05 Oct '22

05 Oct '22

Hi all, First, thank you all for contributing to OpenStack with globalization by contributing translations, coordinating translations with artifacts, and making sure that those translations are shipped with releases to all over the world (we are calling it I18n - Internationalization). While OpenStack I18n could be healthier with the tremendous help from translators as well as many OpenStack upstream contributors & teams such as infrastructure, release management, and documentation, the current translation platform we are using on https://translate.openstack.org relies on Zanata, an open-source translation platform which upstream activities were stopped [1]. Currently, there are several issues reported - most things have been resolved while it repeats / worses as time goes: - OpenID authentication issues for new registration users on translate.openstack.org [2] - Translation job failure issues since Zanata client did not work with a newer Java / job compatibility issues with Python versions [3] - Missing translation jobs for Xena/Yoga stable versions on Zanata [4] Considering the situation, to solve the root cause of the situation, I am calling for volunteers on Weblate migration. The detailed activities would continue from what the previous I18n PTL already investigated, identified, and documented to [5] [6]. There would be diverse work items with developer perspective as well as translators and operators. Hope that there are many volunteers to move forward. Meanwhile, I updated the "Translations & Priority" part on https://translate.openstack.org homepage. Note that stable versions are minimized to Horizon and dashboard projects, and ping me if there would be lots of translation work especially during R-3 to R-1. Looking forward to an enhanced open source translation platform landing soon with OpenInfra. With many thanks, /Ian [1] https://lists.fedoraproject.org/archives/list/trans@lists.fedoraproject.org… [2] https://lists.openstack.org/pipermail/openstack-i18n/2022-February/003550.h… [3] https://review.opendev.org/c/openstack/project-config/+/850962 [4] https://lists.openstack.org/pipermail/openstack-discuss/2021-December/02644… [5] https://blueprints.launchpad.net/openstack-i18n/+spec/renew-translation-pla… [6] https://etherpad.opendev.org/p/I18n-weblate-migration

2 1

OpenStack Ansible Service troubleshooting
by John Ratliff 04 Oct '22

04 Oct '22

We've started deploying new Xena clusters with openstack-ansible. We keep running into problems with some parts of openstack not working. A service will fail or need restarted, but it's not clear which one or why. Recently, one of our test clusters (2 hosts) stopped working. I could login to horizon, but I could not create instances. At first it told me that a message wasn't answered quick enough. I assumed the problem was rabbitmq and restarted the container, but this didn't help. I eventually restarted every container and the nova- compute and haproxy services on the host. But this didn't help either. I eventually rebooted both hosts, but this made things worse (I think I broke the galera cluster doing this). After bootstrapping the galera cluster, I can log back into horizon, but I still cannot create hosts. It tells me "Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance [UUID]" If I look at the journal for nova-compute, I see this error: "libvirt.libvirtError: Failed to activate service 'org.freedesktop.machine1': timed out " Looking at systemd-machined, it won't start due to "systemd- machined.service: Job systemd-machined.service/start failed with result 'dependency'." I'm not sure what "dependency" it's referring to. In the cluster that does work, this service is running. But on both hosts on the cluster that do not, this service is not running. What should I be looking at here to fix? -- John Ratliff Systems Automation Engineer GlobalNOC @ Indiana University

2 4

[cinder] cancelling this week's meeting
by Rajat Dhasmana 04 Oct '22

04 Oct '22

Hello Argonauts, I won't be around to take the cinder meeting tomorrow (i.e. 05th October, 2022) and we are close to the PTG so there aren't many things to discuss. The agenda as of now is empty[1] so it shouldn't be a problem to skip this week's meeting. Also I would like to take this opportunity to remind everyone to add topics to the PTG etherpad[2] and that would be a better utilization of the cinder upstream meeting time. [1] https://etherpad.opendev.org/p/cinder-zed-meetings#L102 [2] https://etherpad.opendev.org/p/antelope-ptg-cinder-planning Thanks and regards Rajat Dhasmana

1 0

PTG Schedule and Reminders
by Kendall Nelson 03 Oct '22

03 Oct '22

Hello Everyone! The October 2022 Project Teams Gathering is right around the corner and the schedule is being setup by your team leads! Slots are going fast, so make sure to get your time booked ASAP! You can find the schedule and available slots on the PTGbot website [1]. The PTGbot site is the during-event website to keep track of what's being discussed and any last-minute schedule changes. It is driven via commands in the #openinfra-events IRC channel (on the OFTC network) where the PTGbot listens. If you have questions about the commands that you can give the bot, check out the documentation here[2]. Also, if you haven’t connected to IRC before, here are some docs on how to get setup![3] Lastly, please don't forget to register[4] (it is free after all!). Please let us know if you have any questions via email to ptg(a)openinfra.dev. Thanks! -Kendall (diablo_rojo) [1] PTGbot Site: https://ptg.opendev.org/ptg.html [2] PTGbot Documentation: https://github.com/openstack/ptgbot#open-infrastructure-ptg-bot [3] Setup IRC: https://docs.openstack.org/contributors/common/irc.html [4] PTG Registration: https://openinfra-ptg.eventbrite.com

1 0

[neutron] PTG topics and scheduling
by Rodolfo Alonso Hernandez 03 Oct '22

03 Oct '22

Hello all: Based on the schedule polls results, I've booked the Neutron meetings from Tuesday to Thursday in Mitaka channel [1], from 13UTC to 16UTC. Of course, if that is not enough, we can always use Friday to continue any pending conversation. The operator hour (actually 2), will be on Friday (pending for reservation), from 13UTC to 15UTC. Please continue adding any topic you want to discuss in the Neutron etherpad [2]. There is a specific section for the Nova-Neutron cross-team meeting. If you have any doubt or question, do not hesitate to let me know (IRC: ralonsoh, mail: ralonsoh(a)redhat.com) You can also ping any core reviewer in #openstack-neutron channel. See you in a few weeks! [1]https://ptg.opendev.org/ptg.html [2]https://etherpad.opendev.org/p/neutron-antelope-ptg

3 3

[neutron] Bug deputy 26 September to 2 October
by Rodolfo Alonso Hernandez 03 Oct '22

03 Oct '22

Hello Neutrinos: This is the list of bugs of the past week: Medium: * https://bugs.launchpad.net/neutron/+bug/1991092: Retry port provisioning for "nova:xxx" device_owner ports only. Assigned * https://bugs.launchpad.net/neutron/+bug/1991222: neutron.provisioningblocks WSREP: referenced FK check fail. Assigned Low: * https://bugs.launchpad.net/neutron/+bug/1990999: Install and configure compute node in Neutron. Unassigned * https://bugs.launchpad.net/neutron/+bug/1991398: Update port with given IPv6 address on SLAAC/stateless_dhpc subnets fails always when IP address is given. Assigned Wishlist: * https://bugs.launchpad.net/neutron/+bug/1990842: [RFE] Expose Open vSwitch other_config column in the API. Assigned * https://bugs.launchpad.net/neutron/+bug/1991000: [tripleo] Provide a tag to the container that will be used to kill it. Assigned Regards.

1 0

suggestion goal for zed: getting swift and glance to support uwsgi
by Thomas Goirand 03 Oct '22

03 Oct '22

Hi, As you may know, almost all of OpenStack now supports running on UWSGI. However, 2 projects remain incompatible with it: Glance and Swift. I've heard that it's now fixed with Glance, but I haven't checked the fact for myself. Has anyone already run Glance (with Swift as backend) under uwsgi, instead of eventlet? What's the status? Has all of the remaining issues been tackled? As for Swift, while upstream has even examples on how to run Swift over uwsgi, experience (in heavy load production) demonstrated that there are many issues running under uwsgi. That's a shame, because the uwsgi server makes most services (proxy, object, container and account servers) run twice as fast. Currently, the proxy and object servers aren't following the RFCs, and are incompatible with uwsgi, especially when chunks are involved (SLO/DLO in the pipeline). Also, it doesn't look like the Swift servers are thread safe. Switching to more than one thread just fails under heavy load. As a result, in production, we had to run double the amount of servers to handle the load. That's a huge waste of resources, IMO. It'd be great if upstream took it seriously to propose a uwsgi binary by default, and if the CI was using it. Note that I've already proposed such a patch [1], but it received zero votes, and not really getting attention upstream. Your thoughts anyone? Cheers, Thomas Goirand (zigo) P.S: This is just a suggestion for the work in the next cycle, I don't think I have the bandwidth to work on each individual project, and that my time is better spent on what I do best: Debian packaging of OpenStack and cluster deployment integration. [1] https://review.opendev.org/c/openstack/swift/+/821192

2 2

[all][tc] What's happening in Technical Committee: summary 2022 Sept 30: Reading: 5 min
by Ghanshyam Mann 01 Oct '22

01 Oct '22

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * We had this week's meeting on Sept 29. Most of the meeting discussions are summarized in this email. Meeting logs are available @ https://meetings.opendev.org/meetings/tc/2022/tc.2022-09-29-15.00.log.html * Next TC weekly meeting will be a video call on Oct 6 Thursday at 15:00 UTC, feel free to add the topic on the agenda[1] by Oct 5. 2. What we completed this week: ========================= * Goal proposal of 'Migrating CI/CD testing from Ubuntu 20.04 to 22.04' is merged [2] * 2023.1 cycle leaderless projects: PTL appointment done for below projects: ** Adjutant[3] ** Keystone[4] ** Masakari[5] ** OpenStack_Charms[6] ** Sahara[7 ** Senlin[8] ** Swift[9] ** Venus[10] 3. Activities In progress: ================== TC Tracker for Zed cycle ------------------------------ * Zed tracker etherpad includes the TC working items[11], Five are completed and other items are in-progress. Open Reviews ----------------- * Five open reviews for ongoing activities[12]. Dedicating Zed release to Ilya Etingof -------------------------------------------- As you might know, there is sad news of Ilya Etingof (Ironic contributor) passed away on Aug 10[13] and we will be dedicating the Zed release to Ilya[14] New community-wide goal "Migration CI/CD to Ubuntu 22.04" -------------------------------------------------------------------------------------- The goal proposal is merged[15]. Dmitriy will propose this goal to be selected for 2023.1 cycle. 2023.1 cycle Leaderless projects & TC Chair ---------------------------------------------------- * PTL appointments for 8 projects are done. Zun project PTL appointment is under review[16]. * TC Chair: TC members are in the progress to select the chair for the next term. 2023.1 cycle TC PTG planning ------------------------------------ * JayF sent the ICS invite of TC PTG slots on ML[17] * Etherpads to add the topics: ** https://etherpad.opendev.org/p/tc-2023-1-ptg ** https://etherpad.opendev.org/p/tc-leaders-interaction-2023-1 * I sent an email about the 'Operator Hours' slots in this PTG, please check and reserve the operator hour slot for your project[18] 2021 User Survey TC Question Analysis ----------------------------------------------- No update on this. The survey summary is up for review[19]. Feel free to check and provide feedback. Fixing Zuul config error ---------------------------- We discussed the Zuul config error for zuul 'queue' syntex[20]. Also added it in the zuul config error etherpad[21 ]. Requesting projects have zuul config errors in their jobs to look into those and fix them asap. As most of the errors occur while project renaming/retiring, I am adding a separate step about it in the project rename/retiring process[22]. Project updates ------------------- * None. 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[23]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [24] 3. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://review.opendev.org/c/openstack/governance/+/858690 [3] https://review.opendev.org/c/openstack/governance/+/858967 [4] https://review.opendev.org/c/openstack/governance/+/858969 [5] https://review.opendev.org/c/openstack/governance/+/858974 [6] https://review.opendev.org/c/openstack/governance/+/858973 [7] https://review.opendev.org/c/openstack/governance/+/858975 [8] https://review.opendev.org/c/openstack/governance/+/858976 [9] https://review.opendev.org/c/openstack/governance/+/858978 [10] https://review.opendev.org/c/openstack/governance/+/858979 [11] https://etherpad.opendev.org/p/tc-zed-tracker [12] https://review.opendev.org/q/projects:openstack/governance+status:open [13] https://lists.openstack.org/pipermail/openstack-discuss/2022-August/030062.… [14] https://review.opendev.org/c/openstack/governance/+/859464 [15] https://review.opendev.org/c/openstack/governance/+/858690 [16] https://review.opendev.org/c/openstack/governance/+/858980 [17] https://lists.openstack.org/pipermail/openstack-discuss/2022-September/0306… [18] https://lists.openstack.org/pipermail/openstack-discuss/2022-September/0303… [19] https://review.opendev.org/c/openstack/governance/+/836888 [20] https://lists.openstack.org/pipermail/openstack-discuss/2022-September/0305… [21] https://etherpad.opendev.org/p/zuul-config-error-openstack [22] https://review.opendev.org/c/openstack/project-team-guide/+/859886 [23] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [24] http://eavesdrop.openstack.org/#Technical_Committee_Meeting -gmann

1 0

[Diversity] Diversity and Inclusion WG meeting reminder
by Amy Marrich 30 Sep '22

30 Sep '22

The D&I WG will be meeting Monday at 15:00 UTC. The meeting will be held on video at https://meetpad.opendev.org/osf-diversity-and-inclusion and the agenda can be found at https://etherpad.openstack.org/p/diversity -wg-agenda. Thanks, Amy (spotz)

1 0

[release] Release countdown for week R+0, Oct 3 - 7
by Előd Illés 30 Sep '22

30 Sep '22

Development Focus ----------------- We will be releasing the coordinated OpenStack Zed release next week, on October 5th, 2022. Thanks to everyone involved in the Zed cycle! We are now in pre-release freeze, so no new deliverable will be created until final release, unless a release-critical regression is spotted. Otherwise, teams attending the virtual PTG should start to plan what they will be discussing there, by creating and filling team etherpads. You can access the list of PTG etherpads at: http://ptg.openstack.org/etherpads.html General Information ------------------- On release day, the release team will produce final versions of deliverables following the cycle-with-rc release model, by re-tagging the commit used for the last RC. A patch doing just that will be proposed. PTLs and release liaisons should watch for that final release patch from the release team. While not required, we would appreciate having an ack from each team before we approve it on the 5th, so that their approval is included in the metadata that goes onto the signed tag. Upcoming Deadlines & Dates -------------------------- Final Zed release: October 5th, 2022 Virtual PTG: October 17-21, 2022 Előd Illés irc: elodilles

1 0

TLS error when cloning https://opendev.org/openstack/devstack
by Neil Jerram 30 Sep '22

30 Sep '22

Anyone else seeing this? neil@glaurung:~/tt$ git clone https://opendev.org/openstack/devstack Cloning into 'devstack'... remote: Enumerating objects: 28589, done. remote: Counting objects: 100% (28589/28589), done. remote: Compressing objects: 100% (9638/9638), done. error: RPC failed; curl 56 GnuTLS recv error (-9): Error decoding the received TLS packet. fatal: early EOF fatal: fetch-pack: invalid index-pack output Best wishes, Neil -- Neil Jerram Principal Software Engineer Tigera neil(a)tigera.io | @neiljerram <http://twitter.com/neiljerram> Follow Tigera: Blog <https://blog.tigera.io/> | Twitter <https://twitter.com/tigeraio> | LinkedIn <https://www.linkedin.com/company/tigera/> Security and observability for containers, Kubernetes, and cloud <https://tigera.io/>

5 14

Oracle Linux 6 VM volume performance
by Quang Long 30 Sep '22

30 Sep '22

Hi Openstack-users, I am having a problem with I/O performance on VM running Oracle Linux 6, I/O throughput on VM Oracle Linux 6 is much lower than VM using another OS (Ubuntu, CentOS). - VM Oracle Linux 6: throughput 40 MBps https://prnt.sc/buKscX_qEtcF - Other VM: throughput 113 MBps https://prnt.sc/IRhBUPrGgLOy - Test tool: dd bs=1M count=1024 if=/dev/zero of=test conv=fdatasync; rm -f test My Enviroment: - Openstack: Ussuri - Ceph: Octopus 15.2.8 - Compute: CentOS8_x86_64, kernel: 4.18.0-240.15.1.el8_3.x86_64 - KVM: qemu-kvm-5.2.0-16.el8.x86_64 - VM Oracle linux6: kernel-uek-4.1.12-124.42.3.el6uek.x86_64 I think because the kernel of Oracle Linux 6 is too old, maybe an older KVM version could support it, and now KVM does not optimize for this OS. Could you guy can help me with this? -- *Lê Quang Long* 0942.533.683 | 0977.116.502

2 2

Oracle Linux 6 VM disk performance
by Quang Long 30 Sep '22

30 Sep '22

Hi Openstack-users, I am having a problem with I/O performance on VM running Oracle Linux 6, I/O throughput on VM Oracle Linux 6 is much lower than VM using another OS (Ubuntu, CentOS). - VM Oracle Linux 6: throughput 40 MBps https://prnt.sc/buKscX_qEtcF - Other VM: throughput 113 MBps https://prnt.sc/IRhBUPrGgLOy - Test tool: dd bs=1M count=1024 if=/dev/zero of=test conv=fdatasync; rm -f test My Enviroment: - Openstack: Ussuri - Ceph: Octopus 15.2.8 - Compute: CentOS8_x86_64, kernel: 4.18.0-240.15.1.el8_3.x86_64 - KVM: qemu-kvm-5.2.0-16.el8.x86_64 - VM Oracle linux6: kernel-uek-4.1.12-124.42.3.el6uek.x86_64 I think because the kernel of Oracle Linux 6 is too old, maybe an older KVM version could support it, and now KVM does not optimize for this OS. Could you guy can help me with this? -- *Lê Quang Long* 0942.533.683 | 0977.116.502

1 0

Live Migration Issues
by Alexander Dibbo - STFC UKRI 30 Sep '22

30 Sep '22

Hi All, I'm having a few issues with live migration at the moment. This is an openstack train deployed with rdo packages. 1. when migrating some VMs the migration succeeds but the VM doesn't move and the following error can be found in the nova logs with nothing that seems to correspond in the neutron logs: 2022-09-30 11:04:04.069 716669 INFO nova.compute.manager [-] [instance: c10d1d9e-2baf-4ab5-ba3a-2f60f521aea6] Took 76.49 seconds for pre_live_migration on destination host hv548.nubes.rl. ac.uk. 2022-09-30 11:04:04.720 716669 ERROR nova.virt.libvirt.driver [-] [instance: c10d1d9e-2baf-4ab5-ba3a-2f60f521aea6] Live Migration failure: 'fa:ca:ad:1f:71:41' 2. When migrating some VMs the migration is marked as complete and the VM is moved from the source to the destination hypervisor but nova keeps the migrating state and doesn't update the host or the node fields. The following error is found in nova with no corresponding error that I can find in neutron. The config is the same across all hypervisors. 2022-09-13 10:37:23.709 12387 ERROR nova.network.neutronv2.api [req-ee51a8b4-911c-4f92-860b-9d6a7a24c786 27be800439c244c1bd742ff056cf700c 4de86830e89b4a46b590536571b6ccd4 - 38372510d9bb4ac7916178b062d387de 38372510d9bb4ac7916178b062d387de] Neutron client was not able to generate a valid admin token, please verify Neutron admin credential located in nova.conf: neutronclient.common.exceptions.Unauthorized: 401-{'error': {'message': 'The request you have made requires authentication.', 'code': 401, 'title': 'Unauthorized'}} 2022-09-13 10:37:23.845 12387 ERROR oslo_messaging.rpc.server [req-ee51a8b4-911c-4f92-860b-9d6a7a24c786 27be800439c244c1bd742ff056cf700c 4de86830e89b4a46b590536571b6ccd4 - 38372510d9bb4ac7916178b062d387de 38372510d9bb4ac7916178b062d387de] Exception during message handling: nova.exception.NeutronAdminCredentialConfigurationInvalid: Networking client is experiencing an unauthorized exception. Regards Alexander Dibbo - Cloud Architect / Cloud Operations Group Leader For STFC Cloud Documentation visit https://stfc-cloud-docs.readthedocs.io<https://stfc-cloud-docs.readthedocs.io/> To raise a support ticket with the cloud team please email cloud-support(a)stfc.ac.uk<mailto:cloud-support@stfc.ac.uk> To receive notifications about the service please subscribe to our mailing list at: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A0=STFC-CLOUD To receive fast notifications or to discuss usage of the cloud please join our Slack: https://stfc-cloud.slack.com/ This email and any attachments are intended solely for the use of the named recipients. If you are not the intended recipient you must not use, disclose, copy or distribute this email or any of its attachments and should notify the sender immediately and delete this email from your system. UK Research and Innovation (UKRI) has taken every reasonable precaution to minimise risk of this email or any attachments containing viruses or malware but the recipient should carry out its own virus and malware checks before opening the attachments. UKRI does not accept any liability for any losses or damages which the recipient may sustain due to presence of any viruses.

1 0

[all] Skip level upgrades (SLURP) grenade job
by Slawek Kaplonski 30 Sep '22

30 Sep '22

Hi, As You may know there some time ago TC merged resolution about release cadence adjustment [1]. According to that resolution starting from 2023.1 (Antelope) will be first "SLURP" release. That means that upgrade directly from 2023.1 to 2024.1 ("C") needs to be supported so projects will need to run "skip-level" grenade job [2]. To start that effort and see how it works currently and what needs to be done/fixed by teams we (TC) would like to ask teams to add such job to CI in the current (2023.1) cycle already. That job will test upgrade from Yoga to master (2023.1). You can refer to the Manila job [3] and do something similar in Your project. If that job will cause some problems, You can make it non-voting temporary and work on fix it but we highly recommend to have this job voting already. If You would have any questions, please reach out to us here or on the #openstack-tc IRC channel. [1] https://governance.openstack.org/tc/resolutions/20220210-release-cadence-ad… [2] https://github.com/openstack/grenade/blob/b1cd7a1866ee7d17392bd9896db6060d4… [3] https://review.opendev.org/c/openstack/manila/+/859875 -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

[Image Encryption] No meeting on Monday
by Josephine Seifert 30 Sep '22

30 Sep '22

Hi, Monday the 3. of October is a national holiday. So there will not be a meeting for the Image Encryption pop up team. cheers, Luzi

1 0