June 2022 - openstack-discuss - lists.openstack.org

[kolla-ansible][wallaby][nova][spice]
by Franck VEDEL 27 Jun '22

27 Jun '22

hello I have two problems and I ask you for a little help before doing stupid things. If I correctly diagnosed the first problem, which is to replace novnc by spice in my installation, it is not possible. I'm using Centos, I'm on the Wallaby version, and the last tag for the Docker image is Train. So my first question is: can I somehow replace novnc with something else, spice or another? Second question: I would like to switch from Wallaby to Xena (unless we can switch from Wallaby to Yoga... is it possible?) . After a year of operation, this is the first time I have had to do an update with an openstack in production (student instances have been deleted, end of the academic year) but not used for a few days. Is the following procedure correct: git clone --branch stable/xena https://opendev.org/openstack/kolla-ansible mv kolla-ansible kolla-ansible-xena (to keep multiple versions) pip install ./kolla-ansible-xena kolla-ansible -i multinode bootstrap-servers kolla-ansible -i multinode prechecks kolla-ansible -i multinode deploy What to do with globals.yml and the /etc/kolla/config overload? no changes ? Thank you in advance for your help, for your answers, and for an update procedure if you have one. Sincerely Franck

1 0

How is this overallocation possible?
by Russell Stather 27 Jun '22

27 Jun '22

See image below. How can I be using 38 vcpus on a compute with 24 total? Is this an error in horizon? [cid:988b50f9-b9c8-4ccc-9240-90f2d1ff3df6]

3 5

[Neutron] team meeting - 28.06.2022. - cancelled
by Lajos Katona 27 Jun '22

27 Jun '22

Hi, As I said in the last Team meeting (see [1]) I am OoO this Tuesday, so can't drive the coming meeting. [1]: https://meetings.opendev.org/meetings/networking/2022/networking.2022-06-21… Best wishes, and see you online. Lajos Katona (lajoskatona)

1 0

[neutron] Drivers meeting agenda - 24.06.2022.
by Lajos Katona 27 Jun '22

27 Jun '22

Hi Neutron Drivers, The agenda for tomorrow's drivers meeting is at [1]. * [RFE] Improve performance of bulk port create/delete with networking-generic-switch (#linkhttps:// bugs.launchpad.net/neutron/+bug/1976270) * Neutron RBAC not sharing subnet (#link https://bugs.launchpad.net/neutron/+bug/1975603) * [ovn]Floating IP adds distributed attributes (#link https://bugs.launchpad.net/neutron/+bug/1978039) * [RFE] Adding the "rekey" parameter to the api for strongswan like "dpd_action" (#link https://bugs.launchpad.net/neutron/+bug/1979044) [1] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda See you at the meeting tomorrow. Lajos Katona (lajoskatona)

2 2

[nova] NVLink passthrough
by Cory Hawkvelt 27 Jun '22

27 Jun '22

Hey team, Is anyone working with NVLink in their clouds? How are you handling passing through the right set of GPU's per NVLink 'group' I have servers with 4 sets of 2 way NVLinks(8 cards in pairs of 2) and I'm able to passthrough the PCI devices to the VM no problem but there is no guarantee that the NVLink pair get passed through together and if we end up with 1 GPU from one pair and 1 GPU from another pair then we run into all sorts of issues(As you'd expect) So I'm looking to understand how Nova can be NVLink aware I guess but I'm struggling to find any conversation ro material on the topic but I assume it's been done before? I did find this talk [1] which mentioned this problem but they write some sort of hack to sit in between nova and qemu, while quite a clever solution it seems like there must be a better way to do this in 2022? [1] - https://www.openstack.org/videos/summits/vancouver-2018/can-we-boost-more-h… Cheers, Cory

2 1

[cinder] Spec Freeze in effect
by Rajat Dhasmana 27 Jun '22

27 Jun '22

Hello Argonauts, As per the scheduled deadline[1], the cinder spec freeze is in effect. If you would like to continue working on your spec to get it merged and implemented in the Zed development cycle, please request a spec freeze exception as a new email to the Openstack Discuss mailing list[2] describing the reason for not making it into the deadline and hence it will be granted the spec freeze exception. The deadline for proposing the spec freeze exception is by 1st July, 2022 and the specs granted spec freeze exception should be merged by 8th July, 2022. Following are the specs that are targeted for the Zed cycle: 1) Spec to introduce additional task status field Patch: https://review.opendev.org/c/openstack/cinder-specs/+/818551 Needs an update from the author. 2) WIP: Add new volume transaction tracking Patch: https://review.opendev.org/c/openstack/cinder-specs/+/845176 Since this is a WIP, I'm not sure the intention is to get it into Zed specifically. 3) volume list query optimization Patch: https://review.opendev.org/c/openstack/cinder-specs/+/726070 Has a +2 but still lacks review from the main cinder core team. 4) Update original resource's az Patch: https://review.opendev.org/c/openstack/cinder-specs/+/778437 Hasn't been updated since 31st March so looks less likely to make it into Zed. 5) New Quota System Patch: https://review.opendev.org/c/openstack/cinder-specs/+/819693 Needs to be retargeted for Zed and updated as per PTG discussion. Also would like to request the cinder core team to take a look at the open specs. [1] https://releases.openstack.org/zed/schedule.html#z-cinder-spec-freeze [2] openstack-discuss(a)lists.openstack.org Thanks and regards Rajat Dhasmana

1 0

[neutron] bug deputy report for week of 2022-06-20
by Bence Romsics 27 Jun '22

27 Jun '22

Hi Neutron Team, Here comes the deputy report for last week: High: * https://bugs.launchpad.net/neutron/+bug/1979047 Interface attach fails with libvirt.libvirtError: internal error: unable to execute QEMU command 'netdev_add': File descriptor named '(null)' has not been found gate failure caused by libvirt bug in centos stream 9, affected tests blacklisted until centos fix arrives: https://review.opendev.org/c/openstack/neutron/+/846905 * https://bugs.launchpad.net/neutron/+bug/1979661 [stable/train] member_batch_update breaks contract with octavia-api interface fix merged: https://review.opendev.org/c/openstack/networking-ovn/+/847255 Medium: * https://bugs.launchpad.net/neutron/+bug/1979643 ``get_ports`` query done in ``check_baremetal_ports_dhcp_options`` cannot filter by VNIC type fix waiting for workflow+1: https://review.opendev.org/c/openstack/neutron/+/847346 Still in discussion with reporter: * https://bugs.launchpad.net/neutron/+bug/1979528 neutron dnsmasq keeps pushing the default gateway * https://bugs.launchpad.net/neutron/+bug/1979089 l3ha router delete race condition if state changes to master Cheers, Bence (rubasov)

1 0

Re: [Swift] [kolla] Swift issues in one cluster
by Albert Braden 27 Jun '22

27 Jun '22

We're running 2.23.3 but it appears that we are experiencing the bug (1). We tracked the problem down to a client who recently started using a java library to read large files from Swift. When he moves his activity to the other QA cluster, the problem follows. Am I guessing correctly that the bug was never fixed, and that (2) fixes a different problem? On Thursday, June 23, 2022, 10:43:44 AM EDT, Clay Gerrard <clay.gerrard(a)gmail.com> wrote: https://review.opendev.org/c/openstack/swift/+/575254 has been included in every released swift tag since 2.21.0 I believe Train included a swift version of at least 2.22 https://releases.openstack.org/train/#swift Nvidia doesn't use haproxy in front of our swift proxies, and we don't see BlockingIOError in tracebacks - the traceback might go away if you upgrade to the latest swift (2.29) and/or eventlet and/or python 3.8ish On Thu, Jun 23, 2022 at 8:49 AM Albert Braden <ozzzo(a)yahoo.com> wrote: Can anyone help with this Swift issue? It looks like we are being hit with this bug (1) but this bug doesn't seem to mention where/whether it was ever fixed. This (2) appears to be a fix, and it appears to have been merged, but it doesn't mention the bug, and it's not obvious to me what version it affects. Is anyone else encountering this problem? It appears that customers in this one cluster may be doing something to cause it; we're still trying to track down specifically what they are doing, that they aren't doing in the other clusters. We are running kolla-ansible Train on RHEL7. 1. https://bugs.launchpad.net/swift/+bug/1572719 2. https://opendev.org/openstack/swift/commit/0e81ffd1e1481a73146fce17f61f2ab9… On Wednesday, June 22, 2022, 05:10:10 PM EDT, Albert Braden <ozzzo(a)yahoo.com> wrote: Is this bug fixed in Train? https://bugs.launchpad.net/swift/+bug/1572719 On Tuesday, June 21, 2022, 09:26:47 AM EDT, Albert Braden <ozzzo(a)yahoo.com> wrote: All of our endpoints are https: +----------------------------------+--------+--------------+--------------+---------+-----------+---------------------------------------------------------+ | ID | Region | Service Name | Service Type | Enabled | Interface | URL | +----------------------------------+--------+--------------+--------------+---------+-----------+---------------------------------------------------------+ | <ID> | <region> | keystone | identity | True | internal | https://api-int.<region>.<domain>:5000 | | <ID> | <region>| swift | object-store | True | public | https://swift. <region>.<domain>:8080/v1/AUTH_%(tenant_id)s | | <ID> | <region>| swift | object-store | True | internal | https://swift.<region>.<domain>:8080/v1/AUTH_%(tenant_id)s | | <ID> | <region>| keystone | identity | True | admin | https://api-int. <region>.<domain>:35357 | | <ID> | <region>| keystone | identity | True | public | https://api-ext. <region>.<domain>:5000 | | <ID> | <region>| swift | object-store | True | admin | https://swift. <region>.<domain>:8080/v1 | +----------------------------------+--------+--------------+--------------+---------+-----------+---------------------------------------------------------+ I don't think this is causing the issue; all of our clusters are setup the same. We did think it was load at first, and got the 2 heaviest users to stop what they were doing, but that didn't make a difference. Our other QA cluster has similar load and identical hardware. When I look at the network graphs, I see traffic spiking up to 1G, but these are 25G interfaces, and none of the resources on the boxes are exhausted. CPU is 97% idle; memory is 30% used, disk is not full. It doesn't look like the problem is load-related. We see the haproxy connections stacking up even when load is low. What else could be causing this? On Friday, June 17, 2022, 11:12:36 PM EDT, Pete Zaitcev <zaitcev(a)redhat.com> wrote: On Fri, 17 Jun 2022 17:33:27 +0000 (UTC) Albert Braden <ozzzo(a)yahoo.com> wrote: > $ openstack container list > Unable to establish connection to https://swift.<region>.<domain>:8080/v1/AUTH_<project>: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer') Right away I have a question: why in the world are you connecting to 8080 with HTTPS? > (from Splunk): > Payload: swift-proxy-server: STDERR: File "/usr/lib64/python3.6/socket.py", line 604, in write#012 return self._sock.send(b) > Payload: swift-proxy-server: STDERR: BlockingIOError > Payload: swift-proxy-server: STDERR: os.read(self.rfd, 1) > Payload: swift-proxy-server: STDERR: File "/usr/lib/python3.6/site-packages/eventlet/wsgi.py", line 818, in process_request#012 proto.__init__(conn_state, self) This looks quite fishy to me, because the os.read is in swift/common/utils.py and it's responsible for the mutex. > When we look at network connections, we see haproxy stacking up (many lines of this): > > # netstat -ntup | sort -b -k2 -n -r | head -n +100 > tcp 5976932 0 127.0.0.1:60738 127.0.0.1:8080 ESTABLISHED 13045/haproxy > tcp 5976446 0 127.0.0.1:58480 127.0.0.1:8080 ESTABLISHED 13045/haproxy > tcp 5973217 0 127.0.0.1:33244 127.0.0.1:8080 ESTABLISHED 13045/haproxy > tcp 5973120 0 127.0.0.1:51836 127.0.0.1:8080 ESTABLISHED 13045/haproxy > tcp 5971968 0 127.0.0.1:58516 127.0.0.1:8080 ESTABLISHED 13045/haproxy > ... > > If we restart the swift_haproxy and swift_proxy_server containers then the problem goes away, and comes back over a few minutes. Where should we be looking for the root cause of this issue? Indeed if so many requests are established, you're in trouble. The best fix, I think, is to find the customer who's doing it and punish them. Otherwise, quotas and the ratelimiting middleware are your friends. There's also a possibility that your cluster is underperforming, although usually that results in 500 results first. But then again, at times users would "compensate" for issues by just launching way more requests, in effect DoS-ing the cluster even worse. -- Pete -- Clay Gerrard210 788 9431

2 5

[all] Failure to build (FTBFS) with Sphinx 5.0 and docutils 0.18
by Thomas Goirand 27 Jun '22

27 Jun '22

Hi, A number of bugs were filed against the Debian packages I maintain. Here's the list of bugs: https://bugs.debian.org/1013410 Nova https://bugs.debian.org/1013406 os-api-ref https://bugs.debian.org/1013402 openstacksdk https://bugs.debian.org/1013394 dogpile.cache https://bugs.debian.org/1013393 repoze.who https://bugs.debian.org/1013382 cloudkitty I'd appreciate a bit of help from the OpenStack project here, to fix these before Sphinx 5 and Docutils 0.18 are uploaded to Debian Unstable. If you do have a fix, a quick link in these bug reports would be lovely. Cheers, Thomas Goirand (zigo)

3 3

[all][horizon][django 4.0] Failure to build (FTBFS) with Django 4.0
by Thomas Goirand 27 Jun '22

27 Jun '22

Hi, A number of RC bugs were filed against my packages in Debian Unstable: https://bugs.debian.org/1013488 Horizon https://bugs.debian.org/1013475 django-pyscss https://bugs.debian.org/1013515 ironic-ui https://bugs.debian.org/1013605 django-formtools https://bugs.debian.org/1013603 enmerkar https://bugs.debian.org/1013506 ara If you have a fix, and can post the link to the patch in the Debian bug tracker, that'd be very much appreciated and help these packages not being auto-removed from Debian testing. Otherwise, you can always ping me on IRC. Cheers, Thomas Goirand (zigo)

2 2

[Ceph Rados Gateway] 403 when using S3 client
by Taltavull Jean-François 27 Jun '22

27 Jun '22

Hi All, I get an http 403 error code when I try to get the bucket list with Ubuntu (Focal) S3 client (awscli). S3 api has been activated in radosgw config file and EC2 credentials have been created and put in S3 client config file. Otherwise, everything is working fine with OpenStack client. My deployment: - OSA 23.2.0 - OpenStack Wallaby - Ceph and Rados GW Octopus Has any of you already experienced this kind of behaviour ? Many thanks, Jean-Francois

3 6

Re: [heat-translator][tacker] Propose Hiromu Asahina (h-asahina) for heat-translator core team
by Hiromu Asahina 27 Jun '22

27 Jun '22

Thank you for your warm feedback. I'll do my best :) By the way, me and Ueha-san who just joined the heat-translator core before me are not listed on heat-translator drivers [1]. I guess it means we don't have the permissions to control the heat-translator launchpad. Is it possible to add us to that list? Best Regards, Hiromu (h-asahina) [1] https://launchpad.net/~heat-translator-drivers/+members On 2022/06/27 13:42, Yasufumi Ogawa wrote: > > > > -------- Forwarded Message -------- > Subject: Re: [heat-translator][tacker] Propose Hiromu Asahina > (h-asahina) for heat-translator core team > Date: Fri, 24 Jun 2022 15:57:18 +0900 > From: Yasufumi Ogawa <yasufum.o(a)gmail.com> > To: Rico Lin <ricolin(a)ricolky.com> > CC: ueha.ayumu(a)fujitsu.com <ueha.ayumu(a)fujitsu.com>, > openstack-discuss(a)lists.openstack.org > <openstack-discuss(a)lists.openstack.org>, HADDLETON, Robert W (Bob) > <bob.haddleton(a)nokia.com>, Ghanshyam Mann <gmann(a)ghanshyammann.com> > > Thanks Rico and all! > > On 2022/06/24 5:03, Rico Lin wrote: >> Hi team >> >> Sorry for the late reply, just added Hiromu to the heat-translator-core. >> >> And welcome Hiromu. >> >> *Rico Lin* >> >> >> On Fri, Jun 24, 2022 at 2:30 AM Yasufumi Ogawa <yasufum.o(a)gmail.com >> <mailto:yasufum.o@gmail.com>> wrote: >> >> Hi heat-translator cores, >> >> We tacker team would like to keep contributing to maintain >> heat-translator, so appreciate if you agree to the proposal kindly. >> >> Cheers, >> Yasufumi >> >> On 2022/06/09 14:14, ueha.ayumu(a)fujitsu.com >> <mailto:ueha.ayumu@fujitsu.com> wrote: >> > Hi Rico, >> > >> > This is just a friendly reminder that we are waiting for your >> action. >> > Or please let us know if there are any other necessary processes. >> > Thanks. >> > >> > Best Regards, >> > Ueha >> > >> > -----Original Message----- >> > From: ueha.ayumu(a)fujitsu.com <mailto:ueha.ayumu@fujitsu.com> >> <ueha.ayumu(a)fujitsu.com <mailto:ueha.ayumu@fujitsu.com>> >> > Sent: Thursday, June 2, 2022 5:39 PM >> > To: openstack-discuss(a)lists.openstack.org >> <mailto:openstack-discuss@lists.openstack.org>; 'Rico Lin' >> <ricolin(a)ricolky.com <mailto:ricolin@ricolky.com>> >> > Subject: RE: [heat-translator][tacker] Propose Hiromu Asahina >> (h-asahina) for heat-translator core team >> > >> > Hi Rico, >> > >> > This proposal is great helpful for us! >> > There seems to be no particular objection, so could you add it to >> heat-translator-core if there is no problem? >> > Thanks. >> > >> > Best Regards, >> > Ueha >> > >> > -----Original Message----- >> > From: ueha.ayumu(a)fujitsu.com <mailto:ueha.ayumu@fujitsu.com> >> <ueha.ayumu(a)fujitsu.com <mailto:ueha.ayumu@fujitsu.com>> >> > Sent: Wednesday, May 25, 2022 1:40 PM >> > To: openstack-discuss(a)lists.openstack.org >> <mailto:openstack-discuss@lists.openstack.org> >> > Subject: RE: [heat-translator][tacker] Propose Hiromu Asahina >> (h-asahina) for heat-translator core team >> > >> > +1 >> > >> > Best Regards, >> > Ueha >> > >> > -----Original Message----- >> > From: Yoshito Ito <yoshito.itou.dr(a)hco.ntt.co.jp >> <mailto:yoshito.itou.dr@hco.ntt.co.jp>> >> > Sent: Wednesday, May 25, 2022 12:31 PM >> > To: openstack-discuss(a)lists.openstack.org >> <mailto:openstack-discuss@lists.openstack.org> >> > Subject: [heat-translator][tacker] Propose Hiromu Asahina >> (h-asahina) for heat-translator core team >> > >> > Hi heat-translator team! >> > >> > I would like to propose Hiromu Asahina (h-asahina) as a member of >> the heat-translator core team. I'm now not able to actively >> contribute to heat-translator, and he can lead the team instead >> of me. >> > >> > He is mainly contributing to Tacker by fixing issues, refactoring >> existing codes, and a lot of helpful reviews, with his experience as >> a research engineer in NTT. Tacker highly depends on heat-translator >> in its main functionality, so I believe he can manage it with his >> knowledge of Tacker. >> > >> > Please vote for his nomination by answering this mail till >> June 1st. >> > >> > Best Regards, >> > >> > Yoshito Ito >> > >> > >>

1 0

[magnum] [xena] [IPv6] Review Patch for dual-stack IPv4/6 work in Magnum-managed Kubernetes 1.21
by Namrata Sitlani 27 Jun '22

27 Jun '22

Hello All, We run release Xena, and we have deployed Kubernetes version 1.21.10 on Magnum with Fedora CoreOS version 34 and we are trying to have IPv6 support for that Kubernetes cluster, as Kubernetes 1.21 and later versions have dual-stack(IPv4/IPv6) support is enabled by default. To achieve that, we also need IPv6 support in magnum, which is not currently supported but there has been a patch for "Support IPv6 dual subnet" in a pending state for almost a year. Following is the patch link: https://review.opendev.org/c/openstack/magnum/+/802235 We are interested in the use case for dual-stack support in magnum. We would highly appreciate it if someone could help us land that patch. Kindly let us know if we can provide any additional information or help for the same. Thanks, Namrata Sitlani

1 0

[vmware-nsx] Missing releases and project status
by Takashi Kajinami 25 Jun '22

25 Jun '22

Hello, I recently noticed that the vmware-nsx repo doesn't have the stable/wallaby branch and the stable/yoga branch. Also, no release has been created since victoria release. There is a bug fix recently merged directly to stable/xena, and this was backported to ussuri and train with victoria skipped. https://review.opendev.org/c/x/vmware-nsx/+/836034 I'm quite confused with this because it looks like master and victoria are no longer maintained. May I ask for some clarification about the current status of the project, especially regarding the following points. - Is there any plan to create stable/wallaby and stable/yoga ? - Is there any plan to create a release for stable/wallaby and later ? - May I know the maintenance status of each branch ? - What is the future plan of that repo? Will you have stable/zed release ? I'm asking this because the plugin is supported by puppet-neutron but we are thinking of deprecating/removing the implementation if the plugin will be unmaintained. I'd appreciate your input on this. Thank you, Takashi

1 1

[all][tc] What's happening in Technical Committee: summary 24 June 2022: Reading: 5 min
by Ghanshyam Mann 25 Jun '22

25 Jun '22

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * We had this week's meeting on 23 June. Most of the meeting discussions are summarized in this email. Meeting full logs are available @https://meetings.opendev.org/meetings/tc/2022/tc.2022-06-23-15.00.log.html * Next TC weekly meeting will be on 30 July Thursday at 15:00 UTC, feel free to add the topic on the agenda[1] by 29 July. 2. What we completed this week: ========================= * Defined "Emerging technology and inactive projects" framework[2]. Details can be found here[4]. Thanks to Slawek for working on this framework. A brief about this framework: 1. When a new project applies to be an official OpenStack project and they are not fully ready/doing things as OpenStack way. Still, they can be an official OpenStack with the agreement of filling the gap for OpenStack way. This framework will help such projects to have them early in the OpenStack community but also with the timeline of filling the gaps. (Skyline is a good example of such a project). 2. Inactive projects: If any project become inactive and no maintainer merges the things then this framework will help to detect such projects before the final release of work and give time to recover before we decide to retire them. This will avoid last-minute issues during the final release for example: what we had in the Yoga release[3] * Clarified "ATC" and "AC" terms in TC charter as per the bylaws perspective[5] * Added cinder ibm storwize charm repo[6] 3. Activities In progress: ================== TC Tracker for Zed cycle ------------------------------ * Zed tracker etherpad includes the TC working items[7], Two are completed and others items are in-progress. Open Reviews ----------------- * Four open reviews for ongoing activities[8]. Create the Environmental Sustainability SIG --------------------------------------------------- There is a proposal for 'Environmental Sustainability ' SIG[9]. Because of its wider scope at the OpenInfra projects level (not just OpenStack) we are discussing if it is a good idea to be an OpenStack SIG or something at the OpenInfra level like a working group under Board or so. New ELK service dashboard: e-r service ----------------------------------------------- Updates from dpawlik: "Changes in ci log processing: created account on docker hub for ci log processing project (credentials are in AWS secret service); enabled pushing logscraper and log gearman container images into the docker hub." Ananya working on integrating the Elastic recheck with Upstream opensearch[10] Dasm working on merging 'origin/rdo' into the merge branch[11] Consistent and Secure Default RBAC ------------------------------------------- We discussed the operator feedback in the policy popup meeting on Tuesday 21 June[12] where operators from KDDI joined and wrote their feedback in etherpad[13]. After considering the feedback and all the challenges we have with 'scope', we decided to drop the 'scope' implementation and work on implementing the 'project persona'. I have proposed the goal document updates[14] 2021 User Survey TC Question Analysis ----------------------------------------------- No update on this. The survey summary is up for review[15]. Feel free to check and provide feedback. Zed cycle Leaderless projects ---------------------------------- No updates on this. Only Adjutant project is leaderless/maintainer-less. We will check Adjutant's the situation again on ML and hope Braden will be ready with their company side permission[16]. Fixing Zuul config error ---------------------------- Requesting projects with zuul config error to look into those and fix them which should not take much time[17][18]. Project updates ------------------- * Add Cinder Dell EMC PowerStore charm[19] * Retire openstack-helm-deployments[20] 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[21]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [22] 3. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://review.opendev.org/c/openstack/governance/+/839880 [3] http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027864.ht… [4] https://governance.openstack.org/tc/reference/emerging-technology-and-inact… [5] https://review.opendev.org/c/openstack/governance/+/844882 [6] https://review.opendev.org/c/openstack/governance/+/846900 [7] https://etherpad.opendev.org/p/tc-zed-tracker [8] https://review.opendev.org/q/projects:openstack/governance+status:open [9] https://review.opendev.org/c/openstack/governance-sigs/+/845336 [10] https://review.opendev.org/c/opendev/elastic-recheck/+/845777 [11] https://review.opendev.org/c/opendev/elastic-recheck/+/847405/ [12] https://etherpad.opendev.org/p/rbac-zed-ptg#L171 [13] https://etherpad.opendev.org/p/rbac-operator-feedback#L45 [14] https://review.opendev.org/c/openstack/governance/+/847418 [15] https://review.opendev.org/c/openstack/governance/+/836888 [16] http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027626.ht… [17] https://etherpad.opendev.org/p/zuul-config-error-openstack [18] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html [19] https://review.opendev.org/c/openstack/governance/+/846890 [20] https://review.opendev.org/c/openstack/governance/+/847413 [21] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [22] http://eavesdrop.openstack.org/#Technical_Committee_Meeting -gmann

1 0

[oslo] Propose to EOL stable/queens, stable/rocky on all the oslo scope
by Herve Beraud 24 Jun '22

24 Jun '22

Hi, On our last meeting of the oslo team we discussed the problem with broken stable branches (rocky and older) in oslo's projects [1]. Indeed, almost all these branches are broken. Előd Illés kindly generated a list of periodic-stable errors on Oslo's stable branches [2]. Given the lack of active maintainers on Oslo and given the current status of the CI in those branches, I propose to make them End Of Life. I will wait until the end of month for anyone who would like to maybe step up as maintainer of those branches and who would at least try to fix CI of them. If no one will volunteer for that, I'll EOLing those branches for all the projects under the oslo umbrella. Let us know your thoughts. Thank you for your attention. [1] https://meetings.opendev.org/meetings/oslo/2021/oslo.2021-10-04-15.00.log.t… [2] http://lists.openstack.org/pipermail/openstack-discuss/2021-July/023939.html -- Hervé Beraud Senior Software Engineer at Red Hat irc: hberaud https://github.com/4383/ https://twitter.com/4383hberaud

5 5

ovn-controller/OVS stranger behaviour
by Tiago Pires 24 Jun '22

24 Jun '22

Hi all, I'm trying to understand a stranger's behaviour regarding to ovn-controller/OVS. In my setup I have OVN 21.09/ OVS 2.16 and Ubuntu Xena and sometimes when a new VM is created, this VM can reach other VMs in east-west traffic (even in differents Chassis) but it can't reach an external network (e.g. Internet) through Chassi Gateway. I ran the following trace: # ovs-appctl ofproto/trace br-int in_port="93",icmp,dl_src=fa:16:3e:26:34:ef,dl_dst=fa:16:3e:65:68:6e,nw_src=192.168.40.140,nw_dst=8.8.8.8,nw_ttl=64 And I got this output: Final flow: recirc_id=0xc157b1,eth,icmp,reg0=0x300,reg11=0xd,reg12=0x10,reg13=0xf,reg14=0x3,reg15=0x2,metadata=0x29,in_port=93,vlan_tci=0x0000,dl_src=fa:16:3e:26:34:ef,dl_dst=fa:16:3e:65:68:6e,nw_src=192.168.40.140,nw_dst=8.8.8.8,nw_tos=0,nw_ecn=0,nw_ttl=64,icmp_type=0,icmp_code=0 Megaflow: recirc_id=0xc157b1,ct_state=+new-est-rel-rpl-inv+trk,ct_label=0/0x1,eth,icmp,in_port=93,dl_src=fa:16:3e:26:34:ef,dl_dst=fa:16:3e:65:68:6e,nw_src= 192.168.40.128/26,nw_dst=8.0.0.0/7,nw_ttl=64,nw_frag=no Datapath actions: ct(commit,zone=15,label=0/0x1,nat(src)),set(eth(src=fa:16:3e:ec:7f:dd,dst=00:00:00:00:00:00)),set(ipv4(ttl=63)),userspace(pid=3451843211,controller(reason=1,dont_send=1,continuation=0,recirc_id=12670898,rule_cookie=0x3e26215e,controller_id=0,max_len=65535)) It seems the Datapath is querying the controller and I did not understand the reason. So, I did an ovn-controller recompute (ovn-appctl -t ovn-controller recompute) on the Chassi where the VM is placed to check if it could change the behaviour and I could trace the packet with success and the VM started to communicate with the Internet normally: Final flow: recirc_id=0x2,eth,icmp,reg0=0x300,reg11=0xd,reg12=0x10,reg13=0xf,reg14=0x3,reg15=0x2,metadata=0x29,in_port=93,vlan_tci=0x0000,dl_src=fa:16:3e:26:34:ef,dl_dst=fa:16:3e:65:68:6e,nw_src=192.168.40.140,nw_dst=8.8.8.8,nw_tos=0,nw_ecn=0,nw_ttl=64,icmp_type=0,icmp_code=0 Megaflow: recirc_id=0x2,ct_state=+new-est-rel-rpl-inv+trk,ct_label=0/0x1,eth,icmp,tun_id=0/0xffffff,tun_metadata0=NP,in_port=93,dl_src=fa:16:3e:26:34:ef,dl_dst=fa:16:3e:65:68:6e,nw_src= 192.168.40.128/26,nw_dst=8.0.0.0/7,nw_ecn=0,nw_ttl=64,nw_frag=no Datapath actions: ct(commit,zone=15,label=0/0x1,nat(src)),set(tunnel(tun_id=0x2a,dst=10.X6.X3.133,ttl=64,tp_dst=6081,geneve({class=0x102,type=0x80,len=4,0x30002}),flags(df|csum|key))),set(eth(src=fa:16:3e:ec:7f:dd,dst=00:00:5e:00:04:00)),set(ipv4(ttl=63)),2 The Datapath action is using the tunnel with the Chassi Gateway. It happens always with new VMs but sometimes. After running the recompute on the Chassi, I created additional VMs and this issue did not happen. In my Chassi I have enable these parameters also: ovn-monitor-all="true" ovn-openflow-probe-interval="0" ovn-remote-probe-interval="180000" I did some troubleshooting and I'm seeing this error (ovs-vswitchd) always when a VM is created in a Chassi: 2022-06-23T11:47:08.385Z|07907|bridge|WARN|could not open network device tap8a43df0c-fd (No such device) 2022-06-23T11:47:09.282Z|07908|bridge|INFO|bridge br-int: added interface tap8a43df0c-fd on port 51 2022-06-23T11:47:09.645Z|07909|bridge|INFO|bridge br-int: added interface tap3200bf1c-20 on port 52 2022-06-23T11:47:19.329Z|07911|connmgr|INFO|br-int<->unix#1468: 430 flow_mods in the 7 s starting 10 s ago (410 adds, 20 deletes) On this commit http://patchwork.ozlabs.org/project/ovn/patch/1608197000-637-1-git-send-ema… it solved something similar to my issue. It seems the ovs-vswitchd is missing some flows and when I run the recompute it fixes it. So, in order to avoid this issue I'm testing at this moment to run the recompute through libvirt hook when a VM gets "started" status. Do you know this behaviour could be bug related? Regards, Tiago Pires Do you know this behaviour could be bug related?

2 2

[heat-translator][tacker] Propose Hiromu Asahina (h-asahina) for heat-translator core team
by Yoshito Ito 24 Jun '22

24 Jun '22

Hi heat-translator team! I would like to propose Hiromu Asahina (h-asahina) as a member of the heat-translator core team. I'm now not able to actively contribute to heat-translator, and he can lead the team instead of me. He is mainly contributing to Tacker by fixing issues, refactoring existing codes, and a lot of helpful reviews, with his experience as a research engineer in NTT. Tacker highly depends on heat-translator in its main functionality, so I believe he can manage it with his knowledge of Tacker. Please vote for his nomination by answering this mail till June 1st. Best Regards, Yoshito Ito

7 10

[ER] Revive elastic recheck
by Dariusz Smigiel 23 Jun '22

23 Jun '22

Hey Team! I started cherry picking changes from the rdo branch back to the master branch for Elastic Recheck. [1] I'm planning to continue doing so, to revive the master branch and continue development in the main branch. Some of the changes are incompatible between releases. We're gonna clear them case by case to enable it in the future. Thanks, Darius [1]: https://review.opendev.org/c/opendev/elastic-recheck/+/847259

1 1

[all][tc] Technical Committee next weekly meeting on 23 June 2022 at 1500 UTC
by Ghanshyam Mann 23 Jun '22

23 Jun '22

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 23 June 2022, at 1500 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Wednesday, 22 June at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1

Swift issues in one cluster
by Albert Braden 23 Jun '22

23 Jun '22

We have multiple Swift clusters, all configured the same. One of them started failing this week. The symptom is that Swift commands take a long time to execute and sometimes they fail: $ openstack container list Unable to establish connection to https://swift.<region>.<domain>:8080/v1/AUTH_<project>: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer') When we look at the logs we see lots of swift-proxy-server errors: (from Splunk): Payload: swift-proxy-server: STDERR: File "/usr/lib64/python3.6/socket.py", line 604, in write#012 return self._sock.send(b) Payload: swift-proxy-server: STDERR: BlockingIOError Payload: swift-proxy-server: STDERR: os.read(self.rfd, 1) Payload: swift-proxy-server: STDERR: File "/usr/lib/python3.6/site-packages/eventlet/wsgi.py", line 818, in process_request#012 proto.__init__(conn_state, self) Payload: swift-proxy-server: STDERR: File "/usr/lib/python3.6/site-packages/eventlet/greenio/base.py", line 397, in send Payload: swift-proxy-server: STDERR: return self._sock.send(b) When we look at network connections, we see haproxy stacking up (many lines of this): # netstat -ntup | sort -b -k2 -n -r | head -n +100 tcp 5976932 0 127.0.0.1:60738 127.0.0.1:8080 ESTABLISHED 13045/haproxy tcp 5976446 0 127.0.0.1:58480 127.0.0.1:8080 ESTABLISHED 13045/haproxy tcp 5973217 0 127.0.0.1:33244 127.0.0.1:8080 ESTABLISHED 13045/haproxy tcp 5973120 0 127.0.0.1:51836 127.0.0.1:8080 ESTABLISHED 13045/haproxy tcp 5971968 0 127.0.0.1:58516 127.0.0.1:8080 ESTABLISHED 13045/haproxy ... If we restart the swift_haproxy and swift_proxy_server containers then the problem goes away, and comes back over a few minutes. Where should we be looking for the root cause of this issue?

2 4

[TripleO] Proposing Brendan Shephard and Takashi Kajinami
by James Slagle 23 Jun '22

23 Jun '22

I'm formally proposing that we add Brendan Shephard and Takashi Kajinami to the core reviewers team for TripleO. Takashi is already considered core on puppet-tripleo, and I'm proposing we expand that to all of TripleO, and likewise for Brendan. They both have been contributing and reviewing for a little while now, and I feel it's time to add them to the team. Please +1 or let me know any concerns before Friday June 15th. Thanks! -- -- James Slagle --

15 15

[TripleO] Gate blocker - tempest test error - 'Failed to attach network adapter device'
by Ronelle Landy 23 Jun '22

23 Jun '22

Hello All, We have a new gate blocker on tripleo-ci-centos-9-standalone, scenario-010 and possibly other jobs. The jobs fail tempest test: tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic Details of the failure are in: https://bugs.launchpad.net/tripleo/+bug/1978969. We will reply to this thread as soon as we have more information and/or a fix. Please hold rechecks for now, Thank you, TripleO CI

1 2

Re: [kolla-ansible][xena] Facing network issue when providing SR-IOV support
by Rodolfo Alonso Hernandez 23 Jun '22

23 Jun '22

Hello Harshit: You need first to fix your underlying network configuration. If the interfaces created on "sriovnet1" can't talk to each other this is because your network is blocking this traffic. Check your TOR switches to enable/allow this VLAN range. Regards. On Thu, Jun 23, 2022 at 9:42 AM Harshit Mishra <harshit(a)voereir.com> wrote: > Hello Rodolfo, > > Thanks for your support. > > If the VMs are spawned without any issue, that could be a problem in the > underlying network deployment. When sending traffic from a VM with an > SR-IOV port, try to capture the traffic in the physical function. Please > check the physical network connected to the SR-IOV network cards allow VLAN > traffic in 1000:1009 (according to your configuration). > > Network I have configured of VLAN type in a given range. > > openstack network show 4cacd198-29c3-47b3-bf77-39f1d01c9a22 -c > provider:network_type -c provider:physical_network -c > provider:segmentation_id > +---------------------------+-----------+ > | Field | Value | > +---------------------------+-----------+ > | provider:network_type | vlan | > | provider:physical_network | sriovnet1 | > | provider:segmentation_id | 1002 | > +---------------------------+-----------+ > > > Note: I forget to add that Intra-communication between the VM's working > fine deployed on same HOST but inter-communication not working. > One more thing IP address is not assigning to interfaces of VM. We have to > configure static IP address manually. > > Please find below incoming traffic flow on PF. > > > # tcpdump -i enp8s0f1 > tcpdump: verbose output suppressed, use -v or -vv for full protocol decode > listening on enp8s0f1, link-type EN10MB (Ethernet), capture size 262144 > bytes > 12:39:28.584000 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:88:f5:3e (oui Unknown), length 285 > 12:39:39.183491 IP6 fe80::a236:9fff:fe24:803a > ip6-allrouters: ICMP6, > router solicitation, length 16 > 12:39:49.660269 IP6 fe80::a236:9fff:fe53:e598.5240 > ff02::15a.5240: UDP, > length 221 > 12:39:49.660897 IP6 fe80::a236:9fff:fe53:e59a.5240 > ff02::15a.5240: UDP, > length 221 > 12:39:54.105381 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from a0:36:9f:d8:0d:a8 (oui Unknown), length 293 > 12:39:54.897051 LLDP, length 46 > 12:39:56.281671 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from 3c:fd:fe:cd:06:71 (oui Unknown), length 293 > 12:40:06.286310 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from a0:36:9f:d8:0d:aa (oui Unknown), length 293 > 12:40:15.039416 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from 3c:fd:fe:cd:06:70 (oui Unknown), length 293 > 12:40:19.675902 IP6 fe80::a236:9fff:fe53:e598.5240 > ff02::15a.5240: UDP, > length 221 > 12:40:19.676390 IP6 fe80::a236:9fff:fe53:e59a.5240 > ff02::15a.5240: UDP, > length 221 > 12:40:25.708972 LLDP, length 46 > 12:40:29.288242 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:c4:3f:4f (oui Unknown), length 285 > 12:40:33.008653 IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, > Request from fa:16:3e:88:f5:3e (oui Unknown), length 285 > > > > Another question: do the VMs with SR-IOV port receive the DHCP reply? If > so, at least you know the compute to controller communication is working > (assuming the DHCP agent is on the controller). > > No, VMs not receiving DHCP reply, you can refer above logs. Yes, DHCP > agent is on controller. > > Kindly let me know anything else is required. > > Thanks! > > Regards, > Harshit Mishra > > ------------------------------ > *From:* Rodolfo Alonso Hernandez <ralonsoh(a)redhat.com> > *Sent:* Wednesday, June 22, 2022 6:46 PM > *To:* Harshit Mishra <harshit(a)voereir.com> > *Subject:* Re: [kolla-ansible][xena] Facing network issue when providing > SR-IOV support > > Hello Harshit: > > If the VMs are spawned without any issue, that could be a problem in the > underlying network deployment. When sending traffic from a VM with an > SR-IOV port, try to capture the traffic in the physical function. Please > check the physical network connected to the SR-IOV network cards allow VLAN > traffic in 1000:1009 (according to your configuration). > > Another question: do the VMs with SR-IOV port receive the DHCP reply? If > so, at least you know the compute to controller communication is working > (assuming the DHCP agent is on the controller). > > Regards. > > On Wed, Jun 22, 2022 at 2:17 PM Harshit Mishra <harshit(a)voereir.com> > wrote: > > Hi! > > > I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a > multi-node setup (1 controller+network, multiple computes). > > > > On this cluster I would like to have support for normal, as well as direct > (SR-IOV) vNIC types. > > > > I have done all the pre-requirement like configure VF on SR-IOV network > interface. > > > > In the current deployment, I have created two physnets, one for flat > network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on > Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal > vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct > vNIC. > > > > Mapping of PF with provider in sriov-agent.ini: > > > > # cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini > > [sriov_nic] > > physical_device_mappings = sriovnet1:enp8s0f1 > > exclude_devices = > > > > [securitygroup] > > firewall_driver = neutron.agent.firewall.NoopFirewallDriver > > > > ---------------------------------------------- > > ml2_conf.ini on controller node: > > > > # cat /etc/kolla/neutron-server/ml2_conf.ini > > [ml2] > > type_drivers = flat,vlan,vxlan > > tenant_network_types = vxlan,vlan,flat > > mechanism_drivers = openvswitch,l2population,sriovnicswitch > > extension_drivers = port_security > > > > [ml2_type_vlan] > > network_vlan_ranges = physnet1,sriovnet1:1000:1009 > > > > [ml2_type_flat] > > flat_networks = physnet1,sriovnet1 > > > > [ml2_sriov] > > agent_required = False > > supported_pci_vendor_devs = 8086:10ed > > > > [ml2_type_vxlan] > > vni_ranges = 1:1000 > > > > ---------------------------------------------- > > > > # grep -nr enabled_filters /etc/kolla/nova-scheduler/ > > /etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = > ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter > > > > ---------------------------------------------- > > > > # grep passthrough /etc/kolla/nova-compute/nova.conf > > passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": > "enp8s0f1"}] > > > > > > The interfaces on VMs from normal vNICs are able to communicate > inter-compute. The same is not working for the direct vNICs belonging to > the sriov_network. I have tried multiple config changes, but none seem to > work. > > > > Please help in solving this issue, or suggest a different way of achieving > this if this is wrong or not optimal. > > > > Thanks! > > Regards, > Harshit Mishra > >

1 0

Re: 504 Gateway time out error while loading OpenStack Projects
by Eugen Block 23 Jun '22

23 Jun '22

Please keep the responses in the list so others can see your responses, too, and chime in with their comments. How is your dashboard configured regarding cache? This is our config (/srv/www/openstack-dashboard/openstack_dashboard/local/local_settings.d/_100_local_settings.py): CACHES = { 'default': { 'BACKEND': 'django.core.cache.backends.memcached.MemcachedCache', 'LOCATION': [ '<IP1>:11211', '<IP2>:11211', ] } } Our memcached config has both localhost and its management IP: MEMCACHED_PARAMS="-U 0 -m 64 -l 127.0.0.1,<IP1> -p 11211 -c 4096" The reason for that is we noticed performance improvements when we replaced the list of control nodes for all the services and point to localhost instead: # before #memcached_servers = controller01:11211,controller02:11211 # after memcached_servers = localhost:11211 Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: > Hello, > > My setting in memcache looks like this, because it is default taken by > ansible > > -d > -v > -U 0 > -m 1024 > -p 11211 > -u memcache > -l 172.29.x.X > -c 4096 > -t 4 > > So should i change the time out perimeter to something else > > Regards > Adivya Singh > > On Wed, Jun 15, 2022 at 8:53 PM Maysa De Macedo Souza <mdemaced(a)redhat.com> > wrote: > >> Hello, >> >> Maybe increasing the value of a setting like >> memcache_pool_conn_get_timeout can help? >> >> Cheers, >> Maysa. >> >> On Wed, Jun 15, 2022 at 2:05 PM Eugen Block <eblock(a)nde.ag> wrote: >> >>> Hi, >>> >>> I remember having a similar issue a few years back in an older >>> openstack release, probably Ocata. We had difficulties loading *all* >>> instances in the admin tab in Horizon dashboard. It turned out to be a >>> memcached misconfiguration. I don't recall the details, unfortunately. >>> But I'd start with memcached. >>> >>> >>> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >>> >>> > hi Team, >>> > >>> > We have Xena release installed on Ubuntu Openstack, Lately we are >>> getting >>> > "504 Gateway Timeout error ", As the we moved from 1 node to 3 node Open >>> > Stack >>> > i do not see any error in haproxy , neither there is a time out when i >>> ping >>> > external-VIP-IP configured. >>> > >>> > Apache 2 are also loaded, tried to delete the Horizon Container and >>> created >>> > it again, but no errors, Still the same errors. >>> > >>> > Any guesses on that >>> > >>> > Regards >>> > Adivya Singh >>> >>> >>> >>> >>>

1 0

Neutron/OVN + IPv6
by Tiago Pires 23 Jun '22

23 Jun '22

Hi all, I am trying to figure out how to enable workloads on overlay to use IPv6 addresses and communicate with external networks. I have to use Neutron ML2/OVN in my scenario and I have doubts regarding how the external networks(Internet) can know how to reach the VMs using IPv6 address behind a regular neutron router. I was checking this link https://cloudbau.github.io/openstack/neutron/networking/2016/05/17/neutron-… that uses the BGP speaker on neutron in order to advertise the /64 subnets to a border router, that option should work fine but Neutron/BGP Speaker is not supported with OVN as I could check on the documentation. How are you using IPv6 integration (Neutron/OVN) to advertise the /64 subnets? Tiago Pires

4 4

R: R: R: [Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi
by Molka Gharbaoui 22 Jun '22

22 Jun '22

3 4

[largescale-sig] Next meeting: June 22nd, 15utc
by Thierry Carrez 22 Jun '22

22 Jun '22

Hi everyone, The Large Scale SIG will be meeting this Wednesday in #openstack-operators on OFTC IRC, at 15UTC. You can check how that time translates locally at: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20220622T15 Feel free to add topics to the agenda: https://etherpad.openstack.org/p/large-scale-sig-meeting Regards, -- Thierry Carrez

1 1

[cinder] Bug deputy report for week of 06-22-2022
by Sofia Enriquez 22 Jun '22

22 Jun '22

This is a bug report from 06-15-2022 to 06-22-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Low - https://bugs.launchpad.net/cinder/+bug/1978825 "StorPool: really detach volumes and snapshots after copying to/from an image." Fix proposed to master. Cheers, Sofia -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

add gpu as flavor option
by A Monster 22 Jun '22

22 Jun '22

After deploying openstack and configuring gpu passthrough, I want to be able to see gpus as an option directly from the flavor table not added as a metadata, as shown in the attached table image, how can I achieve this? Screenshot from 2022-06-22 10-06-58.png <https://drive.google.com/file/d/1A1tn1S8JwgOdL0bcjBSaNYq5QSWpjyN4/view?usp=…>

2 1

[Tripleo] Gate blocker - Standalone 9 failing
by Arx Cruz 22 Jun '22

22 Jun '22

Hello, We have another gate blocker on standalone centos 9 job: https://bugs.launchpad.net/tripleo/+bug/1979300 Kind regards, -- Arx Cruz Software Engineer Red Hat EMEA <https://www.redhat.com> arxcruz(a)redhat.com @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 1

Few Open Questions: Openstack vs Proprietary cloud stacks
by KK CHN 22 Jun '22

22 Jun '22

List, Very recently I came across a discussion with a banking corporation who are heavy users of VMware in all their Data Centre operations .. They asked me a lot of questions in comparison with openstack vs other proprietary vendors (such as VMware. ). As I am promoting OpenStack I need to clarify these questions raised by the organization. I request your inputs for these queries . 1. Does OpenStack support Hyper Converged Infrastructure ? Or any HCI vendors already with OpenStack solutions? Please share the URL/link of case studies of OpenStack HCI. Any documentation/Reference to install openstack as HCI solution with supported H/W OEM details . I can try out ... 2. Is there any performance benchmark for openstack to compare with other such cloud stacks ( URL/reference links kindly share ) 3. What is the market share of OpenStack all over the world ? ( If any statistics kindly share.) Any survey reports available how many large and medium organizations are using Openstack distributions for private/public cloud use in production ? 4. Does OpenStack new versions support VDI(Virtual Desktop Infrastructure) solutions out of the box.? pls give a reference link / url for the same. 5. What is the alternative for VROPS and VRA (including self service capabilities, Blueprint/Template based deployment) in OpenStack and any comparative study on the capabilities available. ( Please share inputs if any to refer. ) 6. What is the alternative of VMWARE Network Insights and VMWARE CodeStream and Vrealize Loginsights in OpenStack ? 7. Any major capability available in VMware cloud stack for which alternative is not available in OpenStack out of the box ? 8. Tools to maintain multiple OpenStack Cluster, any concept of Supervisory cluster available 9. Who all are the large organizations who deployed OpenStack as their alternative over proprietary solutions(eg: VMware cloud and virtualization products ..) 10. Does OpenInfra Foundation also provide direct support For OpenStack Deployment ? If yes Kindly share the link / url where to contact /approach for paid support ? in case the clients need paid support ? 11. Regarding security of cloud environments /infrastructure, what are the USPs of OpenStack cloud security over other competing cloud middleware providers ? and the vulnerability handling model/mechanism in production ? Thanks in advance for your invaluable inputs. Each and every input from each member is valuable for me to showcase as solid proofs to defend and promote the openstack over proprietary market leaders. Krish

4 5

[kolla-ansible][xena] Facing network issue when providing SR-IOV support
by Harshit Mishra 22 Jun '22

22 Jun '22

Hi! I have deployed Openstack Xena using kolla-ansible (v13.0.1) on a multi-node setup (1 controller+network, multiple computes). On this cluster I would like to have support for normal, as well as direct (SR-IOV) vNIC types. I have done all the pre-requirement like configure VF on SR-IOV network interface. In the current deployment, I have created two physnets, one for flat network (called physnet1 on br-ex), and one for SR-IOV (called sriovnet1 on Intel 10G 2P X520 card). I am creating one network of VXLAN type for normal vNIC, and one of VLAN type on sriovnet1 (called sriov_network) for direct vNIC. Mapping of PF with provider in sriov-agent.ini: # cat /etc/kolla/neutron-sriov-agent/sriov_agent.ini [sriov_nic] physical_device_mappings = sriovnet1:enp8s0f1 exclude_devices = [securitygroup] firewall_driver = neutron.agent.firewall.NoopFirewallDriver ---------------------------------------------- ml2_conf.ini on controller node: # cat /etc/kolla/neutron-server/ml2_conf.ini [ml2] type_drivers = flat,vlan,vxlan tenant_network_types = vxlan,vlan,flat mechanism_drivers = openvswitch,l2population,sriovnicswitch extension_drivers = port_security [ml2_type_vlan] network_vlan_ranges = physnet1,sriovnet1:1000:1009 [ml2_type_flat] flat_networks = physnet1,sriovnet1 [ml2_sriov] agent_required = False supported_pci_vendor_devs = 8086:10ed [ml2_type_vxlan] vni_ranges = 1:1000 ---------------------------------------------- # grep -nr enabled_filters /etc/kolla/nova-scheduler/ /etc/kolla/nova-scheduler/nova.conf:13:enabled_filters = ComputeFilter,AvailabilityZoneFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,SameHostFilter,DifferentHostFilter,AggregateInstanceExtraSpecsFilter,PciPassthroughFilter ---------------------------------------------- # grep passthrough /etc/kolla/nova-compute/nova.conf passthrough_whitelist = [{"physical_network": "sriovnet1", "devname": "enp8s0f1"}] The interfaces on VMs from normal vNICs are able to communicate inter-compute. The same is not working for the direct vNICs belonging to the sriov_network. I have tried multiple config changes, but none seem to work. Please help in solving this issue, or suggest a different way of achieving this if this is wrong or not optimal. Thanks! Regards, Harshit Mishra

1 0

[Dev] [Skyline] Boot from Image directly
by Oezcan Isik 22 Jun '22

22 Jun '22

Hi, Will Skyline support boot from image directly during instance creation. Instead of choosing a system disk (volume) every time. Kind Regards, -- Ozcan Isik Software Engineer STAG CERN IT

2 1

[TripleO] no more patches for tripleo stable/victoria please (going EOL)
by Marios Andreou 21 Jun '22

21 Jun '22

Hello o/ as proposed at [1][2] we are moving ahead with transitioning stable/victoria tripleo repos to End Of Life. In order to do this we need to have no open patches against stable/victoria. So please stop posting new patches for tripleo stable/victoria and if you have open patches please merge or abandon these by next Tuesday 21st June (for reference, list of repos with currently open patches at [3]). No problem if someone needs a few more days we can wait just please reach out here or on irc. If there are no such requests then I will abandon all open reviews on 21st and respin [2] to pick up any new commits between now and then. thanks for your help, marios [1] http://lists.openstack.org/pipermail/openstack-discuss/2022-June/028829.html [2] https://review.opendev.org/c/openstack/releases/+/845148 [3] (list of repos with open reviews): * https://review.opendev.org/q/project:openstack%252Fos-net-config+status:ope… * https://review.opendev.org/q/project:openstack%252Fpython-tripleoclient+sta… * https://review.opendev.org/q/project:openstack%252Ftripleo-ansible+status:o… * https://review.opendev.org/q/project:openstack%252Ftripleo-common+status:op… * https://review.opendev.org/q/project:openstack%252Ftripleo-heat-templates+s… * https://review.opendev.org/q/project:openstack%252Ftripleo-image-elements+s… * https://review.opendev.org/q/project:openstack%252Ftripleo-puppet-elements+… * https://review.opendev.org/q/project:openstack%252Ftripleo-validations+stat…

4 8

Propose to add Takashi Kajinami as heat core reviewer
by Rico Lin 21 Jun '22

21 Jun '22

Hi all I want to suggest adding Takashi Kajinami <tkajinam(a)redhat.com> as heat core reviewer. Who help provide valid reviews and fixes for issues on heat. Will be great to have Takashi Kajinami join heat core reviewer team and help. *Rico Lin*

4 4

Re: Regarding Floating IP is existing Setup
by Eugen Block 21 Jun '22

21 Jun '22

Could this be a race condition? I saw something similar, too, when a user tried to attach floating IPs via terraform or ansible (I'm not quite sure) at the same time to two different VMs. We could trace it in the Logs that the port was first attached to the first instance and then failed for the other. I don't recall if they use a workaround at the moment or if just works now, will need to check with them. If this is a race condition can you do anything about it in Heat? Like some sort of delay? It could be a bug, though. Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: > Hi Eugen, > > These are orchestration Heat templates, if there is a Single FLoating IP > creation using this templates it works fine, But if there are multiple > floating IP attachment it shows there is a issue on 2 to 3 floating IP > attached to the instance > > Regards > Adivya Singh > > On Tue, Jun 21, 2022 at 5:59 PM Eugen Block <eblock(a)nde.ag> wrote: > >> Do you have ha routers enabled? >> >> > Most of the template having issue , Have all instance having FLoating >> IP, a >> > Stack with a single floating IP have chance of issue very less >> >> I don't quite understand that sentence, could you please clarify? >> >> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >> >> > hi Eugen, >> > >> > The current setup is 3 controller nodes, The Load is not much on each >> > controller and the number of DHCP agent is always set to 2 as per the >> > standard in the neutron.conf, The L3 agent seems to be stables as other >> > router namespace works fine under it, Only few router Namespace get >> > affected under the agent. >> > >> > Most of the template having issue , Have all instance having FLoating >> IP, a >> > Stack with a single floating IP have chance of issue very less >> > >> > Regards >> > Adivya Singh >> > >> > On Tue, Jun 21, 2022 at 1:18 PM Eugen Block <eblock(a)nde.ag> wrote: >> > >> >> Hi, >> >> >> >> this sounds very familiar to me, I had to deal with something similar >> >> a couple of times in a heavily used cluster with 2 control nodes. What >> >> does your setup look like, is it a HA setup? I would start checking >> >> the DHCP and L3 agents. After increasing dhcp_agents_per_network to 2 >> >> in neutron.conf and restarting the services this didn't occur again >> >> (yet). This would impact floating IPs as well, sometimes I had to >> >> disable and enable the affected router(s). If you only have one >> >> control node a different approach is necessary. Do you see a high load >> >> on the control node? >> >> >> >> >> >> Zitat von Adivya Singh <adivya1.singh(a)gmail.com>: >> >> >> >> > hi Team, >> >> > >> >> > We got a issue in Xena release, where we set the environment in Ubuntu >> >> > Platform, But later we get some issues in Floating IP not reachable. >> >> > >> >> > In a Network node, not all router namespace are Impacted and only few >> of >> >> > them get affected, So we can not comment Network node has a issue. >> >> > >> >> > The L3 agent where the Router is tied up, Worked just fine, as other >> >> > routers work Fine. >> >> > >> >> > and the one having issue in Floating IP, if i unassigned and assigned >> it >> >> > starts working most of the time. >> >> > >> >> > Any thoughts on this >> >> > >> >> > Regards >> >> > Adivya Singh >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>

1 0

[Tripleo] - IPv6 Wallaby Undercloud Installation failure
by Anirudh Gupta 21 Jun '22

21 Jun '22

Hi Team, I am trying to deploy Openstack Wallaby Undercloud on IPv6, but facing the below error: 2022-06-14 05:01:23.213708 | 52540083-cfa2-3f20-e9dc-00000000286f | TASK | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4 2022-06-14 05:03:22.912816 | 52540083-cfa2-3f20-e9dc-00000000286f | FATAL | Manage container systemd services and cleanup old systemd healthchecks for /var/lib/tripleo-config/container-startup-config/step_4 | undercloud | error={"changed": false, "msg": "Service ironic_pxe_tftp has not started yet"} 2022-06-14 05:03:22.914400 | 52540083-cfa2-3f20-e9dc-00000000286f | TIMING | tripleo_container_manage : Manage container systemd Sample Undercloud.conf is as follows: [DEFAULT] clean_nodes = true cleanup = false container_cli = podman container_healthcheck_disabled = true container_images_file = /home/stack/containers-prepare-parameter.yaml deployment_user = stack enable_ironic = true enable_ironic_inspector = true enable_neutron = true enable_routed_networks = false generate_service_certificate = false ipv6_address_mode = dhcpv6-stateful ipxe_enabled = true local_interface = enp8s0 local_ip = aaaa:aaaa:aaaa::1/64 subnets = ctlplane-subnet undercloud_admin_host = aaaa:aaaa:aaaa::1 undercloud_hostname = undercloud.com undercloud_ntp_servers = 30.30.30.3 undercloud_public_host = aaaa:aaaa:aaaa::1 undercloud_timezone = UTC [ctlplane-subnet] cidr = aaaa:aaaa:aaaa::/64 dhcp_end = aaaa:aaaa:aaaa::f dhcp_start = aaaa:aaaa:aaaa::a gateway = aaaa:aaaa:aaaa::1 inspection_iprange = aaaa:aaaa:aaaa::3,aaaa:aaaa:aaaa::9 Can someone please help in this regard. Anirudh Gupta

7 21

[nova] custom metric for weigh scheduling
by Arnaud Morin 21 Jun '22

21 Jun '22

Hey nova team, Some context: I want nova-scheduler to favor instances on some computes based on some hypervisor metrics/traits. E.G. I have 2 hypervisors hosting few instances. One of them is having an old kernel, that I will upgrade some day. The second is already having the correct target kernel. I want the scheduler to favor booting on the second host (good kernel). How can I achieve that without disabling the bad_kernel hypervisor? I was thinking about something in the weight scheduler. I was first thinking about using placement traits (having a custom traits) and reading traits from a weight scheduler. But it seems not doable out of the box. And it also seems not a good idea at all to call placement API from weight scheduler. Maybe I am missing something here because I was expecting to have the traits given by placement up to the nova scheduler. Second shoot, I found the metrics weight [1] which rely on the compute monitors. It seems less hacky, but I will still have to write custom monitor to retrieve such metrics. Am I missing an option here? Is there anyone doing such thing is the community? [1] https://github.com/openstack/nova/blob/master/nova/scheduler/weights/metric… [2] https://github.com/openstack/nova/tree/master/nova/compute/monitors Cheers, Arnaud.

1 0

Re: Few Open Questions: Openstack vs Proprietary cloud stacks
by Lazuardi Nasution 21 Jun '22

21 Jun '22

> > > Hi Krish, Please find inline comment based my experience on banking implementation. Best regards. > Date: Tue, 21 Jun 2022 12:29:01 +0530 > From: KK CHN <kkchn.in(a)gmail.com> > To: openstack-discuss(a)lists.openstack.org > Subject: Few Open Questions: Openstack vs Proprietary cloud stacks > Message-ID: > <CAKgGyB8L-tQKR49Ru4tqCzox5C5o57sJZ+LbfHUpxBu== > ecxyQ(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > List, > > Very recently I came across a discussion with a banking corporation who > are heavy users of VMware in all their Data Centre operations .. > > They asked me a lot of questions in comparison with openstack vs other > proprietary vendors (such as VMware. ). > > > As I am promoting OpenStack I need to clarify these questions raised by > the organization. > > I request your inputs for these queries . > > 1. Does OpenStack support Hyper Converged Infrastructure ? > Or any HCI vendors already with OpenStack solutions? Please share the > URL/link of case studies of OpenStack HCI. > Any documentation/Reference to install openstack as HCI solution with > supported H/W OEM details . I can try out ... > Yes, I have experienced with HCI by using OpenStack and Ceph. > 2. Is there any performance benchmark for openstack to compare with other > such cloud stacks ( URL/reference links kindly share ) > I have done some performance test by using CBTool which is the corr of SPEC Cloud IaaS benchmark. So, so the result can be compared with published SPEC Cloud IaaS result as long it has same benchmark parameters. > 3. What is the market share of OpenStack all over the world ? ( If any > statistics kindly share.) > Any survey reports available how many large and medium organizations are > using Openstack distributions for private/public cloud use in production ? > Maybe you can refer to OpenStack surveys. It seem that on any forms (including customized), OpenStack os popular for public cloud. > 4. Does OpenStack new versions support VDI(Virtual Desktop Infrastructure) > solutions out of the box.? pls give a reference link / url for the same. > Actually, VDI consists managed desktop VMs. I haven't use it but maybe Guacamole can be used for VDI on OpenStack. > 5. What is the alternative for VROPS and VRA (including self service > capabilities, Blueprint/Template based deployment) in OpenStack and any > comparative study on the capabilities available. ( Please share inputs if > any to refer. ) > OpenStack includes self service capability. Yes, it has template based deployment like Heat and catalog based deployment like Murano. > 6. What is the alternative of VMWARE Network Insights and VMWARE > CodeStream and Vrealize Loginsights in OpenStack ? > I use other open source products for monitoring and log analysis. Somethink like Prometheus, Loki, etc. > 7. Any major capability available in VMware cloud stack for which > alternative is not available in OpenStack out of the box ? > I have no idea about this. But it is hard to have apple to apple comparison. > 8. Tools to maintain multiple OpenStack Cluster, any concept of > Supervisory cluster available There are some cloud management products which are compatible with OpenStack. But for me, Ansible and/or BASH scripting are good enough. > 9. Who all are the large organizations who deployed OpenStack as their > alternative over proprietary solutions(eg: VMware cloud and virtualization > products ..) > I have no idea with this. > 10. Does OpenInfra Foundation also provide direct support For OpenStack > Deployment ? If yes Kindly share the link / url where to contact > /approach for paid support ? in case the clients need paid support ? > It seem OpenInfra doesn't, but OpenInfra member do. CMIIW. > > 11. Regarding security of cloud environments /infrastructure, what are the > USPs of OpenStack cloud security over other competing cloud middleware > providers ? and the vulnerability handling model/mechanism in production ? > On OpenStack, every tenants can be fully isolated. Anyway, some security products may have another approach to enhance the security. Floating IP concept is good for hiding non service (externally) instance. > Thanks in advance for your invaluable inputs. > > Each and every input from each member is valuable for me to showcase as > solid proofs to defend and promote the openstack over proprietary market > leaders. > > Krish >

1 0

[cinder] cinder backup benji driver.
by Jesper Schmitz Mouridsen 21 Jun '22

21 Jun '22

Hi, I have been looking into using benji-backup[1] in a cinder-backup driver[2]. I have not tested it thoroughly enough yet, but both in devstack and in a multinode setup.(focal victoria). On devstack I get a newer sqlalchemy that satisfies Benji's requirements list. I have not found issues with downgrading Benji to use an earlier version of sqlalchemy found in canonical focal repos. But that also needs some testing. I asked the author of Benji why he chose a version as high as he did. So just a little info about this work. Any comments on the idea? Thanks. Jesper Schmitz Mouridsen. [1] https://benji-backup.me/ [2] https://github.com/jsm222/cinder-backup-benji-driver

1 0

[neutron] CI meeting 21.06 cancelled
by Slawek Kaplonski 20 Jun '22

20 Jun '22

Hi, I will be on PTO this Tuesday and I will not be able to run Neutron CI meeting. We don't have anything really urgent what can't wait one week more so lets cancel this week's meeting. See You on the Neutron CI meeting next week. -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

[kolla][monasca] No more Monasca for AArch64? Or Ubuntu?
by Marcin Juszkiewicz 20 Jun '22

20 Jun '22

Monasca bumped confluent-kafka-python to newer version. And that generates side effects on AArch64 (all distributions Kolla supports) and on Ubuntu 22.04 (any architecture). Why? #error "confluent-kafka-python requires librdkafka v1.9.0 or later. Install the latest version of librdkafka from the Confluent repositories, see http://docs.confluent.io/current/installation.html" Debian/stable has 1.6.0, Ubuntu/22.04 has 1.8.0 versions. On x86-64 architecture we can fetch wheel files for CentOS Stream 8, CentOS Stream 9, Debian/stable and Ubuntu/20.04 as they use Python 3.6/3.8/3.9 versions for which there are wheel files provided by upstream. On Ubuntu 22.04 we have Python 3.10 for which there is no wheel file from upstream... Sure, on x86-64 we can use extra repository from upstream and build 'confluent-kafka-python' from source. And probably we will go that way later in a cycle. But on AArch64 we have no other way than disabling build of Monasca. There is no way to satisfy dependency :( https://review.opendev.org/c/openstack/kolla/+/846800

1 0

[Neutron] What is the best tool for automated data plane testing with openstack?
by ROBERTO BARTZEN ACOSTA 20 Jun '22

20 Jun '22

Hey there, I'm using OpenStack(old version) with neutron OVN CMS-plugin and I need to migrate to the Yoga release (Ubuntu ovn v22.03.0 and ovs v2.17.0). I'm interested in validating a series of fixed issues on openvswitch and ovn in the releases related to the OpenStack Yoga version (e.g. https://github.com/ovn-org/ovn/commit/ccbbbd0584e52c2aa88436a431fe7a6deffd2… ). What OpenStack automated testing tool do you use or recommend to validate the data plane? Best regards Roberto -- _‘Esta mensagem é direcionada apenas para os endereços constantes no cabeçalho inicial. Se você não está listado nos endereços constantes no cabeçalho, pedimos-lhe que desconsidere completamente o conteúdo dessa mensagem e cuja cópia, encaminhamento e/ou execução das ações citadas estão imediatamente anuladas e proibidas’._ * **‘Apesar do Magazine Luiza tomar todas as precauções razoáveis para assegurar que nenhum vírus esteja presente nesse e-mail, a empresa não poderá aceitar a responsabilidade por quaisquer perdas ou danos causados por esse e-mail ou por seus anexos’.*

4 4

[sdk] Question about openstacksdk
by pspal83＠hotmail.com 20 Jun '22

20 Jun '22

Hi All, I am new to OpenStack SDA API and I need help. While I am running my basic py file I am always getting the below error, Please suggest. Code: import openstack conn = openstack.connect(cloud='openstack') for server in conn.compute.servers(): print(server.to_dict()) Error: [pke@vm01 ~]$ python openstack-connect.py Traceback (most recent call last): File "openstack-connect.py", line 7, in <module> for server in conn.compute.servers(): File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 87, in __get__ proxy = self._make_proxy(instance) File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 262, in _make_proxy found_version = temp_adapter.get_api_major_version() File "/usr/local/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 354, in get_api_major_version return self.session.get_api_major_version(auth or self.auth, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1276, in get_api_major_version return auth.get_api_major_version(self, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 500, in get_api_major_version data = get_endpoint_data(discover_versions=discover_versions) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 134, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1149, in post return self.request(url, 'POST', **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 986, in request raise exceptions.from_response(resp, method, url)keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-0e898e09-0dbc-4beb-8414-8dcdc4f6631e) RegardsPradeep Kumar On Monday, 20 June, 2022, 04:54:19 pm IST, pspal83(a)hotmail.com <pspal83(a)hotmail.com> wrote: Hi All, I am new to OpenStack SDA API and I need help. While I am running my basic py file I am always getting the below error, Please suggest. Code: import openstack conn = openstack.connect(cloud='openstack') for server in conn.compute.servers(): print(server.to_dict()) Error: [pke@vm01 ~]$ python openstack-connect.py Traceback (most recent call last): File "openstack-connect.py", line 7, in <module> for server in conn.compute.servers(): File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 87, in __get__ proxy = self._make_proxy(instance) File "/usr/local/lib/python3.6/site-packages/openstack/service_description.py", line 262, in _make_proxy found_version = temp_adapter.get_api_major_version() File "/usr/local/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 354, in get_api_major_version return self.session.get_api_major_version(auth or self.auth, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1276, in get_api_major_version return auth.get_api_major_version(self, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 500, in get_api_major_version data = get_endpoint_data(discover_versions=discover_versions) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 134, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/identity/v3/base.py", line 188, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 1149, in post return self.request(url, 'POST', **kwargs) File "/usr/local/lib/python3.6/site-packages/keystoneauth1/session.py", line 986, in request raise exceptions.from_response(resp, method, url)keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-0e898e09-0dbc-4beb-8414-8dcdc4f6631e) RegardsPradeep Kumar

3 3

[neutron] bug deputy report June 13th to 19th
by Miguel Lavalle 19 Jun '22

19 Jun '22

Hi, Here's this week's bugs deputy report: Requires follow up ============== https://bugs.launchpad.net/neutron/+bug/1979089 l3ha router delete race condition if state changes to master. Waiting for more info from reporter High ==== https://bugs.launchpad.net/neutron/+bug/1978938 [9-stream][master][yoga] ovs/ovn fips jobs fails randomly with DNS issue. Assigned to Yatin Karel. Proposed fix: https://review.opendev.org/c/openstack/neutron/+/846001 Medium ====== https://bugs.launchpad.net/neutron/+bug/1978571 VPNaaS: creating ipsec site connection fails (in master). Assigned to Bodo Petermann. Proposed fix: https://review.opendev.org/c/openstack/neutron-vpnaas/+/845759 https://bugs.launchpad.net/neutron/+bug/1979072 Duplicated port binding registers per port, due to live-migration failures. Assigned to Rodolfo Alonso. Proposed fix: https://review.opendev.org/c/openstack/neutron/+/846422 https://bugs.launchpad.net/neutron/+bug/1979002 DVR router takes too long to learn octavia LB VIP. Unassigned. We may need help from Octavia team RFE === https://bugs.launchpad.net/neutron/+bug/1979044. [RFE] Adding the "rekey" parameter to the api for strongswan like "dpd_action". This is really for vpnass and requires further triaging Incomplete ======== https://bugs.launchpad.net/neutron/+bug/1978775 ovn: ovs-system: deferred action limit reached, drop recirc action. Waiting for more info from reporter

1 0

Re: [ceph-users] Suggestion to build ceph storage
by Satish Patel 19 Jun '22

19 Jun '22

Sent from my iPhone > On Jun 18, 2022, at 10:47 AM, Anthony D'Atri <anthony.datri(a)gmail.com> wrote: > > Please do not CC the list. It was my mistake, sorry about that. > >> 15 Total servers and each server has a 12x18TB HDD (spinning disk) . We >> understand SSD/NvME would be best fit but it's way out of budget. > > NVMe SSDs can be surprisingly competitive when you consider IOPS/$, density, and the cost of the HBA you don’t need. Yes totally and I have only single slot to mount one NvME on motherboard. Let’s say I want to put single M.2 NvME then what size I would go for ? > >> Ceph recommends using a faster disk for wal/db if the data disk is slow and >> in my case I do have a slower disk for data. >> >> Question: >> 1. Let's say if i want to put a NvME disk for wal/db then what size i >> should buy. > > Since you specify 12xHDD, you’re thinking an add-in PCI card? Or do you have rear bays? I have raid controller connected to all drivers in side box. > > >> 2. Do I need to partition wal/db for each OSD or just a single >> partition can share for all OSDs? > > Each OSD. What size of partition I should create for each 18TB OSD? > >> 3. Can I put the OS on the same disk where the wal/db is going to sit ? > > Bad idea. I can understand but I have redundancy of 3 copy just in case of failure. And OS disk doesn’t hammer correct? > >> (This way i don't need to spend extra money for extra disk) > > Boot drives are cheap. I have no extra slot left that is why planning to share but I can explore more. > >> >> Any suggestions you have for this kind of storage would be much >> appreciated. >> _______________________________________________ >> ceph-users mailing list -- ceph-users(a)ceph.io >> To unsubscribe send an email to ceph-users-leave(a)ceph.io >

2 1

Re: [trove] Devstack Installation Fails with Internal Server Error
by Hirotaka Wakabayashi 18 Jun '22

18 Jun '22

Hi, KK CHN # Added [trove] topic to the subject. Please see: # https://wiki.openstack.org/wiki/MailingListEtiquette#Subjects I use CentOS Stream9 but I have successfully installed devstack with Trove. Here is my Jinja2 version in my devstack environment. ``` $ pip list | grep Jinja Jinja2 3.1.2 ``` > https://docs.openstack.org/trove/latest/install/install-devstack.html I will check the docs and update if needed. Thanks in advance, Hirotaka On Friday, June 17, 2022 at 10:45:54 PM GMT+9, <openstack-discuss-request(a)lists.openstack.org> wrote: Send openstack-discuss mailing list submissions to openstack-discuss(a)lists.openstack.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss or, via email, send a message with subject or body 'help' to openstack-discuss-request(a)lists.openstack.org You can reach the person managing the list at openstack-discuss-owner(a)lists.openstack.org When replying, please edit your Subject line so it is more specific than "Re: Contents of openstack-discuss digest..." Today's Topics: 1. Re: Devstack Installation Fails with Internal Server Error (HTTP 500) (KK CHN) ---------------------------------------------------------------------- Message: 1 Date: Fri, 17 Jun 2022 15:46:25 +0530 From: KK CHN <kkchn.in(a)gmail.com> To: openstack-discuss(a)lists.openstack.org Subject: Re: Devstack Installation Fails with Internal Server Error (HTTP 500) Message-ID: <CAKgGyB9jqOQ5tXduxkvNNGL4ewHmm-__YG7zDa4wk+ZhmhYDNg(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" I have tried the Trove Devstack installation on Ubuntu20.04 too.. But no success.. ( As I have made no progress in Debian 11 Trove-Devstak installation, I tried a number of times but all failed with the error ). To my experience.. The same error for Ubuntu 20.04 also. Followed the same stuff : https://docs.openstack.org/trove/latest/install/install-devstack.html The compete Error log here https://paste.openstack.org/show/bwSXZXHRtHWHnaOO2Fb4/ It reports an Error starting with 2022-06-17 09:58:04.720 | ERROR: Cannot install trove==17.1.0.dev31 because these package versions have conflicting dependencies. 2022-06-17 09:58:04.721 | 2022-06-17 09:58:04.721 | The conflict is caused by: 2022-06-17 09:58:04.721 | trove 17.1.0.dev31 depends on Jinja2>=2.10 2022-06-17 09:58:04.721 | The user requested (constraint) jinja2===3.1.2 How to overcome this Jinja dependency, where we need to edit this and what jinja suitable ? 2022-06-17 09:58:04.721 | And finally Exit with error 2022-06-17 09:58:07.560 | + /usr/local/lib/python3.8/dist-packages/diskimage_builder/lib/img-functions:trap_cleanup:38 : exit 1 Error on exit stack@kk:~/devstack$ uname -a Linux kk 5.11.0-27-generic #29~20.04.1-Ubuntu SMP Wed Aug 11 15:58:17 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux stack@kk:~/devstack$ On Thu, Jun 16, 2022 at 11:51 AM KK CHN <kkchn.in(a)gmail.com> wrote: > Update to my Devstack installation Error. > > I have crossed this Internal Error ( HTTP 500) and ended up with a new > error for the Trove Devstack Installation attempts. > ################################################## > 2022-06-16 05:46:40.183 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:26 > : total_kB=16393076 > 2022-06-16 05:46:40.188 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:29 > : RAM_NEEDED=4 > 2022-06-16 05:46:40.192 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:30 > : '[' 16393076 -lt 4194304 ']' > 2022-06-16 05:46:40.197 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:tmpfs_check:30 > : return 0 > 2022-06-16 05:46:40.202 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:cleanup_image_dir:236 > : timeout 120 sh -c 'while ! sudo umount -f /tmp/dib_image.WMpKoawa; do > sleep 1; done' > 2022-06-16 05:46:40.225 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/common-functions:cleanup_image_dir:241 > : rm -rf --one-file-system /tmp/dib_image.WMpKoawa > 2022-06-16 05:46:40.231 | + > /usr/local/lib/python3.9/dist-packages/diskimage_builder/lib/img-functions:trap_cleanup:38 > : exit 1 > Error on exit > # Warning: iptables-legacy tables present, use iptables-legacy to see them > # Warning: iptables-legacy tables present, use iptables-legacy to see them > # Warning: iptables-legacy tables present, use iptables-legacy to see them > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ > > ############################################################################# > > I am able to login to the Horizon dash board inspite the ./stack.sh > script Exit with the above error status.. And in the image section, I am > able to view cirros-0.5.2-x86_64-disk > <http://10.184.48.187/dashboard/ngdetails/OS::Glance::Image/be0c8769-286c-4b…> > image in the dashboard. > > But on the terminal when I issue the command DEVSTACK_TROVE/devstack$ > openstack datastore version list mysql it says > " Datastore 'mysql' cannot found. HTTP(404). > > #############Here the tty output > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ source ./openrc > WARNING: setting legacy OS_TENANT_NAME to support cli tools. > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack datastore > version list mysql > Datastore 'mysql' cannot be found. (HTTP 404) > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack server list > > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack image list > > +--------------------------------------+--------------------------+--------+ > | ID | Name | Status > | > > +--------------------------------------+--------------------------+--------+ > | be0c8769-286c-4b61-b989-a037e0e9601c | cirros-0.5.2-x86_64-disk | active > | > > +--------------------------------------+--------------------------+--------+ > stack@XenaCtrl2:/home/cloud/DEVSTACK_TROVE/devstack$ openstack datastore > version list mysql > Datastore 'mysql' cannot be found. (HTTP 404) > > ####################################################################################### > > > So I ended up with the TROVE installation failing ? Or what does this > error mean ? How can I fix this to get a devstack installed successfully > with Trove-DbaaS feature up and running ? > > > Any help / directions much appreciated .... > > [ How I rectify the earlier errors of HTTP 500 : I just created a VM > again with same debian 11 image and 'stack' user created with /opt/stack > dir and freshly git cloned devstack to DEVSTACK_TROVE/ Dir.. > Then created the same local.conf file which I posted in my earlier mail. > and reran ./stack.sh script . This time I was able to get the > dashboard up and be able to login(earlier it's not possible to get the > dashboard too) ] > > Krish > > > > > > On Wed, Jun 15, 2022 at 12:31 PM KK CHN <kkchn.in(a)gmail.com> wrote: > >> This is my latest devstack installation error.. No clues why it >> fails repeatedly; earlier it was during the uploading stage of the cirros >> image, internal server error ( HTTP 500 ) occurred. This was repeated >> multiple times. So I posted for the first time in this thread. >> >> In this iteration for starting afresh, I have removed the stack user and >> /opt/stack directory manually, and freshly created 'stack' user with sudo >> permissions and /opt/stack directory with stack:stack ownership, and >> fresh git cloned(git clone https://opendev.org/openstack/devstack ) to >> /opt/DEVSTACK_stack folder and created local.conf ( attached here) . >> Then executed ./stack.sh . >> >> Got the following error this time ... Any clues why it fails here ? >> Platform (on a VM with Debian uname output) : Linux XenaCtrl1 >> 5.10.0-9-amd64 #1 SMP Debian 5.10.70-1 (2021-09-30) x86_64 GNU/Linux >> >> [image: Trove_installationError.png] >> >> On Tue, Jun 14, 2022 at 8:46 PM Sean Mooney <smooney(a)redhat.com> wrote: >> >>> On Tue, 2022-06-14 at 06:37 -0700, Dan Smith wrote: >>> > > i hit the same issue the other day if you recall me asking about it. >>> > > didnt check my devstack logs to see if it installed or not but i can >>> > > see if i can repoduce it tomorrow. >>> > >>> > I checked with the OP and they have it installed properly, >>> > system-wide. I was assuming your issue might have been venv (or >>> > ordering) related, but theirs was not. There are some other weird >>> things >>> > going on with their setup, so I'm not so sure. >>> nope, was not useing a vnev or anything special, it just devstack >>> installed normaly more or less >>> but driven by the ansible roles. the run devstack rull litrally just >>> opens a shell and invokes >>> stack.sh so i dont think there was anything specific ot how i was >>> invoking it. >>> >>> > >>> > --Dan >>> > >>> >>>

1 0

[nova]tempest-integrated-compute-centos-9-stream is broken since yesterday
by Balazs Gibizer 18 Jun '22

18 Jun '22

Hi, Please hold you rechecks as $subject is 100% fail on master with error: libvirt.libvirtError: internal error: unable to execute QEMU command 'netdev_add': File descriptor named '(null)' has not been found Cheers, gibi [1]https://zuul.opendev.org/t/openstack/builds?job_name=tempest-integrated-c… [2]https://bugs.launchpad.net/nova/+bug/1979047

2 2

Devstack Installation Fails with Internal Server Error (HTTP 500)
by KK CHN 18 Jun '22

18 Jun '22

List, I am trying Devstack installation on a Virtual Machine to try TROVE DbaaS. All the time ./stack.sh command stops with the same error message at this particular point + functions:_upload_image:121 : openstack --os-cloud=devstack-admin --os-region-name=RegionOne image create cirros-0.5.2-x86_64-disk --public --container-format bare --disk-format qcow2 --property hw_rng_model=virtio Internal Server Error (HTTP 500) I have ./unstack.sh && ./clean.sh and re run ./stack.sh multiple time but no progress. Here always the script exit with error . Screenshot attached (using "stack" user created by the devstack/tool/ stack user script) my local.conf file as follows here 10.184.48.187 is my VMs IP Any hints to rectify this error most welcome!! ############################################################ [[local|localrc]] RECLONE=False HOST_IP=10.184.48.187 enable_plugin trove https://opendev.org/openstack/trove enable_plugin trove-dashboard https://opendev.org/openstack/trove-dashboard LIBS_FROM_GIT+=,python-troveclient DATABASE_PASSWORD=password ADMIN_PASSWORD=password SERVICE_PASSWORD=password SERVICE_TOKEN=password RABBIT_PASSWORD=password LOGFILE=$DEST/logs/stack.sh.log VERBOSE=True LOG_COLOR=False LOGDAYS=1 IPV4_ADDRS_SAFE_TO_USE=10.111.0.0/26 FIXED_RANGE=10.111.0.0/26 NETWORK_GATEWAY=10.111.0.1 FLOATING_RANGE=10.184.48.0/24 PUBLIC_NETWORK_GATEWAY=10.184.48.1 #pre requisites ENABLED_SERVICES=rabbit,mysql,key #nova enable_service horizon enable_service n-api enable_service n-cpu enable_service n-cond enable_service n-sch enable_service n-api-meta enable_service placement-api enable_service placement-client #Glance enable_service g-api enable_service g-reg #Cinder enable_service cinder enable_service c-api enable_service c-vol enable_service c-sch #Neutron enable_service q-svc enable_service q-agt enable_service q-dhcp enable_service q-l3 enable_service q-meta #enable DVR Q_AGENT=openvswitch Q_DVR_MODE=legacy Q_ML2_PLUGIN_MECHANISM_DRIVERS=openvswitch Q_ML2_TENANT_NETWORK_TYPE=vxlan Q_PLUGIN=ml2 #SWIFT ENABLED_SERVICES+=,swift SWIFT_HASH=66a3d6b56c1f479c8b4e70ab5c2000f5 SWIFT_REPLICAS=1 stack@XenaCtrl1:/home/cloud/trove_devstack/devstack$ #################################################################

8 19