July 2021 - openstack-discuss - lists.openstack.org

[doc][requirements] Sphinx 4.1.1 broken with wsmeext.sphinxext
by Pierre Riteau 27 Jul '21

27 Jul '21

Hello, Sphinx was bumped to version 4.1.1 in upper constraints just earlier today [1]. It has broken our CloudKitty documentation build [2]: Running Sphinx v4.1.1 loading stevedore.sphinxext Extension error: Could not import extension wsmeext.sphinxext (exception: cannot import name 'PyClassmember' from 'sphinx.domains.python' Both aodh and mistral are also impacted [3]. [1] https://review.opendev.org/c/openstack/requirements/+/802179/4/upper-constr… [2] https://zuul.opendev.org/t/openstack/build/86ec39a3fc84485b8f6b1e05f94c7190 [3] https://codesearch.opendev.org/?q=wsmeext.sphinxext&i=nope&files=&excludeFi…

3 2

[wallaby][nova] Host Evacuate Instances
by Ammad Syed 27 Jul '21

27 Jul '21

Hi, I am using openstack wallaby. I am testing to evacuate instances from failed host. The feature works fine. The instances on cinder backed shared storage rebuild on other host and their data is preserved. However the instances that are on local compute storage rebuild with fresh image on other host and data on root disk was lost. The question is, is it possible to evacuate all instances from failed host that are on shared storage only ? Ammad

3 4

[all] Broken gate caused by Block Storage API v2 removal
by Takashi Kajinami 27 Jul '21

27 Jul '21

# the similar topic was sent for some specific projects already but # let me send this with [all] to get attention from all projects. Hello, As you might know, Block Storage API v2 was deprecated during Pike cycle and now cinder is removing that deprecated API completely in current Xena. However unfortunately there are some projects still using volume v2 API and especially the recent bump of python-cinderclient[1], which completely removes cinderclient.v2, broke such usage. [1] https://review.opendev.org/c/openstack/requirements/+/801759 I went through the following search results[2] and submitted fix for some projects[3], but I'd recommend you check your own projects to find any remaining usage of v2 API. [2] https://codesearch.opendev.org/?q=volumev2&i=nope&files=&excludeFiles=&repo… https://codesearch.opendev.org/?q=cinderclient.v2&i=nope&files=&excludeFile… [3] https://review.opendev.org/q/topic:"volumev2-removal" It seems charm repos are still referring to removed cincetclient.v2 in addition to cinderclient.v1, which looks very strange to me. However I'm not familiar with charm so I'd leave that to anyone actually involved in the project. Thank you, Takashi

2 1

[neutron] Bug Deputy Report July 19 - Jul 26
by Lucas Alvares Gomes 26 Jul '21

26 Jul '21

High: * https://bugs.launchpad.net/neutron/+bug/1936911 - " Scenario test test_established_tcp_session_after_re_attachinging_sg is failing on the linuxbridge backend" Unassigned * https://bugs.launchpad.net/neutron/+bug/1936959 - "[OVN Octavia Provider] Unable to delete Load Balancer with PENDING_DELETE" Assigned to: Brian Haley Medium: * https://bugs.launchpad.net/neutron/+bug/1936839 - "Ingress bw-limit with DPDK does not work" Assigned to: Bence Romsics * https://bugs.launchpad.net/neutron/+bug/1936980 - " [DVR] ARP entries for allowed address pairs with IPv4 addresses are added using qr- interface from IPv6 subnets" Assigned to: Slawek Kaplonski * https://bugs.launchpad.net/neutron/+bug/1937039 - "dsvm-functional can not run due to some ovs/ovn commands not found" Unassigned Needs further triage: * https://bugs.launchpad.net/neutron/+bug/1937093 - "ERROR neutron.pecan_wsgi.hooks.translation designateclient.exceptions.Forbidden: Forbidden" Unassigned * https://bugs.launchpad.net/neutron/+bug/1937261 - " python3-msgpack package broken due to outdated cython" Unassigned Cheers, Lucas

1 0

[kolla][kolla-ansible] Query regarding Kolla Image Tag vs Release name
by Anirudh Gupta 26 Jul '21

26 Jul '21

Hi Team, I am installing Openstack using Kolla-Ansible. I have following queries: 1. Tag 11.0.0 corresponds to the Openstack Victoria release. On docker hub,There are 2 types of tag for a particular kolla image - One with the Tag name and other Release name. docker pull kolla/centos-binary-ironic-pxe:victoria docker pull kolla/centos-binary-ironic-pxe:11.0.0 Image for Tag 11.0.0 was updated 6 months ago whereas for Victoria release the image is updated 4 days ago. To deploy kolla ansible in the production environment, what should we set in openstack_release field in globals.yml - tag number or release name ? 2. For wallaby Release, there is no tag 12.0.0 defined in docker hub kolla images. Is there any plan to specify kolla images with tag for wallaby or not? Regards Anirudh Gupta

2 1

Fwd: gerrit no longer lading from iphone
by Radosław Piliszek 25 Jul '21

25 Jul '21

Forwarding misrouted Sorin's message here. :-) Also CC'ing Clark due to the attachment. ---------- Forwarded message --------- From: Sorin Sbarnea <ssbarnea(a)redhat.com> Date: Sun, Jul 25, 2021 at 8:48 PM Subject: Re: gerrit no longer lading from iphone To: Radosław Piliszek <radoslaw.piliszek(a)gmail.com> It is crashing trying to load the oage. I attached screenshot, I am not yet sure how to extract more info. Is bit weird in a decade of using ios, i found only few cases with errors like this. The crash happens even in private mode but it does not happen with Google app internal browser (suppose Chrome). Url I used https://review.opendev.org/c/openstack/python-tripleoclient/+/802032 I should mention that loading root url works. Considering that it takes a long time to crash I suppose is loading some js code that exceeds memory limits and safari is killing the process. Maybe is related to the build status code? I may look more tomorrow as I do not want to finish my Sunday evening on desktop ;) On Sun, 25 Jul 2021 at 19:01, Radosław Piliszek <radoslaw.piliszek(a)gmail.com> wrote: > > On Sun, Jul 25, 2021 at 7:25 PM Clark Boylan <cboylan(a)sapwetik.org> wrote: > > > > On Sun, Jul 25, 2021, at 9:58 AM, Radosław Piliszek wrote: > > > On Sun, Jul 25, 2021 at 6:51 PM Sorin Sbarnea <ssbarnea(a)redhat.com> wrote: > > > > > > > > I am wondering if something was changed on our gerrit deployment recently as it seems to no longer load on ios safari. > > > > > > Yeah, it was updated recently. > > > Most likely it broke compat. > > > > The server moved but the software wasn't changed (using the same docker image). When you say it doesn't load do you get the "This Server has Moved" page we put on the old server? Or maybe you get no connection at all? Unfortunately "it no longer loads" could be one of many things, and I don't have an ios device to try and reproduce. It does load in firefox and chrome on my desktop and chrome on my android device. > > Ah, thanks for clarifying. > For me, it started working snappier so I thought it had some software > improvement as well. ;-) > > -yoctozepto > > > Clark > > > -- -- /zbr

1 0

[cloudkitty] No indexes in the rated_data_frames table
by Thomas Goirand 24 Jul '21

24 Jul '21

Hi, Very fast, with only a few resources, the rated_data_frames tables becomes huge. I was very surprised to see there's absolutely zero index in this table. Isn't a "openstack rating dataframes get" querying this table, with tenant_id and begin / end as filters? Wouldn't the API calls be a lot more efficient with such indexes? Cheers, Thomas Goirand (zigo)

3 2

[sdk] PTL on PTO
by Artem Goncharov 24 Jul '21

24 Jul '21

Hi, I will be trying to enjoy my vacation and will be back on Monday 16.08.2021. For anything urgent hopefully someone from the SDK/CLI team is still reachable, but anyway do not hesitate to write here (I will be still “reachable”). Regards, Artem

1 0

[all][tc] What's happening in Technical Committee: summary 23th July, 21: Reading: 5 min
by Ghanshyam Mann 23 Jul '21

23 Jul '21

Hello Everyone, Here is last week's summary of the Technical Committee activities. 1. What we completed this week: ========================= * Retired django-openstack-auth[1] * Properly retired neutron-lbaas[2] * Deprecated os-panko role[3] 2. TC Meetings: ============ * TC held this week meeting on Thursday; you can find the full meeting logs in the below link: - https://meetings.opendev.org/meetings/tc/2021/tc.2021-07-22-15.00.log.html * We will have next week's meeting on July 29th, Thursday 15:00 UTC[4]. 3. Activities In progress: ================== TC Tracker for Xena cycle ------------------------------ TC is using the etherpad[5] for Xena cycle working item. We will be checking and updating the status biweekly in the same etherpad. Open Reviews ----------------- * Six open reviews for ongoing activities[6]. Migration from Freenode to OFTC ----------------------------------------- * Still many projects left to merge these small changes. requesting core team of those repos to merge them. ** https://review.opendev.org/q/topic:%2522oftc%2522+status:open * All the required work for this migration is tracked in this etherpad[7] Test support for TLS default: ---------------------------------- * Rico has started a separate email thread over testing with tls-proxy enabled[8], we encourage projects to participate in that testing and help to enable the tls-proxy in gate testing. Project updates: ------------------- * Retiring js-openstack-lib [9] * Retiring tripleo-common-tempest-plugin[10] Yoga release community-wide goal ----------------------------------------- * Please add the possible candidates in this etherpad [11]. * Current status: One goal "Secure RBAC" is proposed. Other Changes ------------------ * Defining Yoga release testing runtime12] PTG planning ---------------- * TC booked three slots: ** 1. Monday 15-17 UTC for TC + Community Leaders ** 2. Thursday 13-17 UTC ** 3. Friday 13-17UTC * We are collecting the PTG topics in etherpad[13], feel free to add any topic you want to discuss. 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[14]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [15] 3. Office hours: The Technical Committee offers a weekly office hour every Tuesday at 0100 UTC [16] 4. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://review.opendev.org/c/openstack/governance/+/800471 [2] https://review.opendev.org/c/openstack/governance/+/800148 [3] https://review.opendev.org/c/openstack/governance/+/799817 [4] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [5] https://etherpad.opendev.org/p/tc-xena-tracker [6] https://review.opendev.org/q/project:openstack/governance+status:open [7] https://etherpad.opendev.org/p/openstack-irc-migration-to-oftc [8] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023000.html [9] https://review.opendev.org/c/openstack/governance/+/798540 [10] https://review.opendev.org/c/openstack/governance/+/800432 [11] https://etherpad.opendev.org/p/y-series-goals [12] https://review.opendev.org/c/openstack/governance/+/799927 [13] https://etherpad.opendev.org/p/tc-yoga-ptg [14] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [15] http://eavesdrop.openstack.org/#Technical_Committee_Meeting [16] http://eavesdrop.openstack.org/#Technical_Committee_Office_hours -gmann

1 0

[neutron] PTL on holidays
by Slawek Kaplonski 23 Jul '21

23 Jul '21

Hi, I will be on PTO from 24.07 and I will be back on Monday 1.08.2021. For anything related to Neutron, please reach out to our drivers team [1] or core team [2]. For any release related things, please reach out to Akihiro who is our release liaison. Due to my holidays I'm also canceling our next week's meetings. There will be no team meeting and ci meeting on Tuesday 27.07. Drivers team meeting on Friday will be chair by Miguel. Have a great week. [1] https://review.opendev.org/admin/groups/ 5b063c96511f090638652067cf0939da1cb6efa7,members [2] https://review.opendev.org/admin/groups/ 9b227d5d1b27471dacbe9a9161904ec115a74138,members -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

[masakari] Blueprints cleanup
by Radosław Piliszek 23 Jul '21

23 Jul '21

Dears, I have cleaned up the blueprints for Masakari [1], closing the completed ones and assigning targets and priorities to the discussed (initially-approved) ones. In other words, the implemented blueprints are hidden and those in some kind of current motion have their priority-assignee-series properly set. I have also updated the progress statuses on active and linked to relevant commits (where missing). [1] https://blueprints.launchpad.net/masakari -yoctozepto

1 0

[TripleO] Gate blocker - please hold rechecks
by Marios Andreou 23 Jul '21

23 Jul '21

folks we have a gate blocker for tripleo at https://bugs.launchpad.net/tripleo/+bug/1937333 but resolution is in progress please hold rechecks or at least check if you are hitting that issue before doing so thank you! happy friday o/ ;)

1 1

Unable to Mount LVM data volume when uploading qcow2 files
by KK CHN 23 Jul '21

23 Jul '21

Members, We are in need of migrating of VMs from another vendor who has hosted all the VMs on their host machine using KVM. hypervisor. No OpenStack they are using. We want to migrate these VMs to our fresh OpenStack Ussuri environment setup with two host machine which using KVM and Debian as Host Operating System. ( The VMs are in RedHat,CentOS and Windows machines ) The vendor has provided each VM as Three files(qcow2 files). Because they are using additional disks for each partition. They are telling us they can provide this way only. They are unable to provide as single file( I'm also not sure whether there is a way to get it as single file ? ) The existing Vendor provides the files for each VM as follows. 1. First file is Operating Sytem ( CentOS) qcow2 image 2. Second file is Boot file system as qcow2 image. 3. Third file is data volume(LVM data also qcow2 image) : The data volume which contains the application data. When we are uploding these files to OpenStack glance using Horizon dashboard the first two files Operating Sytem and boot files are detected for the VM. But the Third file unable to attach. Its not detecting. So I tried manually mount the data volume in command line but it throws error "unknown filesystem type 'LVM2_member' #mount /dev/vdc2 /mnt/ mount:unknown filesystem type 'LVM2_member' // here vdc2 is the data volume in question. // /dev/vda1 is the OS partion which when uploaded to glance through horizon no error in mounting. similarly /dev/vdc1 the boot partion also able to attach through horizon dash board. Only the data volume is not getting attached and when manually tried to mount that volume /dev/vdc2 throws the error "mount:unknown filesystem type 'LVM2_member' " How to resolve this issue ? whats the root cause ? Kindly share your inputs . Thanks in advance Kris

2 1

[nova][placement] PTL is on vacation
by Balazs Gibizer 23 Jul '21

23 Jul '21

Hi, FYI, next week I will be on PTO. Sylvain volunteered to chair the weekly nova meeting next week. cheers, gibi

1 0

[nova][sdk] Gate is broken due to block storage v2 removal
by Balazs Gibizer 22 Jul '21

22 Jul '21

Hi, Cinder merged the removal of the block storage v2 API[1]. This broke the openstacksdk-functional-devstack job blocking at least the nova and openstack-sdk gate[2] due to test cases in the job still trying to test the v2 API. I've proposed a patch to remove those functional tests[3]. Please hold your recheck until [3] merges. Cheers, gibi [1] https://review.opendev.org/c/openstack/cinder/+/792299 [2] https://zuul.opendev.org/t/openstack/builds?job_name=openstacksdk-functiona… [3] https://review.opendev.org/c/openstack/openstacksdk/+/801864

2 2

[tc][ptl] TC + PTL interaction in Yoga Virtual PTG
by Ghanshyam Mann 22 Jul '21

22 Jul '21

Hello Everyone, In one of the previous TC meeting, we discussed about having the TC and PTLs (project leaders) interaction sessions in PTG. The goal of this session is: * To improve the interaction between TC and PTLs. * Discuss about the things we as TC or as community need to improve. * Any required change in the process or so which project leaders think can be helpful in the development cycle or overall project health. I have created the below etherpad with the draft agenda , If you as PTL or project representatives would like to attend this session, please add your name under L38 section: - https://etherpad.opendev.org/p/tc-ptl-interaction I am thinking we can plan this session for two hours either on Monday or Tuesday. Please add your preference in the below doodle poll (including TC members): - https://doodle.com/poll/ua72h8aip4srsy8s -gmann

2 4

Need information
by Gk Gk 22 Jul '21

22 Jul '21

Hi, I want to know if tenant isolation and overlapping ips, possible in the case of provider vlan networks ? If not, how is it different when compared to tenant networks of type vlan where tenant isolation is possible ? Please explain. I am confused between the two regarding their tenant isolation and overlapping ips features. Thanks Kumar

2 3

[neutron] Drivers meeting - agenda for 23.07.2021
by Slawek Kaplonski 22 Jul '21

22 Jul '21

Hi, Agenda for tomorrow's drivers meeting is available at https:// wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda We have 3 RFEs to discuss: * https://bugs.launchpad.net/neutron/+bug/1933222 - [RFE] Add distributed datapath for metadata - This is continuation from the last meeting 2 weeks ago. * https://bugs.launchpad.net/neutron/+bug/1933517 - [RFE][OVN] Create an intermediate OVS bridge between VM and intergration bridge to improve the live-migration process * https://bugs.launchpad.net/neutron/+bug/1935847 - [RFE] Basic Authentication Support for Standalone Neutron Please check those RFEs, ask questions if You have any and see You tomorrow on the meeting. -- Slawek Kaplonski Principal Software Engineer Red Hat

2 2

[octavia] PTL on vacation - Meetings cancelled
by Gregory Thiemonge 22 Jul '21

22 Jul '21

Hi, I'll be on PTO for 2 weeks, I'll be back on August 9th. As discussed during the previous weekly meeting, the next two Octavia meetings are cancelled. The next meeting is on August 11th. Greg

1 0

]ops] Something wrong with rabbit settings
by Massimo Sgaravatto 22 Jul '21

22 Jul '21

Dear all I am afraid I have something wrong in the setup of rabbit, and I would appreciate your help. We have a single rabbit cluster for all the OpenStack services. It is a cluster composed by 3 instances (now running rabbitmq-server-3.8.16 and erlang-24.0.2). We are using this setting: cluster_partition_handling = pause_minority to handle partitions, and we are using this policy: [root@cld-rbt-01 ~]# rabbitmqctl list_policies Listing policies for vhost "/" ... vhost name pattern apply-to definition priority / ha-all ^(?!amq\.).* all {"ha-mode":"all"} 0 In the conf files of the OpenStack services we have these settings related to Rabbit: transport_url = rabbit://openstack_prod:xxx@192.168.60.220:5672, openstack_prod:xxx@192.168.60.221:5672, openstack_prod:xxx@192.168.60.222:5672 rabbit_ha_queues = true >From time to time rabbit complains about some network partitions (still not clear why): 2021-07-02 08:12:55.715 [error] <0.463.0> Partial partition detected: * We saw DOWN from rabbit@cld-rbt-02 * We can still see rabbit@cld-rbt-03 which can see rabbit@cld-rbt-02 * pause_minority mode enabled We will therefore pause until the *entire* cluster recovers and when this happens Openstack services are of course impacted. As soon as I can check the cluster status, rabbitmqctl cluster_status doesn't complain about any problems (i.e. it doesn't report any network partitions and it reports all nodes running) but the problems on the OpenStack services are still there (e.g. "neutron agent-list" report many agents down). I need to restart the rabbit cluster in order to have OpenStack services working again Any hints ? Thanks, Massimo

4 5

[nova][placement] Yoga PTG
by Balazs Gibizer 22 Jul '21

22 Jul '21

Hi, It is time again to discuss and agree on what time we will meet during the PTG week (18 - 22 Oct). I created a doodle [1]. Please make your votes there about the timing. The final date to register our time slots is 21th of July so I ask you to make your vote not later than 20 of July, so I can make the registration in time. Also I think we should discuss how many slots we need. In the last two PTGs we tried finish our etherpad in 3 days x 4 hour slots. But in both cases some overtime was needed. How do you feel, should we book for 4 days x 4 hours slots this time instead? I created the PTG etherpad so we can start collecting the topics[2]. If you have cross project topics, then please either agree with the other team about the timing of the discussion or let me know and I will arrange for the slot. Cheers, gibi [1] https://doodle.com/poll/yetctyhufnn6g8hn [2] https://etherpad.opendev.org/p/nova-yoga-ptg

2 4

[Kolla] [ Kolla-Ansible] Kolla Ansible Downgrade Issue
by Richa Gupta 22 Jul '21

22 Jul '21

Hi Team, I installed Kolla-Ansible release 12.0.0, i.e. wallaby on multinode setup, and then downgraded Kolla-Ansible to release 11.0.0, i.e. Victoria, following the below-mentioned link: https://docs.openstack.org/kolla-ansible/latest/user/operating-kolla.html I downgraded Kolla-Ansible by running the command "*pip install --upgrade kolla-ansible==6.0.0*" and, changing "openstack_release: victoria" in globals.yml. But, "*kolla-ansible upgrade*" failed with the below error (Error also attached in the mail) : "alembic.util.exc.CommandError: Can't locate revision identified by 'wallaby_contract01'" Could you please suggest if the downgrade is supported in Kolla-Ansible? Best Regards, Richa Gupta

3 3

[all][neutron][qa] Gate status: tempest-full-py3, tempest-slow-py3 or few more jobs are broken: "Donot recheck"
by Ghanshyam Mann 21 Jul '21

21 Jul '21

Hello Everyone, Since 2-3 hrs before, tempest-full-py3, tempest-slow-py3 and few more jobs started failing consistently in create_neutron_initial_network() method: "++ lib/neutron_plugins/services/l3:create_neutron_initial_network:214 : oscwrap --os-cloud devstack-admin --os-region RegionOne network create --project a6b71b541987471595bf5e38f5fbe264 private" - https://zuul.openstack.org/builds?job_name=tempest-full-py3 - https://zuul.openstack.org/builds?job_name=tempest-slow-py3 Strange is that 'tempest-integrated-storage'|'compute' jobs are passing even the configuration is almost the same. Slaweq reported the below bug and trying some neutron revert to know the root cause. He will check it tomorrow morning. - https://bugs.launchpad.net/neutron/+bug/1936983 Until we find the root cause/fix, do not recheck on these failures. -gmann

5 8

[kolla][glance][cinder] issues with show_image_direct_url and show_multiple_locations in wallaby
by J-P Methot 21 Jul '21

21 Jul '21

Hi, As you might already know if you read this mailing list, I've been trying to push Kolla into production for a while. This issue however might be more Glance and Cinder related than Kolla. We're trying to provision an Openstack Wallaby cluster on Ubuntu using Kolla and Ceph pacific. The issue I now have is that, if I try to provision a Ceph volume from an image stored in Ceph, I get the following error : https://pastebin.com/59EZbxKu By looking around a bit, I figured out that this is linked to the following mailing list email : https://www.spinics.net/lists/ceph-users/msg66016.html Ceph copy on write cloning breaking because Cinder can't work ifshow_image_direct_url is set to true is a pretty big issue, I believe. It's possible that this has been talked about before, but there's no other trace I could find outside of that Ceph mailing list email. Additionally, in Kolla, setting show_image_direct_url to false doesn't solve this issue because by default, Kolla appears to also set show_multiple_locations to true. By setting show_multiple_locations to false through a custom configuration, I am able to create volumes from glance Ceph images again (images have to be re-uploaded for this to work though). Of course, these volumes are not created through copy-on-write, because that's broken. I couldn't find any bug report pertaining to these issues. If they are not known, then I would be happy to make a bug report. I would just like to verify if this is all already known or not. -- Jean-Philippe Méthot Senior Openstack system administrator Administrateur système Openstack sénior PlanetHoster inc.

2 1

[all][tc] Technical Committee next weekly meeting on July 22th at 1500 UTC
by Ghanshyam Mann 21 Jul '21

21 Jul '21

Hello Everyone, Technical Committee's next weekly meeting is scheduled for July 22th at 1500 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Wednesday, June 21th, at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1