- openstack-discuss - lists.openstack.org

[blazar][requirements] setuptools and python_version in upper constraints
by Pierre Riteau 14 Apr '22

14 Apr '22

Hello, In the blazar project, we have been seeing a job timeout failure in openstack-tox-py39 affecting master and stable/yoga. tox starts the "lockutils-wrapper python setup.py testr --slowest --testr-args=" process which doesn't show progress until job timeout. It started happening sometime between 2022-03-10 16:01:39 (last success on master) and 2022-03-24 16:35:15 (first timeout occurrence) [1], with no change in blazar itself and few changes in requirements. I resumed debugging today and managed to reproduce it using Ubuntu 20.04 (it doesn't happen on macOS). Here is the traceback after interrupting it if anyone wants to take a look [2]. The python process is using 100% of the CPU until interrupted. I tracked down the regression to the upper constraint on setuptools. For example, stable/yoga has: setuptools===59.6.0;python_version=='3.6' setuptools===60.9.3;python_version=='3.8' It appears this is ignored in the py39 job so the job runs with the latest setuptools. Indeed, there were some releases between March 10 and March 24. I still have to figure out what changed in setuptools to cause this behaviour. Question for requirements maintainers: is this expected behaviour, or should upper constraints also include lines for python_version=='3.9' on yoga? Thanks, Pierre Riteau (priteau) [1] https://zuul.openstack.org/builds?job_name=openstack-tox-py39&project=opens… [2] https://paste.opendev.org/show/bZO7ELmTvfMUGJPdlQ4k/

5 5

[cinder][PTG] Summary of Zed PTG
by Rajat Dhasmana 14 Apr '22

14 Apr '22

Hi All, Here is a summary of Cinder Zed PTG[1] conducted from 05th April - 8th April, 2022 from 1300 to 1700 UTC each day. Please look at the topic summary and the action items if you were the author for any topic. [1] https://wiki.openstack.org/wiki/CinderZedPTGSummary Thanks and regards Rajat Dhasmana

1 0

R: [devstack] Not able to install devstack on ubuntu 20.04
by Molka Gharbaoui 13 Apr '22

13 Apr '22

Thank you Jeremy for your prompt reply! Changing the directories ownership definetly does not work for me. Other many errors are generated. I will follow the threads to check if hopefully a better solution is suggested. ________________________________ Da: Jeremy Stanley Inviato: Mercoledì, 13 Aprile, 2022 18:53 A: openstack-discuss(a)lists.openstack.org Oggetto: Re: [devstack] Not able to install devstack on ubuntu 20.04

1 0

[devstack] Not able to install devstack on ubuntu 20.04
by Molka Gharbaoui 13 Apr '22

13 Apr '22

Hi all, I am trying to install devstack by downloading the cose through the following link: git clone https://opendev.org/openstack/devstack and then executing ./stack command which I used to use several times without any error. However, today I am getting the following error (I only changed the VM): Obtaining file:///opt/stack/keystone Preparing metadata (setup.py) ... error error: subprocess-exited-with-error × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [16 lines of output] Error parsing Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/pbr/core.py", line 111, in pbr attrs = util.cfg_to_args(path, dist.script_args) File "/usr/local/lib/python3.8/dist-packages/pbr/util.py", line 272, in cfg_to_args pbr.hooks.setup_hook(config) File "/usr/local/lib/python3.8/dist-packages/pbr/hooks/__init__.py", line 25, in setup_hook metadata_config.run() File "/usr/local/lib/python3.8/dist-packages/pbr/hooks/base.py", line 27, in run self.hook() File "/usr/local/lib/python3.8/dist-packages/pbr/hooks/metadata.py", line 25, in hook self.config['version'] = packaging.get_version( File "/usr/local/lib/python3.8/dist-packages/pbr/packaging.py", line 872, in get_version raise Exception("Versioning for this project requires either an sdist" Exception: Versioning for this project requires either an sdist tarball, or access to an upstream git repository. It's also possible that there is a mismatch between the package name in setup.cfg and the argument given to pbr.version.VersionInfo. Project name keystone was given, but was not able to be found. error in setup command: Error parsing /opt/stack/keystone/setup.cfg: Exception: Versioning for this project requires either an sdist tarball, or access to an upstream git repository. It's also possible that there is a mismatch between the package name in setup.cfg and the argument given to pbr.version.VersionInfo. Project name keystone was given, but was not able to be found. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. +inc/python:pip_install:1 exit_trap +./stack.sh:exit_trap:523 local r=1 ++./stack.sh:exit_trap:524 jobs -p +./stack.sh:exit_trap:524 jobs= +./stack.sh:exit_trap:527 [[ -n '' ]] +./stack.sh:exit_trap:533 '[' -f '' ']' +./stack.sh:exit_trap:538 kill_spinner +./stack.sh:kill_spinner:433 '[' '!' -z '' ']' +./stack.sh:exit_trap:540 [[ 1 -ne 0 ]] +./stack.sh:exit_trap:541 echo 'Error on exit' Error on exit +./stack.sh:exit_trap:543 type -p generate-subunit +./stack.sh:exit_trap:544 generate-subunit 1649867885 63 fail +./stack.sh:exit_trap:546 [[ -z /opt/stack/logs ]] +./stack.sh:exit_trap:549 /usr/bin/python3.8 /opt/stack/devstack/tools/worlddump.py -d /opt/stack/logs World dumping... see /opt/stack/logs/worlddump-2022-04-13-163909.txt for details +./stack.sh:exit_trap:558 exit 1 Changing the owner of the directories using the following commands allows to go further in the installation process: sudo chown -R root:root /opt/stack/horizon/ sudo chown -R root:root /opt/stack/nova/ sudo chown -R root:root /opt/stack/cinder/ etc. However, then I am getting other errors related to permissions issues so I guess changing the directories ownership is not the solution. Could you please help me in resolving this. Thank you in advance!

2 1

[neutron][ovn] Need VM accessible on Internet, and able to access DC resources
by Chris DiLorenzo 13 Apr '22

13 Apr '22

To Internet To Data Center Resources (10.x) - -/ - -/ / -/ / -/ / -/ -/ -/ / -/ / Public Provider Network / Private Provider Network / +------------------------+ +-------------------------+ | | | | | | | | | Router #1 |--------------| Router #2 | | SNAT Enabled | .2| SNAT Enabled | | | | | | | | | +------------------------+ +-------------------------+ | 192.168.1.1 | | | | | | | | | 192.168.1.10 (FIP: Public IP) +---------|-------------+ | | | | | | | VM | | | | | +-----------------------+ I am running Openstack Xena with OVN and distributed FIP enabled. We are trying to come up with a way to make a VM accessible from the Internet and still have it able to access internal Data Center services. Our thought is to setup a router between the tenant network and an internet accessible provider network. We'll assign a FIP to the VM. Then, we create an additional router that connects to the same tenant network but routes to a provider network that has access to everything inside the DC. We would then add a static route on Router #1 like 10.0.0.0/8 nexthop 192.168.1.2. I've tried setting this up in our lab, but it's not working. I can't ping to anything inside the DC. Should this work? Any best practice here we should look at? Thanks Chris

1 0

[cinder] Bug deputy report for week of 04-13-2022
by Sofia Enriquez 13 Apr '22

13 Apr '22

This is a bug report from 03-30-2022 to 04-13-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- High - https://bugs.launchpad.net/os-brick/+bug/1967790 " Encryptor connect_volume not changing the symlink." Fix proposed to marter. Medium - https://bugs.launchpad.net/cinder/+bug/1968746 "cinder-manage db sync fails due to row size too large." Unassigned. - https://bugs.launchpad.net/cinder/+bug/1968645 "Concurrent migration of vms with the same multiattach volume fails." Unassigned. Low - https://bugs.launchpad.net/cinder/+bug/1968170 "reimage_volume failure message action does not exist." Unassigned. Cheers, -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

Error while creating attached to an external interface
by A Monster 13 Apr '22

13 Apr '22

I'm trying to launch an instance attached to an external network, but I get an all host exhausted error message, and the neutron log file show the following error : *ERROR neutron.plugins.ml2.managers [req-6979d5fd-8e6a-4802-a758-e4882b7ac5b6 397fa0267ae340e1b24a3a96ae302f32 05b9f31fca434f7a96b63a1d17e8b14c - default default] Failed to bind port d57ac8f5-7904-495f-a4b9-9b23df681634 on host compute1.localdomain for vnic_type normal using segments [{'id': '475c70c2-6a35-4721-a726-cbf8c0b7e778', 'network_type': 'flat', 'physical_network': 'physnet2', 'segmentation_id': None, 'network_id': 'a1c2cc8f-6a04-48ce-9d87-a351da1d3f3e'}]* But when I try to launch an instance using another external network, it works just fine.

1 0

[neutron] Zed PTG Summary
by Lajos Katona 13 Apr '22

13 Apr '22

Hi, I will try to summarize the Neutron PTG sessions during the last week. The etherpad which we used: https://etherpad.opendev.org/p/neutron-zed-ptg # Day 1 (Monday April 4.) ## Yoga retrospective (I just list here the topics, not every discussion under them): * Good things ** New active people around the team ** Revived project: neutron-fwaas ** video CI meetings every second week are very good IMO ** OVN backend is getting more and more attention and there are less gaps between OVN and OVS backends * Bad / Not so good: ** less and less active people ** to much depends on Red Hat - ~66% of reviews, ~62% of commits (in Neutron official projects) ** lack of maintainers for some stadium projects (neutron-vpnaas) and some backends/drivers (linuxbridge) * As action we previously decided to have a forum session during the Berlin Summit to discuss the lack of activity/maintainers for some backends and stadium projects hopefully with some operators also. ## Short update on bgp related blueprints https://etherpad.opendev.org/p/neutron-zed-ptg#L111 The development of these blueprints are stopped, we will revert the already merged code. # Day 2 (Tuesday April 5.) ## Have nova / os-vif delete the trunk bridges to avoid race conditions The creation of trunk bridges now done by os-vif, and the deletion is done by Neutron, to avoid the race condition we agreed to have both operations done by os-vif. ## skip-level upgrade (tick-tick) We discussed together how this affects Neutron, what is working currently and what is in front of us. We have periodic jobs for ovs and ovn backend. Actions: * Make ovn grenade upgrade jobs green ## When we say something is not supported? * Recently from the Neutron stadium neutron-vpnaas project was that lost all maintainers. Neutron core team keeps an eye on the gate of networking projects, and keep them green, but if there is nobody with specific knowledge for the given area we can't solve the bugs. * We have similar problems with "in-tree" drivers also, a good example is the linuxbridge driver. Agreement was to keep the current approach for stadium project, so send out mail to openstack-discuss, asking for help, and if nobody appears, make the project retired and delete the code but keep git history for it. For in-tree code (drivers, extensions....): * We keep existing jobs for linuxbridge driver for example, but when the tests start to fail we skip them and finally we stop the job also. To make it clear for operators we add warning logs highlighting that the given feature/driver is experimental, and introduce cfg option to enable such features explicitly. We plan to discuss these questions during the Berlin Summit with operators. ## Prefix delegation for Openstack Neutron aka: dibbler tool for dhcpv6 is concluded The original bug: https://bugs.launchpad.net/neutron/+bug/1916428 * The tool behind PD, Dibbler is no more maintained and the suggested tool ISC Kea has no DHCP client actually. * this feature is not tested in upstream CI Due to these we decided to mark prefix delegation as experimental feature. # Day 3 (Wednesday April 6.) ## neutron-dynamic-routing + OVN Redhat works on a BGP solution for OVN, that is ovn-bgp-agent, and currently it doesn't need the existing API in neutron-dynamic-routing. The current approach to make neutron-dynamic-routing work with OVN will be checked. ## Option for OVN to disable DHCP/DNS and use dhcp-agent instead Technically it is possible, a new RFE will be proposed and the drivers team will discuss the usecase behind it. ## CI status / zuul job config errors In the list of zuul cfg errors ( https://zuul.opendev.org/t/openstack/config-errors ) old Neutron stadium branches are listed. * Decision was to EOL these old branches where fixing is not possible. Another topic was from Slawek if we want to have neutron-tempest-plugin-api-ovs job, and the agreement was to merge OVS scenario and API jobs. ## inconsistencies in OVS firewall on an agent restart We will go for a cfg option to select between OVS flow installation in batches and per port, and operators can select which is best for their environment. ## Pain Points TC started a discussion to cover the collected operator pain points, last week we checked again the list for Neutron ( https://etherpad.opendev.org/p/pain-point-elimination#L268) * neutron (via python calls) and OVN (via C calls) can have different ideas about what the hostname is, particulary if a deployer (rightly or wrongly) sets their hostname to be an FQDN ** it was fixed: https://review.opendev.org/q/Iea2533f4c52935b4ecda9ec22fb619c131febfa1 * Useful error msg when network deletion fails due to existing resources on it ** done: https://review.opendev.org/c/openstack/neutron/+/821935 * Open vSwitch Agent excess logging at INFO level ** we check if we can change some to debug, Slawek create a DNM job with only info logs to discuss during one of the coming meetings. * OVN: Spoofing of DNS reponses seems very wrong behavior ** We agreed that for this we need an RFE (see above for disabling OVN DNS/DHCP) ## Edge topics Together with the Designate team we agreed that this is more a documentation problem based on our current understanding. Based on Redhat downstream bugs for edge deployments we try to cover these in this cycle. # Day 4 (Thursday April 7.) We have no sassions. # Day 5 (Friday April 8.) ## Nova - Neutron xproject ### How to require ml2 plugins to implement multiple port bindings The problem is that there are old drivers (hyperv perhaps and others) that do not implement it and this cause a lot of extra code path in Nova. Sean suggested a Forum topic for Berlin to discuss it with operators also. ### Is heal_instance_info_cache_interval still needed? Let's create a job which sets heal_instance_info_cache_interval to 0, and decide the next steps based on the results. The happy moment with the team screenshot: https://photos.app.goo.gl/P6YuYgxzqEiv2gHt8 I hope next time we can meet in person :-) Thanks to everybody for the great discussions. Lajos Katona (lajoskatona)

1 0

[horizon] Cancelling Today's Weekly meeting
by vishal manchanda 13 Apr '22

13 Apr '22

Hello Team, I won't be able to chair today's horizon weekly meeting due to some travel. So if someone from team can host it on my behalf or we can skip this week meeting. Note: I will join office from thrusday so if anything urgent please reach out to horizon core team. Thanks & regards, Vishal Manchanda

1 0

[Trove][Xena] Errors when creating postgresql insances
by wodel youchi 13 Apr '22

13 Apr '22

Hi, I defined a postgresql data store with two versions 10 and 12. When creating db instances I am getting different errors : *For Postgresql 10, I am getting : * Traceback (most recent call last): File "/var/lib/kolla/venv/lib/python3.6/site-packages/trove/taskmanager/models.py", line 436, in wait_for_instance time_out=timeout) File "/var/lib/kolla/venv/lib/python3.6/site-packages/trove/common/utils.py", line 223, in poll_until return wait_for_task(task) File "/var/lib/kolla/venv/lib/python3.6/site-packages/trove/common/utils.py", line 207, in wait_for_task return polling_task.wait() File "/var/lib/kolla/venv/lib/python3.6/site-packages/eventlet/event.py", line 125, in wait result = hub.switch() File "/var/lib/kolla/venv/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 313, in switch return self.greenlet.switch() File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/loopingcall.py", line 150, in _run_loop result = func(*self.args, **self.kw) File "/var/lib/kolla/venv/lib/python3.6/site-packages/trove/common/utils.py", line 194, in poll_and_check obj = retriever() File "/var/lib/kolla/venv/lib/python3.6/site-packages/trove/taskmanager/models.py", line 791, in _service_is_active raise TroveError(_("Service not active, status: %s") % status) trove.common.exception.TroveError: Service not active, status: failed to spawn ==> trove-conductor.log <== 2022-04-13 00:26:52.334 124 ERROR trove.conductor.manager [-] Guest exception on request req-b5bd49e8-e147-41b2-8292-2900bb4022a1: ['Traceback (most recent call last):\n', ' File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/manager.py", line 218, in prepare\n ds_version=ds_version)\n', ' File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/manager.py", line 234, in _prepare\n cluster_config, snapshot, ds_version=ds_version)\n', ' File "/opt/guest-agent-venv/lib/python3.6/site-packages/osprofiler/profiler.py", line 160, in wrapper\n result = f(*args, **kwargs)\n', ' File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/manager.py", line 161, in do_prepare\n self.app.start_db(ds_version=ds_version, command=command)\n', ' File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 229, in start_db\n raise exception.TroveError("Failed to start database service")\n', *'trove.common.exception.TroveError: Failed to start database service\n']* *And for Postgresql 12, I am getting :* Server type: guest Traceback (most recent call last): File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/manager.py", line 845, in create_user self.adm.create_users(users) File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 516, in create_users self.create_user(models.PostgreSQLUser.deserialize(user), None) File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 549, in create_user [models.PostgreSQLSchema.deserialize(db) for db in user.databases]) File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 558, in _grant_access [db.name for db in databases], File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 432, in grant_access database=database, File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 723, in psql return self.connection.execute(statement) File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 763, in execute autocommit=True) File "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", line 776, in _execute_stmt cursor.execute(cmd, data_values) psycopg2.errors.InvalidCatalogName: database "dbweb01" does not exist And this error from > ==> trove-conductor.log <== > 2022-04-12 23:58:11.689 46 ERROR trove.conductor.manager [-] Guest > exception on request req-7c0e005a-2b02-4acf-bdc5-e9d7a964cd7e: > ['Traceback (most recent call last):\n', ' File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/manager.py", > line 808, in create_database\n return > self.adm.create_databases(databases)\n', ' File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", > line 464, in create_databases\n > self.create_database(models.PostgreSQLSchema.deserialize(database))\n', ' > File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", > line 477, in create_database\n collation=database.collate,\n', ' File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", > line 723, in psql\n return self.connection.execute(statement)\n', ' > File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", > line 763, in execute\n autocommit=True)\n', ' File > "/opt/guest-agent-venv/lib/python3.6/site-packages/trove/guestagent/datastore/postgres/service.py", > line 776, in _execute_stmt\n cursor.execute(cmd, data_values)\n', > 'psycopg2.errors.ActiveSqlTransaction: *CREATE DATABASE cannot run inside > a transaction block\n\n']* > Regards.

1 0