- openstack-discuss - lists.openstack.org

[kolla][ops] Anyone using the collectd and/or telegraf?
by Radosław Piliszek 02 Aug '22

02 Aug '22

Hi Kolla-flavoured OpenStackers, Any of you using the collectd and/or telegraf with Kolla Ansible? The core team is looking to deprecate their support as it's not tested and collectd is now gone from Ubuntu Jammy. Please reply to this mail. Cheers, Radek -yoctozepto

2 2

[ceilometer][gnocchi][tacker] Internal Server Error in devstack for Zuul gate job
by ueha.ayumu＠fujitsu.com 02 Aug '22

02 Aug '22

Hi telemetry team, I’m Ueha from Tacker team, The Zuul gate job of Tacker failed with the following error. Do you know the solution? The gate job has failed, so we would appreciate it if you could deal it with high priority. Thanks! for reference, the same error occurring in the ceilometer patch. (https://review.opendev.org/c/openstack/ceilometer/+/851338 ‘s telemetry-dsvm-integration-centos-9s job) ------------------ ++ /opt/stack/ceilometer/devstack/plugin.sh:start_ceilometer:322 : /usr/local/bin/ceilometer-upgrade 2022-07-29 05:20:42.125 61523 DEBUG ceilometer.cmd.storage [-] Upgrading Gnocchi resource types upgrade /opt/stack/ceilometer/ceilometer/cmd/storage.py:42 2022-07-29 05:20:42.228 61523 CRITICAL ceilometer [-] Unhandled error: gnocchiclient.exceptions.ClientException: Internal Server Error (HTTP 500) 2022-07-29 05:20:42.228 61523 ERROR ceilometer Traceback (most recent call last): 2022-07-29 05:20:42.228 61523 ERROR ceilometer File "/usr/local/bin/ceilometer-upgrade", line 10, in <module> 2022-07-29 05:20:42.228 61523 ERROR ceilometer sys.exit(upgrade()) 2022-07-29 05:20:42.228 61523 ERROR ceilometer File "/opt/stack/ceilometer/ceilometer/cmd/storage.py", line 49, in upgrade 2022-07-29 05:20:42.228 61523 ERROR ceilometer tenacity.Retrying( ......... omit ......... 2022-07-29 05:20:42.228 61523 ERROR ceilometer File "/usr/local/lib/python3.8/dist-packages/gnocchiclient/client.py", line 52, in request 2022-07-29 05:20:42.228 61523 ERROR ceilometer raise exceptions.from_response(resp, method) 2022-07-29 05:20:42.228 61523 ERROR ceilometer gnocchiclient.exceptions.ClientException: Internal Server Error (HTTP 500) 2022-07-29 05:20:42.228 61523 ERROR ceilometer ------------------ Full log: https://zuul.opendev.org/t/openstack/build/71262e66ecf34827a8a3435657aa9b3f Best Regards, Ueha

4 4

[horizon][security-sig][tc] XStatic and JS dependencies
by Jeremy Stanley 02 Aug '22

02 Aug '22

We discussed this at the PTG, and sending out a recap has been on my to do list for a few months. Sorry about the delay! The tl;dr here is that OpenStack is effectively serving as the upstream distributor for (often vulnerable versions of) JavaScript software we didn't make, and downstream consumers like GNU/Linux distributions are then directly repackaging our copies of these things, and assuming we've taken care of any security vulnerabilities for them. In the early days, we needed a way to make it possible for Horizon to consume JavaScript libraries installed on systems, typically supplied by Linux distros via system level package management. XStatic was and still is a good framework for this, providing a means of bundling up metadata which can be adjusted in deployments to tie in local copies of JS libs so that Horizon can find them, and also allowing us to conveniently use the same sorts of mappings for upstream testing as well. The original idea was that we were shipping XStatic metadata packages, and distributions would take care of supplying the actual JS bits since that's not our specialty as a community. To make our own testing easier, we embedded copies of the actual JS within our XStatic packages, which is where all of this started going horribly wrong. The rationale at the time was that distro package maintainers would know to devendor (unbundle and replace) the JS inside our XStatic packages, substituting standard ones from their distribution. What has happened instead, likely due to a confluence of convenience and lack of clear communication on our part, is that the distros took the entirety of these XStatic packages and redistributed them, JS and all. Why is that bad? Well, our approach to Python dependencies is that we freeze the versions we use at the time of our coordinated release, on the assumption that distros backport any relevant security fixes for them. That's generally okay because we're not shipping those dependencies ourselves, someone else does and takes care of fixing and communicating vulnerabilities in them. For many of the XStatic packages Horizon relies on, however, distros are treating us as the upstream supplier of that software, including the JS bundled inside it. We don't (and really can't reliably) track security vulnerabilities in our dependencies, and JS is no exception in this regard. Unfortunately, when it comes to the outdated versions of JS libs we're redistributing inside those packages, many distros assume we are doing exactly that. Worse, it's not just the Linux distros, but even our own deployment projects following the same pattern. How can we address this? The first and fastest thing we should do is to start clearly communicating that we make no effort to track or fix vulnerabilities for JS inside our XStatic packages. Readme files in all of them should get a big disclaimer added, as visible as possible, that the included "convenience" copies of JS libs in them are not for production use and should be considered insecure, to be replaced at deployment time with actual upstream copies instead (this will be noticed not just when browsing our source code, but for any subsequent releases on PyPI too). Also update any places in our documentation where XStatic packages are mentioned to point this situation out. Ideally, we should reach out to distros and deployment projects we know are installing our copies of the embedded JS libs to make sure they're aware of this problem too. In the long term, we really need to gut the JS content from the source trees of our XStatic packages and make our test jobs use something like NPM or Yarn to fetch the relevant versions at deployment time, installing them into the expected locations pointed to by the XStatic metadata. This will make it more obvious that we're not taking responsibility for the security of those libraries, since we're no longer directly supplying them. I've only got the loosest understanding of how XStatic integration works, and not much familiarity with Horizon or its testing, so am relying on Horizon's contributors to weigh in on whether this course of action is sensible and, more importantly, achievable. -- Jeremy Stanley

1 1

[TripleO], Undercloud deployment is failing with with the NTP error
by Veronika Fisarova 02 Aug '22

02 Aug '22

Good day everyone, I was trying to deploy TripleO via tripleo-quickstart following this guide <https://docs.openstack.org/tripleo-quickstart/latest/getting-started.html#>. Working environment has satisfactory requirements following specifications in the guide. Python 3.6.8. is installed. The following deployment script was used: bash quickstart.sh --tags all -R wallaby -X --teardown all -v $VIRTHOST and the deployment is failing with the following error: 2022-08-02 13:05:13,693 p=21797 u=root n=ansible | 2022-08-02 13:05:13.692871 | 008acbda-7e58-575b-6e97-00000000078a | TASK | Ensure system is NTP time synced 2022-08-02 13:10:04,147 p=21797 u=root n=ansible | 2022-08-02 13:10:04.146932 | 008acbda-7e58-575b-6e97-00000000078a | FATAL | Ensure system is NTP time synced | undercloud | error={"changed": true, "cmd": ["chronyc", "waitsync", "30"], "delta": "0:04:50.254002", "end": "2022-08-02 13:10:04.121815", "msg": "non-zero return code", "rc": 1, "start": "2022-08-02 13:05:13.867813", "stderr": "", "stderr_lines": [], "stdout": "try: 1, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 2, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 3, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 4, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 5, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 6, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 7, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 8, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 9, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 10, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 11, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 12, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 13, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 14, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 15, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 16, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 17, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 18, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 19, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 20, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 21, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 22, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 23, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 24, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 25, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 26, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 27, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 28, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 29, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 30, refid: 00000000, correction: 0.000000000, skew: 0.000", "stdout_lines": ["try: 1, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 2, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 3, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 4, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 5, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 6, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 7, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 8, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 9, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 10, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 11, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 12, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 13, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 14, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 15, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 16, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 17, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 18, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 19, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 20, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 21, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 22, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 23, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 24, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 25, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 26, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 27, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 28, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 29, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 30, refid: 00000000, correction: 0.000000000, skew: 0.000"]} 2022-08-02 13:10:04,178 p=21797 u=root n=ansible | PLAY RECAP ********************************************************************* 2022-08-02 13:10:04,178 p=21797 u=root n=ansible | localhost : ok=1 changed=0 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0 2022-08-02 13:10:04,179 p=21797 u=root n=ansible | undercloud : ok=209 changed=110 unreachable=0 failed=1 skipped=50 rescued=0 ignored=2 For more information, please see the copy of the partially deployed undercloud here <https://paste.opendev.org/show/bxKvk87Y8ZH1RdboQaa3/> and here <https://paste.opendev.org/show/banD6k2R1gReYvBjN8bx/>. As far as I know, I can SSH to the deployed undercloud, but I cannot ensure if the undercloud is working properly and how many functions are missing. If you would need any additional information, please email me or use the IRC nick: deydra Any help or suggestions appreciated. -- *Veronika Fisarova* Openstack Validation Framework - Intern Red Hat <http://www.redhat.com>

1 0

[security-sig] Cancelling our August meeting
by Jeremy Stanley 02 Aug '22

02 Aug '22

Apologies for the late notice, but I have travel for an appointment conflicting with our meeting and will be unable to chair it this month. If someone else wants to run the meeting please feel free, though we don't have any pressing agenda items so it's probably fine to skip. I'm also open to holding the meeting next week instead, if anybody is interested in rescheduling. Barring any ad hoc meetings in the interim, our next scheduled meeting is 15:00 UTC on Thursday, September 1. In the meantime, Security SIG folks can be found in the #openstack-security channel on OFTC or by prepending subjects to this ML with [security-sig] of course! -- Jeremy Stanley

1 0

Horizon dashboard query
by KK CHN 02 Aug '22

02 Aug '22

Hi everyone! I need a guide or advice or anything. I am administering a private cloud in openstack. As I am using the Horizon dashboard for the VM provisioning and administering activities. But the users are sending requests in mail and creating the VMs for them. can we make workflow automation for the request and approval and provisioning automatically in the Horizon dashboard on approval? Has anyone already done /have idea on these kinds of solutions for your openstack cloud ??. Is there some kind of documentation that could help me?. Any guidance much appreciated, where to start, what to refer and which tool/programming language best if I need to code from scratch. thanks in advance. Krish

5 6

[neutron] CI meeting agenda for 2.08.2022
by Slawek Kaplonski 02 Aug '22

02 Aug '22

Hi, It's just a reminder that today at 1500 UTC we will have our CI meeting. It will be on video this time [1]. Agenda is on etherpad [2]. [1] https://meetpad.opendev.org/neutron-ci-meetings [2] https://etherpad.opendev.org/p/neutron-ci-meetings -- Slawek Kaplonski Principal Software Engineer Red Hat

1 0

resize or migrate problem
by f.loghmani 02 Aug '22

02 Aug '22

hello I use OpenStack and I create some VMs in different compute in one region. when I resize the VM. if the compute doesn't have enough space, automatically the vm will be migrated to another compute. but my problem is here that when it migrated, the _base file doesn't migrate and remains in the first compute that it doesn't have enough space. because of this, the VM appears with an error status in OpenStack. if I move the _base from first compute to final compute and reboot the server this problem has been solved. so i need to not transfer _base manually and if it migrated to another compute the disk and _base transfer with each other. could you please help me to solve this problem? thanks in advance

1 0

[Triple0 - Wallaby] Overcloud deployment getting failed with SSL
by Lokendra Rathour 02 Aug '22

02 Aug '22

Hi Team, We were trying to install overcloud with SSL enabled for which the UC is installed, but OC install is getting failed at step 4: ERROR :nectionPool(host='fd00:fd00:fd00:9900::2ef', port=13000): Max retries exceeded with url: / (Caused by SSLError(CertificateError(\"hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'undercloud.com'\",),))\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2022-07-08 17:03:23.606739 | 5254009a-6a3c-adb1-f96f-0000000072ac | FATAL | Clean up legacy Cinder keystone catalog entries | undercloud | item={'service_name': 'cinderv3', 'service_type': 'volume'} | error={"ansible_index_var": "cinder_api_service", "ansible_loop_var": "item", "changed": false, "cinder_api_service": 1, "item": {"service_name": "cinderv3", "service_type": "volume"}, "module_stderr": "Failed to discover available identity versions when contacting https://[fd00:fd00:fd00:9900::2ef]:13000. Attempting to parse version from URL.\nTraceback (most recent call last):\n File \"/usr/lib/python3.6/site-packages/urllib3/connectionpool.py\", line 600, in urlopen\n chunked=chunked)\n File \"/usr/lib/python3.6/site-packages/urllib3/connectionpool.py\", line 343, in _make_request\n self._validate_conn(conn)\n File \"/usr/lib/python3.6/site-packages/urllib3/connectionpool.py\", line 839, in _validate_conn\n conn.connect()\n File \"/usr/lib/python3.6/site-packages/urllib3/connection.py\", line 378, in connect\n _match_hostname(cert, self.assert_hostname or server_hostname)\n File \"/usr/lib/python3.6/site-packages/urllib3/connection.py\", line 388, in _match_hostname\n match_hostname(cert, asserted_hostname)\n File \"/usr/lib64/python3.6/ssl.py\", line 291, in match_hostname\n % (hostname, dnsnames[0]))\nssl.CertificateError: hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'undercloud.com'\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/lib/python3.6/site-packages/requests/adapters.py\", line 449, in send\n timeout=timeout\n File \"/usr/lib/python3.6/site-packages/urllib3/connectionpool.py\", line 638, in urlopen\n _stacktrace=sys.exc_info()[2])\n File \"/usr/lib/python3.6/site-packages/urllib3/util/retry.py\", line 399, in increment\n raise MaxRetryError(_pool, url, error or ResponseError(cause))\nurllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='fd00:fd00:fd00:9900::2ef', port=13000): Max retries exceeded with url: / (Caused by SSLError(CertificateError(\"hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'undercloud.com'\",),))\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 1022, in _send_request\n resp = self.session.request(method, url, **kwargs)\n File \"/usr/lib/python3.6/site-packages/requests/sessions.py\", line 533, in request\n resp = self.send(prep, **send_kwargs)\n File \"/usr/lib/python3.6/site-packages/requests/sessions.py\", line 646, in send\n r = adapter.send(request, **kwargs)\n File \"/usr/lib/python3.6/site-packages/requests/adapters.py\", line 514, in send\n raise SSLError(e, request=request)\nrequests.exceptions.SSLError: HTTPSConnectionPool(host='fd00:fd00:fd00:9900::2ef', port=13000): Max retries exceeded with url: / (Caused by SSLError(CertificateError(\"hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'undercloud.com'\",),))\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py\", line 138, in _do_create_plugin\n authenticated=False)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 610, in get_discovery\n authenticated=authenticated)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/discover.py\", line 1452, in get_discovery\n disc = Discover(session, url, authenticated=authenticated)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/discover.py\", line 536, in __init__\n authenticated=authenticated)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/discover.py\", line 102, in get_version_data\n resp = session.get(url, headers=headers, authenticated=authenticated)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 1141, in get\n return self.request(url, 'GET', **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 931, in request\n resp = send(**kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 1026, in _send_request\n raise exceptions.SSLError(msg)\nkeystoneauth1.exceptions.connection.SSLError: SSL exception connecting to https://[fd00:fd00:fd00:9900::2ef]:13000: HTTPSConnectionPool(host='fd00:fd00:fd00:9900::2ef', port=13000): Max retries exceeded with url: / (Caused by SSLError(CertificateError(\"hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'undercloud.com'\",),))\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File \"<stdin>\", line 102, in <module>\n File \"<stdin>\", line 94, in _ansiballz_main\n File \"<stdin>\", line 40, in invoke_module\n File \"/usr/lib64/python3.6/runpy.py\", line 205, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib64/python3.6/runpy.py\", line 96, in _run_module_code\n mod_name, mod_spec, pkg_name, script_name)\n File \"/usr/lib64/python3.6/runpy.py\", line 85, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_openstack.cloud.catalog_service_payload_7ikyjf7t/ansible_openstack.cloud.catalog_service_payload.zip/ansible_collections/openstack/cloud/plugins/modules/catalog_service.py\", line 185, in <module>\n File \"/tmp/ansible_openstack.cloud.catalog_service_payload_7ikyjf7t/ansible_openstack.cloud.catalog_service_payload.zip/ansible_collections/openstack/cloud/plugins/modules/catalog_service.py\", line 181, in main\n File \"/tmp/ansible_openstack.cloud.catalog_service_payload_7ikyjf7t/ansible_openstack.cloud.catalog_service_payload.zip/ansible_collections/openstack/cloud/plugins/module_utils/openstack.py\", line 407, in __call__\n File \"/tmp/ansible_openstack.cloud.catalog_service_payload_7ikyjf7t/ansible_openstack.cloud.catalog_service_payload.zip/ansible_collections/openstack/cloud/plugins/modules/catalog_service.py\", line 141, in run\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_identity.py\", line 517, in search_services\n services = self.list_services()\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_identity.py\", line 492, in list_services\n if self._is_client_version('identity', 2):\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/openstackcloud.py\", line 460, in _is_client_version\n client = getattr(self, client_name)\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_identity.py\", line 32, in _identity_client\n 'identity', min_version=2, max_version='3.latest')\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/openstackcloud.py\", line 407, in _get_versioned_client\n if adapter.get_endpoint():\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py\", line 291, in get_endpoint\n return self.session.get_endpoint(auth or self.auth, **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 1243, in get_endpoint\n return auth.get_endpoint(self, **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 380, in get_endpoint\n allow_version_hack=allow_version_hack, **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 271, in get_endpoint_data\n service_catalog = self.get_access(session).service_catalog\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 134, in get_access\n self.auth_ref = self.get_auth_ref(session)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py\", line 206, in get_auth_ref\n self._plugin = self._do_create_plugin(session)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py\", line 161, in _do_create_plugin\n 'auth_url is correct. %s' % e)\nkeystoneauth1.exceptions.discovery.DiscoveryFailure: Could not find versioned identity endpoints when attempting to authenticate. Please check that your auth_url is correct. SSL exception connecting to https://[fd00:fd00:fd00:9900::2ef]:13000: HTTPSConnectionPool(host='fd00:fd00:fd00:9900::2ef', port=13000): Max retries exceeded with url: / (Caused by SSLError(CertificateError(\"hostname 'fd00:fd00:fd00:9900::2ef' doesn't match 'overcloud.example.com'\",),))\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2022-07-08 17:03:23.609354 | 5254009a-6a3c-adb1-f96f-0000000072ac | TIMING | Clean up legacy Cinder keystone catalog entries | undercloud | 0:11:01.271914 | 2.47s 2022-07-08 17:03:23.611094 | 5254009a-6a3c-adb1-f96f-0000000072ac | TIMING | Clean up legacy Cinder keystone catalog entries | undercloud | 0:11:01.273659 | 2.47s PLAY RECAP ********************************************************************* localhost : ok=0 changed=0 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0 overcloud-controller-0 : ok=437 changed=104 unreachable=0 failed=0 skipped=214 rescued=0 ignored=0 overcloud-controller-1 : ok=436 changed=101 unreachable=0 failed=0 skipped=214 rescued=0 ignored=0 overcloud-controller-2 : ok=431 changed=101 unreachable=0 failed=0 skipped=214 rescued=0 ignored=0 overcloud-novacompute-0 : ok=345 changed=83 unreachable=0 failed=0 skipped=198 rescued=0 ignored=0 undercloud : ok=28 changed=7 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 2022-07-08 17:03:23.647270 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-07-08 17:03:23.647907 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 1373 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ in the deploy.sh: openstack overcloud deploy --templates \ -r /home/stack/templates/roles_data.yaml \ --networks-file /home/stack/templates/custom_network_data.yaml \ --vip-file /home/stack/templates/custom_vip_data.yaml \ --baremetal-deployment /home/stack/templates/overcloud-baremetal-deploy.yaml \ --network-config \ -e /home/stack/templates/environment.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/services/ironic-conductor.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/services/ironic-inspector.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/services/ironic-overcloud.yaml \ -e /home/stack/templates/ironic-config.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/external-ceph.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/services/ptp.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/enable-tls.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/tls-endpoints-public-ip.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/inject-trust-anchor.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/docker-ha.yaml \ -e /usr/share/openstack-tripleo-heat-templates/environments/podman.yaml \ -e /home/stack/containers-prepare-parameter.yaml Addition lines as highlighted in yellow were passed with modifications: tls-endpoints-public-ip.yaml: Passed as is in the defaults. enable-tls.yaml: # ******************************************************************* # This file was created automatically by the sample environment # generator. Developers should use `tox -e genconfig` to update it. # Users are recommended to make changes to a copy of the file instead # of the original, if any customizations are needed. # ******************************************************************* # title: Enable SSL on OpenStack Public Endpoints # description: | # Use this environment to pass in certificates for SSL deployments. # For these values to take effect, one of the tls-endpoints-*.yaml # environments must also be used. parameter_defaults: # Set CSRF_COOKIE_SECURE / SESSION_COOKIE_SECURE in Horizon # Type: boolean HorizonSecureCookies: True # Specifies the default CA cert to use if TLS is used for services in the public network. # Type: string PublicTLSCAFile: '/etc/pki/ca-trust/source/anchors/overcloud-cacert.pem' # The content of the SSL certificate (without Key) in PEM format. # Type: string SSLRootCertificate: | -----BEGIN CERTIFICATE----- ----*** CERTICATELINES TRIMMED ** -----END CERTIFICATE----- SSLCertificate: | -----BEGIN CERTIFICATE----- ----*** CERTICATELINES TRIMMED ** -----END CERTIFICATE----- # The content of an SSL intermediate CA certificate in PEM format. # Type: string SSLIntermediateCertificate: '' # The content of the SSL Key in PEM format. # Type: string SSLKey: | -----BEGIN PRIVATE KEY----- ----*** CERTICATELINES TRIMMED ** -----END PRIVATE KEY----- # ****************************************************** # Static parameters - these are values that must be # included in the environment but should not be changed. # ****************************************************** # The filepath of the certificate as it will be stored in the controller. # Type: string DeployedSSLCertificatePath: /etc/pki/tls/private/overcloud_endpoint.pem # ********************* # End static parameters # ********************* inject-trust-anchor.yaml # ******************************************************************* # This file was created automatically by the sample environment # generator. Developers should use `tox -e genconfig` to update it. # Users are recommended to make changes to a copy of the file instead # of the original, if any customizations are needed. # ******************************************************************* # title: Inject SSL Trust Anchor on Overcloud Nodes # description: | # When using an SSL certificate signed by a CA that is not in the default # list of CAs, this environment allows adding a custom CA certificate to # the overcloud nodes. parameter_defaults: # The content of a CA's SSL certificate file in PEM format. This is evaluated on the client side. # Mandatory. This parameter must be set by the user. # Type: string SSLRootCertificate: | -----BEGIN CERTIFICATE----- ----*** CERTICATELINES TRIMMED ** -----END CERTIFICATE----- resource_registry: OS::TripleO::NodeTLSCAData: ../../puppet/extraconfig/tls/ca-inject.yaml The procedure to create such files was followed using: Deploying with SSL — TripleO 3.0.0 documentation (openstack.org) <https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/feature…> Idea is to deploy overcloud with SSL enabled i.e* Self-signed IP-based certificate, without DNS. * Any idea around this error would be of great help. -- skype: lokendrarathour

4 21

[dev][requirements][tripleo] Return of the revenge of lockfile strikes back part II
by Jeremy Stanley 01 Aug '22

01 Aug '22

It became apparent in a Python community discussion[0] yesterday that lockfile has been designated as a "critical project" by PyPI, even though it was effectively abandoned in 2010. Because our release automation account is listed as one of its maintainers, I looked into whether we still need it for anything... For those who have been around here a while, you may recall that the OpenStack project temporarily assumed maintenance[1] of lockfile in late 2014 and uploaded a few new releases for it, as a stop-gap until we could replace our uses with oslo.concurrency. That work was completed[2] early in the Liberty development cycle. Unfortunately for us, that's not the end of the story. I looked yesterday expecting to see that we've not needed lockfile for 7 years, and was disappointed to discover it's still in our constraints list. Why? After much wailing and gnashing of teeth and manually installing multiple bisections of the requirements list, I narrowed it down to one dependency: ansible-runner. Apparently, ansible-runner currently depends[3] on python-daemon, which still has a dependency on lockfile[4]. Our uses of ansible-runner seem to be pretty much limited to TripleO repositories (hence tagging them in the subject), so it's possible they could find an alternative to it and solve this dilemma. Optionally, we could try to help the ansible-runner or python-daemon maintainers with new implementations of the problem dependencies as a way out. Whatever path we take, we're long overdue. The reasons we moved off lockfile ages ago are still there, and the risk to us has only continued to increase in the meantime. I'm open to suggestions, but we really ought to make sure we have it out of our constraints list by the Zed release. [0] https://discuss.python.org/t/17219 [1] https://lists.openstack.org/pipermail/openstack-dev/2014-June/038387.html [2] https://review.openstack.org/151224 [3] https://github.com/ansible/ansible-runner/issues/379 [4] https://pagure.io/python-daemon/issue/42 -- Jeremy Stanley

4 7

[openstack-ansible][glance][nfs] Requesting Example of Working Config
by Dave Hall 01 Aug '22

01 Aug '22

Hello, Release - yoga. Host OS - Debian 11 I'm looking for an example of how to get NFS working as storage for glance and cinder - both the openstack_user_config.yml stanzas and the NFS server setup (/etc/exports, etc.). So far I've adapted the stanzas from the openstack_user_config.yml examples. The shares are mounted and writable (by root) from the glance/cinder containers, but glance keeps on throwing 410 errors. Thanks. -Dave -- Dave Hall Binghamton University kdhall(a)binghamton.edu

2 2

[baremetal-sig][ironic] No meeting on August
by Iury Gregory 01 Aug '22

01 Aug '22

Dear all, We would like to inform you that this month the Bare Metal SIG meeting will be skipped. Best regards, -- *Att[]'s* *Iury Gregory Melo Ferreira * *MSc in Computer Science at UFCG* *Ironic PTL * *Senior Software Engineer at Red Hat Brazil* *Social*: https://www.linkedin.com/in/iurygregory *E-mail: iurygregory(a)gmail.com <iurygregory(a)gmail.com>*

1 0

[ironic][swift][vitrage][OpenStackSDK] missing releases in Zed
by Előd Illés 01 Aug '22

01 Aug '22

Hi PTLS/release liaisons of teams in $SUBJECT, Here we are at the time in Zed cycle where release team evaluates if every cycle-with-intermediary deliverables had their releases (like we had in yoga [1] for example). The list-deliverables script showed that we miss some of the deliverables [2]. Here we should create a patch that proposes the transition from 'cycle-with-intermediary' to 'cycle-with-rc' for every such deliverables. As these are usually the ones that missing at this time of the cycles and we end up usually abandoning the transition patches and proposing releases: could you please propose release patches for these deliverables [2]? (Let me know if any of the deliverables needs anyway a transition though, and I'll create the patch) [1] https://review.opendev.org/q/topic:not-yet-released-yoga [2] https://paste.opendev.org/show/bXsaCISJzOfOsRnECvE9/ Thanks in advance, Előd Illés irc: elodilles

1 0

Seek help for glance error "Configuration for store failed. Adding images to this store is disabled"
by Hao Jue PX Wang 01 Aug '22

01 Aug '22

Hi folks, I am using a glance config like this to leverage IBM gpfs backend to store image, however, when upload images openstack image create --file rhel-8.5-official.qcow2 test1, I ran into the following error. Any idea or suggestion for fixing the error? Thanks ============================== [glance_store] default_backend = filesystem enabled_backends = filesystem filesystem_store_datadir = /foundation_gpfs2/icic/images/ filesystem_store_file_perm = 0644 ============================== ========================================================================================== 2022-08-01 10:18:43.590 3663156 INFO glance_store.capabilities [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] haojuedebug req_cap: [<BitMasks.WRITE_ACCESS: 8>] 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] Error in store configuration. Adding images to store is disabled.: glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data Traceback (most recent call last): 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/v2/image_data.py", line 182, in upload 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image.set_data(data, size, backend=backend) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/domain/proxy.py", line 198, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.base.set_data(data, size, backend=backend, set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 501, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.force_reraise() 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise value 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 448, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/policy.py", line 204, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/quota/__init__.py", line 319, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 559, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self._upload_to_store(data, verifier, backend, size) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 486, in _upload_to_store 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 491, in add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, store, context, verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 468, in store_add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, context=context, verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/driver.py", line 279, in add_adapter 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data metadata_dict) = store_add_fun(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/capabilities.py", line 175, in op_checker 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise op_exec_map[op](**kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data ==========================================================================================

2 2

[nova] Zed API microversion planning
by Sylvain Bauza 01 Aug '22

01 Aug '22

Hey, tl;dr: if you have an open API change asking for a microversion, add it into the proposal list BEFORE TOMORROW AUG 2ND https://etherpad.opendev.org/p/nova-zed-microversions-plan For those who write API changes, they probably hit merge conflicts everytime we merge a new API microversion. FWIW, we recently merged 2.91 and 2.92, which means you now have to rebase at least with using a 2.93 version. That's why I'm proposing something new this cycle that may help you : IF YOU HAVE AN OPEN API CHANGE THAT'S JUST NEEDS TO BE REVIEWED, PLEASE ADD IT TO https://etherpad.opendev.org/p/nova-zed-microversions-plan BEFORE AUGUST 2ND 1600UTC. During the next Nova meeting, we'll look at all of the provided API changes in the etherpad, and we'll try to organize them by saying "ok, this one will have this API microversion, this other one that other API microversion". After this meeting, you should be able to know which API microversion you would have for Zed so you could then rebase your changes to use this one. That being said, please make sure to be able to rebase your change very quickly, because we don't want to wait for some API change before accepting another one that's important and which is ready to be merged. Thanks, -Sylvain

1 0

[neutron] Bug deputy July 25 to August 1
by Nurmatov Mamatisa 01 Aug '22

01 Aug '22

Hi, I was bug deputy last week. Below is the week summary. Bug #1940425 <https://bugs.launchpad.net/nova/+bug/1940425> was occurred last week due to os-vif 3.0.0 release. One rfe<https://bugs.launchpad.net/neutron/+bug/1983053> was proposed. Undecided bug needs further triage. Details: Critical -------- - https://bugs.launchpad.net/neutron/+bug/1940425 - test_live_migration_with_trunk tempest test fails due to port remains in down state - Confirmed - Assigned to Slawek Kaplonski - https://bugs.launchpad.net/neutron/+bug/1982818 - Periodic job openstack-tox-py39-with-oslo-master is broken - In progress: https://review.opendev.org/c/openstack/neutron/+/851433 - Assigned to Rodolfo Alonso - https://bugs.launchpad.net/neutron/+bug/1982720 - stable/train: neutron-grenade job consistently fails in reqirements repo - In progress: https://review.opendev.org/c/openstack/neutron/+/851506 - Assigned to Slawek Kaplonski Medium ------ - https://bugs.launchpad.net/neutron/+bug/1982962 - Quota driver "DbQuotaNoLockDriver" should implement "get_detailed_project_quotas" - In progress: https://review.opendev.org/c/openstack/neutron/+/851357 - Assigned to Rodolfo Alonso Low --- - https://bugs.launchpad.net/neutron/+bug/1982951 - [OVN][QoS] Add minimum bandwidth rule support to ML2/OVN - In progress: https://review.opendev.org/c/openstack/neutron/+/842292 - Assigned to Rodolfo Alonso Undecided --------- - https://bugs.launchpad.net/neutron/+bug/1982882 - Failed to process compatible router - network is unreachable - New RFEs ---- - https://bugs.launchpad.net/neutron/+bug/1983053 - [RFE] Add possibility to define default security group rules - New - Assigned Slawek Kaplonski Best regards, Isa Advanced Software Technology Lab / Cloud Technologies Research

1 0

[cinder] midcycle - 2 Planning
by Rajat Dhasmana 01 Aug '22

01 Aug '22

Hello Argonauts, As discussed in our last cinder meeting[1], most of the cinder team (present during the meeting) don't have conflicts on 10th August, 1400-1600 UTC so we are planning to conduct our Cinder midcycle-2 on the proposed date (R-8 week). This will be 3 weeks prior to Milestone-3/Feature Freeze and 2 weeks before non-client library release (os-brick) so will give plenty of time to know we're on track and work on it if we're not. Please add your topics in the etherpad along with your IRC nick (from L#33). Date: 10th August, 2022 Time: 1400-1600 UTC Etherpad: https://etherpad.opendev.org/p/cinder-zed-midcycles [1] https://etherpad.opendev.org/p/cinder-zed-meetings#L113

1 0

Openstack routed provider network
by Ignazio Cassano 31 Jul '22

31 Jul '22

Hello All, I am reading documentation about routed provider network. It reports: " Routed provider networks imply that compute nodes reside on different segments. " What does mean ? What is a segment it this case ? Thanks for helping me" Ignazio

3 7

[all][tc] What's happening in Technical Committee: summary 2022 July 31: Reading: 5 min
by Ghanshyam Mann 31 Jul '22

31 Jul '22

Hello Everyone, Here is this week's summary of the Technical Committee activities. 1. TC Meetings: ============ * We had this week's meeting on July 28. Most of the meeting discussions are summarized in this email. Meeting full logs are available @https://meetings.opendev.org/meetings/tc/2022/tc.2022-07-28-15.00.log.html * Next TC weekly meeting will be on 4 Aug Thursday at 15:00 UTC, feel free to add the topic on the agenda[1] by Aug 3. 2. What we completed this week: ========================= * Updates to the RBAC community wide for focusing on 'reader' role[2] * Added Skyline as Emerging Technology[3]. 3. Activities In progress: ================== TC Tracker for Zed cycle ------------------------------ * Zed tracker etherpad includes the TC working items[4], Two are completed and others items are in-progress. Open Reviews ----------------- * Four open reviews for ongoing activities[5]. 2021 User Survey TC Question Analysis ----------------------------------------------- No update on this. The survey summary is up for review[6]. Feel free to check and provide feedback. Zed cycle Leaderless projects ---------------------------------- Dale Smith volunteer to be PTL for Adjutant project [7] Fixing Zuul config error ---------------------------- Requesting projects with zuul config error to look into those and fix them which should not take much time[8][9]. Project updates ------------------- * Add charmed k8s operators to OpenStack Charms[10] 4. How to contact the TC: ==================== If you would like to discuss or give feedback to TC, you can reach out to us in multiple ways: 1. Email: you can send the email with tag [tc] on openstack-discuss ML[11]. 2. Weekly meeting: The Technical Committee conduct a weekly meeting every Thursday 15 UTC [12] 3. Ping us using 'tc-members' nickname on #openstack-tc IRC channel. [1] https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting [2] https://review.opendev.org/c/openstack/governance/+/847418 [3] https://review.opendev.org/c/openstack/governance/+/849155 [4] https://etherpad.opendev.org/p/tc-zed-tracker [5] https://review.opendev.org/q/projects:openstack/governance+status:open [6] https://review.opendev.org/c/openstack/governance/+/836888 [7] https://review.opendev.org/c/openstack/governance/+/849606 [8] https://etherpad.opendev.org/p/zuul-config-error-openstack [9] http://lists.openstack.org/pipermail/openstack-discuss/2022-May/028603.html [10] https://review.opendev.org/c/openstack/governance/+/849997 [11] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-discuss [12] http://eavesdrop.openstack.org/#Technical_Committee_Meeting -gmann

1 0

Workflow based VM provisioning for Openstack
by KK CHN 29 Jul '22

29 Jul '22

List, 1. Does anybody using the workflow based front end tools for VM requisition, approval and provisioning for automating the requests from various users ? (The users can be or cannot be from backend AD/LDAP) 2. Or do we need to code from scratch to integrate such a mechanism(Do Horizon dashboard need to be customized for this workflow based approval and auto provisioning and de provisioning of VMs ? ) . Where to start ? Pls guide me on how to achieve this functionality for openstack IaaS cloud infrastructure. ( we are using Ussuri version). Thanks in advance, Krish

1 0

[TripleO] - Overcloud Wallaby Deployment Failing with SSL and DNS
by Anirudh Gupta 29 Jul '22

29 Jul '22

Hi Team, I was trying to install Openstack Wallaby Release with Tripleo. I need to enable SSL with DNS. Without DNS, I am able to install overcloud successfully. But using DNS I am facing some authentication issues although the public VIP is successfully resolved by my DNS Server. I found a similar issue at Bugzilla https://bugs.launchpad.net/tripleo/+bug/1982996 Has anyone tried installing Wallaby with SSL and DNS? If yes, can you please suggest some pointers to resolve this? Regards Anirudh Gupta

1 0

Ansible playbook failing
by Derek O keeffe 29 Jul '22

29 Jul '22

Hi all, I have ran the OSA playbooks to completion on more than one occasion but recently I'm having an issue I can't figure out so if anyone could shed some light on it it would be much appreciated. When running "openstack-ansible setup-openstack.yml" I get to the task named "TASK [python_venv_build : Create wheel directory on the build host]" and I get the following error: fatal: [infra1_gnocchi_container-7c40503c -> infra1_repo_container-017aea8f(xx.xx.xx.xx)]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "msg": "chown failed: failed to look up user nginx", "owner": "root", "path": "/var/www", "size": 4096, "state": "directory", "uid": 0} I cannot seem to find anything about this and didn't see this error when running the playbooks previously. Thanks in advance for any suggestions. Regards,Derek

3 2

[ops] tentative plans for ops meetup on Friday after PTG
by Chris Morgan 29 Jul '22

29 Jul '22

Hi All, Please see this tweet, we are in the early stages of planning an ops meetup on an extra day (Friday) of PTG at the same venue: https://twitter.com/osopsmeetup/status/1552788675632799744?s=20&t=aEBpjhm6t… Event link : https://openinfra.dev/ptg/ early bird pricing currently available! We ask interested openstack operators to follow that twitter account, we keep it lean and spam free. We are also experimenting with also sharing news on LinkedIn if that works better for some of you OpenStack operators. You can connect with me (Chris Morgan, Bloomberg) there if you wish. Chris -- Chris Morgan <mihalis68(a)gmail.com>

2 1

[all][stable] Propose to EOL Pike series
by Előd Illés 28 Jul '22

28 Jul '22

Hi, It seems that time has come to (mass)transition Pike to End of Life due to lack of maintainers (and backports + reviews; see the list of recent changes [1]). Some core projects have made this step already. Others are still open but not really maintained, which can be seen by the number of daily periodic stable job failures on pike branch, which is around 40 for several months now. (By the way, periodic stable job failures number is constantly high [2], due to some projects which seem to be abandoned completely (murano, *-powervm), but that is another story). Please let me know what do you think, or indicate if any of the projects wants to keep its pike branch open / in Extended Maintenance. [1] https://review.opendev.org/q/branch:stable/pike [2] http://lists.openstack.org/pipermail/openstack-stable-maint/2022-May/thread… Thanks, Előd

1 1

Regarding Application Credential in Open Stack XENA
by Adivya Singh 28 Jul '22

28 Jul '22

hi Team, There is a use case, where a user wants to Create CI/CD pipeline using Application Credentials of Open Stack, Henceforth we tried Create an application with a role with a secret Key. but it is failing with the below output, The user wants to push the qcow2 image from his system to Open Stack. Using auth plugin: v3 application credential /usr/lib/python3.7/socket.py:660: ResourceWarning: unclosed <socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.17.0.3', 55738), raddr=('10.188.2.9', 5000)> self._sock = None ResourceWarning: Enable tracemalloc to get the object allocation traceback Not Found (HTTP 404) (Request-ID: req-217c9f28-d6a6-4649-adf9-2d9a4b965b3f) END return value: 1 it failed with a below result Regards Adivya Singh

2 3

[Neutron] Aug 1 - Aug 15 - team and drivers meeting CANCELLED
by Lajos Katona 28 Jul '22

28 Jul '22

Hi, I will be on PTO for the next 2 weeks, so as we discussed at the last team meeting, let's cancel the meetings for these weeks. Have a great summer time :-) Lajos Katona (lajoskatona)

1 0

[all][tc] Technical Committee next weekly meeting on 28 July 2022 at 1500 UTC
by Ghanshyam Mann 28 Jul '22

28 Jul '22

Hello Everyone, The technical Committee's next weekly meeting is scheduled for 28 July 2022, at 1500 UTC. If you would like to add topics for discussion, please add them to the below wiki page by Wednesday, 27 July at 2100 UTC. https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee#Next_Meeting -gmann

1 1

[neutron] Drivers meeting agenda - 29.07.2022.
by Lajos Katona 28 Jul '22

28 Jul '22

Hi Neutron Drivers, The agenda for tomorrow's drivers meeting is at [1]. * [RFE] OVN E/W routing for external (baremetal) VLAN ports (#link https://bugs.launchpad.net/neutron/+bug/1982541) [1] https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda See you at the meeting tomorrow. Lajos Katona (lajoskatona)

1 0

[ironic] Revise Ironic Vision Meeting
by Iury Gregory 28 Jul '22

28 Jul '22

Hello ironicers, During the upstream meeting today we have scheduled the meeting to revise the vision of our project. The meeting will happen tomorrow at 15:00 UTC, details about the meeting are in the etherpad [1]. See you tomorrow! [1] https://etherpad.opendev.org/p/revise-ironic-vision -- *Att[]'s* *Iury Gregory Melo Ferreira * *MSc in Computer Science at UFCG* *Ironic PTL * *Senior Software Engineer at Red Hat Brazil* *Social*: https://www.linkedin.com/in/iurygregory *E-mail: iurygregory(a)gmail.com <iurygregory(a)gmail.com>*

1 1

openstack router with flat
by Parsa Aminian 28 Jul '22

28 Jul '22

hello is it possible to assign valid ip to openstack router directly without nat ? as I know openstack need invalid fix ip when using router and valid ip should be added as float ip .

2 3

Manila/NFS support for Zun
by Vaibhav 27 Jul '22

27 Jul '22

Hi, I want to mount my Manila shares on containers managed by Zun. I can see a Fuxi project and driver for this but it is discontinued now. I want to have a shared file system to be mounted on multiple containers simultaneously, it is not possible with cinder. Is there any alternative to Fuxi? Or can it work with yoga release ? Please advise and give a suggestion. Regards, Vaibhav

2 3

RAM and Storage requirements for Openstack cloud
by Mahendra Paipuri 27 Jul '22

27 Jul '22

Hello all, We are going to deploy Openstack cloud with researchers as primary target users. We will have around 100 GPUs with 12-15 servers with Infiniband interconnect. We still do not know the exact spec of servers nor GPUs but mostly we will have A100s and Intel Xeon processors. What sort of RAM and Storage requirements we need for a cluster of this size? Of course, this depends a lot on use cases and this cloud will be primarily used for HPC and AI. For the storage, we are mainly interested in the block storage requirements for provisioning VMs. We will most probably have a shared parallel file system as scratch and project spaces. Is there any rule of thumb to get to the RAM and storage requirement numbers based on compute infrastructure we will have? If we can estimate a sort of "lower bound" that would be really helpful for us. If anyone have clusters of this size at your organizations and if you can share the RAM ans storage details of your clouds, that would be very useful for us too. Thanks a lot and have a great day!! Regards Mahendra

3 3

Customization of scheduler manager
by Levon Melikbekjan 27 Jul '22

27 Jul '22

Hi all, as part of my thesis, I modified the Openstack version Train with the intention of sharing resources, which are not in use with other users to ensure maximum utilization. So far everything is working fine except for the last step. Let me first explain my work. The system works according to the following rules: 1. Users who own compute hosts within the private cloud have the highest priority on their hosts. 2. Users who do not own hosts within the private cloud are low priority users who can instantiate their virtual machine on unused resources (on the hosts that have an owner). 3. If the owner wants to use his resources that are currently occupied, the foreign VM must be suspended to free up resources for the owners VM. 4. An owner is a low priority user on foreign hosts. Everything works automatically and generically, but in step 3 I do not suspend those VMs, I delete them. I want the VMs to be suspended to be able to restart them with the intention of being able to continue processes that are paused, and I know there is maybe a REST API functions that provides this functionality. A user should be able to continue his work after resources become free again. It would be annoying if long-running processes were killed. My question is this: Is the suspend function the right choice? Are the resources released when I use the suspend function? Thank you & Best regards, Levon Melikbekjan

2 2

[dev][horizon][keystone]
by Sergey Drozdov 27 Jul '22

27 Jul '22

To whom it may concern, I have previously sen out an email about this topic but just wanted to run this by community again incase it was missed. I have the following issue. The firm I am currently working at is running OpenStack at sale with circa 6000 different projects. Whenever we try to access a projects tab via horizon we experience a timeout (accessing through the API works fine). For the horizon team, we were hoping to propose something akin to filtering/dynamic listing in order to rectify the issue. For the keystone team, we were wondering whether there is anything we can do with the API in order to simplify the aforementioned horizon proposal; we are hoping to get both teams on board. We are ready to open up a bug report and start subsequent development should this be supported by both teams! I am available on the both Openstack-horizon and Openstack-keystone irc channels under the nickname sdrozdov, please feel free to reach out. Best Regards, Sergey Drozdov Software Engineer The Hut Group

3 2

[cinder] Bug deputy report for week of 07-27-2022
by Sofia Enriquez 27 Jul '22

27 Jul '22

This is a bug report from 07-20-2022 to 07-27-2022. Agenda: https://etherpad.opendev.org/p/cinder-bug-squad-meeting ----------------------------------------------------------------------------------------- Medium - https://bugs.launchpad.net/cinder/+bug/1982436 "Reimage volume API image is invalid, the status should not be downloading." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982848 "Creating from source volume tries to create it multiple times if rekeying fails." Unassigned. Low - https://bugs.launchpad.net/cinder/+bug/1982350 "Infinidat Cinder driver multi-attach feature is broken." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982405 "Infinidat Cinder driver generic volume migration feature is broken." Fix proposed to master. - https://bugs.launchpad.net/cinder/+bug/1982568 "PowerMax doesn´t work with the workload in extra specs." Unassigned. - https://bugs.launchpad.net/cinder/+bug/1982891 "NFS Attach Encrypted fails only on the first attempt." Unassigned. Cheers, -- Sofía Enriquez she/her Software Engineer Red Hat PnT <https://www.redhat.com> IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>

1 0

[cinder] This week's meeting will be in video+IRC
by Rajat Dhasmana 27 Jul '22

27 Jul '22

Hello Argonauts, This week's meeting (today) will be held in video + IRC mode with details as follows: Date: 27th July, 2022 Time: 1400 UTC Meeting link: https://bluejeans.com/556681290 IRC Channel: #openstack-meeting-alt Make sure you're connected to both the bluejeans meeting and IRC since we do roll call and also (sometimes) summarize the discussion points on IRC. Thanks and regards Rajat Dhasmana

1 0

[Kolla][14.1.0][Yoga][Fluentd] fluentd container restarting indefinitely
by Vishwanath 27 Jul '22

27 Jul '22

Hello all, I have upgraded openstack, we are currently running on 14.1.0. I noticed fluentd container restarting indefinitely. The message I see under /var/log/kolla/fluentd/fluentd.log is as follows, Any thoughts on how to fix this ? I noticed a similar issue back in 2017 from this post - https://bugs.launchpad.net/kolla-ansible/+bug/1663126 *error log:* *2022-07-06 21:20:42 +0000 [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="'format' parameter is required"* *full logs:* 2022-07-06 21:20:42 +0000 [info]: parsing config file is succeeded path="/etc/td-agent/td-agent.conf" 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '5.2.3' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '4.1.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-grep' version '0.3.4' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-grok-parser' version '2.6.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-kafka' version '0.14.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-parser' version '0.6.1' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus' version '2.0.3' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.8.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-prometheus_pushgateway' version '0.0.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-record-modifier' version '2.1.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.3.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-s3' version '1.4.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-systemd' version '1.0.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-td' version '1.1.0' 2022-07-06 21:20:42 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.2.5' 2022-07-06 21:20:42 +0000 [info]: gem 'fluentd' version '1.11.2' 2022-07-06 21:20:42 +0000 [info]: gem 'fluentd' version '0.12.43' 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf97620 @keys="programname">, /^(cinder-api-access|cloudkitty-api-access|gnocchi-api-access|horizon-access|keystone-apache-admin-access|keystone-apache-public-access|monasca-api-access|octavia-api-access|placement-api-access)$/, "", "apache_access", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96f90 @keys="programname">, /^(aodh_wsgi_access|barbican_api_uwsgi_access|zun_api_wsgi_access|vitrage_wsgi_access)$/, "", "wsgi_access", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96950 @keys="programname">, /^(nova-api|nova-compute|nova-compute-ironic|nova-conductor|nova-manage|nova-novncproxy|nova-scheduler|nova-placement-api|placement-api|privsep-helper)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf96310 @keys="programname">, /^(sahara-api|sahara-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95cd0 @keys="programname">, /^(neutron-server|neutron-openvswitch-agent|neutron-ns-metadata-proxy|neutron-metadata-agent|neutron-l3-agent|neutron-dhcp-agent)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95690 @keys="programname">, /^(magnum-conductor|magnum-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf95050 @keys="programname">, /^(keystone)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf94a10 @keys="programname">, /^(heat-engine|heat-api|heat-api-cfn)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf943d0 @keys="programname">, /^(glance-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabf850 @keys="programname">, /^(cloudkitty-storage-init|cloudkitty-processor|cloudkitty-dbsync|cloudkitty-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabe978 @keys="programname">, /^(ceilometer-polling|ceilometer-agent-notification)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabdcd0 @keys="programname">, /^(barbican-api|barbican-worker|barbican-keystone-listener|barbican-db-manage|app)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adabc4e8 @keys="programname">, /^(aodh-notifier|aodh-listener|aodh-evaluator|aodh-dbsync)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9fa50 @keys="programname">, /^(cyborg-api|cyborg-conductor|cyborg-agent)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9f410 @keys="programname">, /^(cinder-api|cinder-scheduler|cinder-manage|cinder-volume|cinder-backup|privsep-helper)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9edd0 @keys="programname">, /^(mistral-server|mistral-engine|mistral-executor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9e790 @keys="programname">, /^(designate-api|designate-central|designate-manage|designate-mdns|designate-sink|designate-worker)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9e150 @keys="programname">, /^(manila-api|manila-data|manila-manage|manila-share|manila-scheduler)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9db10 @keys="programname">, /^(trove-api|trove-conductor|trove-manage|trove-taskmanager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9d4d0 @keys="programname">, /^(murano-api|murano-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9ce90 @keys="programname">, /^(senlin-api|senlin-conductor|senlin-engine|senlin-health-manager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9c850 @keys="programname">, /^(watcher-api|watcher-applier|watcher-db-manage|watcher-decision-engine)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adf9c210 @keys="programname">, /^(freezer-api|freezer-api_access|freezer-manage)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab7880 @keys="programname">, /^(octavia-api|octavia-health-manager|octavia-housekeeping|octavia-worker)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab6ef8 @keys="programname">, /^(zun-api|zun-compute|zun-cni-daemon)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adab5918 @keys="programname">, /^(kuryr-server)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfabe90 @keys="programname">, /^(gnocchi-api|gnocchi-statsd|gnocchi-metricd|gnocchi-upgrade)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfab850 @keys="programname">, /^(ironic-api|ironic-conductor|ironic-inspector)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfab210 @keys="programname">, /^(tacker-server|tacker-conductor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfaabd0 @keys="programname">, /^(vitrage-ml|vitrage-notifier|vitrage-graph|vitrage-persistor)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfaa590 @keys="programname">, /^(blazar-api|blazar-manager)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa9f50 @keys="programname">, /^(monasca-api|monasca-notification|monasca-persister|agent-collector|agent-forwarder|agent-statsd)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa9910 @keys="programname">, /^(masakari-engine|masakari-api)$/, "", "openstack_python", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: programname [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfa92d0 @keys="programname">, /.+/, "", "unmatched", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: Payload [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfc9cb0 @keys="Payload">, /^\d{6}/, "", "infra.mariadb.mysqld_safe", nil] 2022-07-06 21:20:42 +0000 [info]: adding rewrite_tag_filter rule: Payload [#<Fluent::PluginHelper::RecordAccessor::Accessor:0x00005634adfc9670 @keys="Payload">, /^\d{4}-\d{2}-\d{2}/, "", "infra.mariadb.mysqld", nil] *2022-07-06 21:20:42 +0000 [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="'format' parameter is required"* Thanks Vish

3 4

[nova] hw_qemu_guest_agent image metadata property
by John Ratliff 26 Jul '22

26 Jul '22

We forgot to set this property on our image before creating several servers in our openstack cluster. I tried adding this property to the volume of one of the hosts and shutting it down / turning it back on, but it didn’t help. I found this blog post showing one way that worked, but it requires manual database editing. I was hoping for something a bit less typo-prone, like something in the openstack cli. https://www.thenoccave.com/2021/07/openstack-qemu-guest-tools-after-creatio… I can automate the above with ansible if that’s the only way, but if someone has a better suggestion that doesn’t involve recreating our instances, I would appreciate it. Thanks. --John Ratliff

3 3

[dev][security-sig][tc] Please follow up on privately reported defects
by Jeremy Stanley 26 Jul '22

26 Jul '22

First, a huge thank you to everyone who is staying on top of reports of suspected security vulnerabilities! Unfortunately, not everyone has been, which is the reason for this E-mail. It's common practice that, if someone finds a problem in software which they think might be an exploitable security vulnerability, they report it initially in private in order to give the project's maintainers an opportunity to correct things and have patches ready before it becomes common knowledge. This works okay as long as people actually look at these privately reported bugs (or at the project's bugs at all). For OpenStack deliverables whose maintainers opt them into VMT oversight[*], these private reports are initially handled by a vulnerability coordinator in order to make sure that they're probably reported against the correct project, that the project maintainers who have volunteered to handle those sorts of reports are correctly subscribed, and that everyone is reminded of the ground rules and timetable for resolving reports under such an embargo. For other OpenStack deliverables, VMT members may still weigh in on those private reports and offer assistance or guidance on handling and reporting procedures. Our VMT members do not, however, have sufficient time in their day to keep individually reaching out to project maintainers in order to remind them to do their part. OpenStack is a community which has optimized around transparency and public collaboration, so it's not surprising that confirming bugs and reviewing changes in private is clunky and unpleasant. This is, if anything, a reason to prioritize triaging private bug reports in order to make sure they're really a bug (not just a misunderstanding or misconfiguration), and represent a severe enough risk to warrant continued handling in secret. Many of the private bug reports currently pending could probably be switched to public and even perhaps closed today, if maintainers for their projects would just find a moment to take a look at them. For the ones which can't be handled right away, at least leave a quick comment letting the reporter and the VMT members know you're taking a look, or any first impressions or questions you might have. If you're interested in helping a project resolve reported vulnerabilities and aren't yet a member of their security review team in the appropriate bug tracker (usually *-coresec in LP or openstack-security-* in SB), then please reach out to the appropriate PTL and let them know. If you're a PTL and you were never made a member of the security review team for your project or are having trouble adding willing volunteers, please follow up here on the ML or feel free to reach out to me directly for assistance. For those who read this far, thank you for your time, and please remember to follow up on those bugs! [*] https://security.openstack.org/repos-overseen.html -- Jeremy Stanley

1 0

[nova] Hold your rechecks
by Sylvain Bauza 26 Jul '22

26 Jul '22

We're currently investigating a quite impacting issue in both nova-next and ovs-hybrid-plug jobs that prevent Zuul to be happy. https://bugs.launchpad.net/nova/+bug/1940425 In the meantime, as the failure rate is pretty high, doing rechecks (against this bug number of course, you already know to NOT do blind rechecks [1]) doen't help and just consumes constrained CI resources for a very little and unpredictable gain. Thanks, -Sylvain

2 3

[kolla] RabbitMQ High Availability
by Tan Tran Trong 26 Jul '22

26 Jul '22

Hello, I'm trying to figure out how to configure RabbitMQ to make it high available. I have 3 controller nodes and 2 compute nodes, deployed with kolla with mostly default configuration. The RabbitMQ set to ha-all for all queues on all nodes, amqp_durable_queues = True My problem is when I shutdown 1 controller node (or 1 RabbitMQ container) (master or slave) the whole cluster becomes unstable. Some instances can not be created, it is stuck on Scheduling, Block Device Mapping, the volumes not shown or are stuck on creating, the compute node reported dead randomly,... I'm looking for documentation to know how Openstack using RabbitMQ, Openstack behavior when RabbitMQ node down and way to make RabbitMQ HA in a stable way. Do you have any recommendation? TIA, Tan

5 6

[nova] nova hypervisor oom killed some openstack guest
by hai wu 26 Jul '22

26 Jul '22

nova hypervisor sometimes oom would kill some openstack guests. Is it possible to not allow kernel to oom kill any openstack guests? ram is not oversubscribed much ..

5 11

[IRONIC] - Various questions around network features.
by Gaël THEROND 25 Jul '22

25 Jul '22

I everyone, I’m currently working back again with Ironic and it’s amazing! However, during our demo session to our users few questions arise. We’re currently deploying nodes using a private vlan that can’t be reached from outside of the Openstack network fabric (vlan 101 - 192.168.101.0/24) and everything is fine with this provisioning network as our ToR switch all know about it and other Control plan VLANs such as the internal APIs VLAN which allow the IPA Ramdisk to correctly and seamlessly be able to contact the internal IRONIC APIs. (When you declare a port as a trunk allowed all vlan on a aruba switch it seems it automatically analyse the CIDR your host try to reach from your VLAN and route everything to the corresponding VLAN that match the destination IP). So know, I still get few tiny issues: 1°/- When I spawn a nova instance on a ironic host that is set to use flat network (From horizon as a user), why does the nova wizard still ask for a neutron network if it’s not set on the provisioned host by the IPA ramdisk right after the whole disk image copy? Is that some missing development on horizon or did I missed something? 2°/- In a flat network layout deployment using direct deploy scenario for images, am I still supposed to create a ironic provisioning network in neutron? >From my understanding (and actually my tests) we don’t, as any host booting on the provisioning vlan will catch up an IP and initiate the bootp sequence as the dnsmasq is just set to do that and provide the IPA ramdisk, but it’s a bit confusing as many documentation explicitly require for this network to exist on neutron. 3°/- My whole Openstack network setup is using Openvswitch and vxlan tunnels on top of a spine/leaf architecture using aruba CX8360 switches (for both spine and leafs), am I required to use either the networking-generic-switch driver or a vendor neutron driver ? If that’s right, how will this driver be able to instruct the switch to assign the host port the correct openvswitch vlan id and register the correct vxlan to openvswitch from this port? I mean, ok neutron know the vxlan and openvswitch the tunnel vlan id/interface but what is the glue of all that? 4°/- I’ve successfully used openstack cloud oriented CentOS and debian images or snapshot of VMs to provision my hosts, this is an awesome feature, but I’m wondering if there is a way to let those host cloud-init instance to request for neutron metadata endpoint? I was a bit surprised about the ironic networking part as I was expecting the IPA ramdisk to at least be able to set the host os with the appropriate network configuration file for whole disk images that do not use encryption by injecting those information from the neutron api into the host disk while mounted (right after the image dd). All in all I really like the ironic approach of the baremetal provisioning process, and I’m pretty sure that I’m just missing a bit of understanding of the networking part but it’s really the most confusing part of it to me as I feel like if there is a missing link in between neutron and the host HW or the switches. Thanks a lot anyone that will take time to explain me this :-)

2 4

[neutron] Bug Deputy Report Jul 18 - Jul 24
by Oleg Bondarev 25 Jul '22

25 Jul '22

Hello Neutron Team, Bug report for the week of Jul 18 is below: Critical: ---------- - https://bugs.launchpad.net/neutron/+bug/1981963 - Some jobs broken post pyroute2 update to 0.7.1 - In progress - https://review.opendev.org/c/openstack/requirements/+/850295 is merged - https://bugs.launchpad.net/neutron/+bug/1982206 - stable: Neutron unit tests timeout on stable/ussuri and stable/victoria (perhaps wallaby also) - Fix released - https://review.opendev.org/c/openstack/neutron/+/850670 High: ------- - https://bugs.launchpad.net/neutron/+bug/1982367 - Race condition between DHCP and L2 agent during evacuate vms may cause VM ends up in ERROR state - In Progress - Assigned to Slawek Medium: ------------ - https://bugs.launchpad.net/neutron/+bug/1982569 - [OVN] metadata does not work when using neutron-dhcp-agent for baremetal ports - Confirmed - Unasigned - https://bugs.launchpad.net/neutron/+bug/1982110 - [taap-as-a-service] Project requires "webtest" library for testing - Fix committed - https://review.opendev.org/c/openstack/neutron-vpnaas/+/850335 RFEs: --------- - https://bugs.launchpad.net/neutron/+bug/1982287 - [rfe][ovn] Support address group for ovn driver - Approved on drivers meeting - Assigned to liushy - https://bugs.launchpad.net/neutron/+bug/1982541 - [RFE] OVN E/W routing for external (baremetal) VLAN ports - New - Assigned to Michal Nasiadka Undecided: --------------- - https://bugs.launchpad.net/neutron/+bug/1982373 - nova/neutron ignore and overwrite custom device owner fields - Opinion - most probably it's in Nova scope Thanks, Oleg

1 0

[Openstack] sdn multisite???
by Ignazio Cassano 23 Jul '22

23 Jul '22

Hello All, is there any sdn solution for openstack multi site sdn ? I read something about network to network api extension for neutron presented in an openstack summit but it seems no more adopted. Any help, please? We have 3 separated openstack installations and I wonder if there is some solution for controlling network (vxlan to vxlan connection, sec groups airchestration and so on) Openstack cascading seems only a dream. Ignazio

2 2

ovn-bgp-agent installation issue
by Satish Patel 23 Jul '22

23 Jul '22

Folks, I am trying to create lab of of ovn-bgp-agent using this blog https://ltomasbo.wordpress.com/2021/02/04/ovn-bgp-agent-testing-setup/ So far everything went well but I'm stuck at the bgp-agent installation and I encounter following error when running bgp-agent. Any suggestions? root@rack-1-host-2:/home/vagrant/bgp-agent# bgp-agent 2022-07-22 04:02:39.123 111551 INFO bgp_agent.config [-] Logging enabled! 2022-07-22 04:02:39.475 111551 CRITICAL bgp-agent [-] Unhandled error: AssertionError 2022-07-22 04:02:39.475 111551 ERROR bgp-agent Traceback (most recent call last): 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/bin/bgp-agent", line 10, in <module> 2022-07-22 04:02:39.475 111551 ERROR bgp-agent sys.exit(start()) 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/agent.py", line 76, in start 2022-07-22 04:02:39.475 111551 ERROR bgp-agent bgp_agent_launcher = service.launch(config.CONF, BGPAgent()) 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/agent.py", line 44, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent self.agent_driver = driver_api.AgentDriverBase.get_instance( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/platform/driver_api.py", line 25, in get_instance 2022-07-22 04:02:39.475 111551 ERROR bgp-agent agent_driver = stevedore_driver.DriverManager( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/stevedore/driver.py", line 54, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent super(DriverManager, self).__init__( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/stevedore/named.py", line 78, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent extensions = self._load_plugins(invoke_on_load, 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/stevedore/extension.py", line 221, in _load_plugins 2022-07-22 04:02:39.475 111551 ERROR bgp-agent ext = self._load_one_plugin(ep, 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/stevedore/named.py", line 156, in _load_one_plugin 2022-07-22 04:02:39.475 111551 ERROR bgp-agent return super(NamedExtensionManager, self)._load_one_plugin( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/stevedore/extension.py", line 257, in _load_one_plugin 2022-07-22 04:02:39.475 111551 ERROR bgp-agent obj = plugin(*invoke_args, **invoke_kwds) 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/platform/osp/ovn_bgp_driver.py", line 64, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent self._sb_idl = ovn.OvnSbIdl( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/platform/osp/utils/ovn.py", line 62, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent super(OvnSbIdl, self).__init__( 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/bgp_agent/platform/osp/utils/ovn.py", line 31, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent super(OvnIdl, self).__init__(remote, schema) 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/ovs/db/idl.py", line 283, in __init__ 2022-07-22 04:02:39.475 111551 ERROR bgp-agent schema = schema_helper.get_idl_schema() 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/ovs/db/idl.py", line 2323, in get_idl_schema 2022-07-22 04:02:39.475 111551 ERROR bgp-agent self._keep_table_columns(schema, table, columns)) 2022-07-22 04:02:39.475 111551 ERROR bgp-agent File "/usr/local/lib/python3.8/dist-packages/ovs/db/idl.py", line 2330, in _keep_table_columns 2022-07-22 04:02:39.475 111551 ERROR bgp-agent assert table_name in schema.tables 2022-07-22 04:02:39.475 111551 ERROR bgp-agent AssertionError 2022-07-22 04:02:39.475 111551 ERROR bgp-agent After googling I found one more agent at https://opendev.org/x/ovn-bgp-agent and its also throwing an error. Which agent should I be using? root@rack-1-host-2:~# ovn-bgp-agent 2022-07-22 04:04:36.780 111761 INFO ovn_bgp_agent.config [-] Logging enabled! 2022-07-22 04:04:37.247 111761 INFO ovn_bgp_agent.agent [-] Service 'BGPAgent' stopped 2022-07-22 04:04:37.248 111761 INFO ovn_bgp_agent.agent [-] Service 'BGPAgent' starting 2022-07-22 04:04:37.248 111761 INFO ovn_bgp_agent.drivers.openstack.utils.frr [-] Add VRF leak for VRF ovn-bgp-vrf on router bgp 64999 2022-07-22 04:04:37.248 111761 INFO oslo.privsep.daemon [-] Running privsep helper: ['sudo', 'privsep-helper', '--privsep_context', 'ovn_bgp_agent.privileged.vtysh_cmd', '--privsep_sock_path', '/tmp/tmp4cie9eiz/privsep.sock'] 2022-07-22 04:04:37.687 111761 INFO oslo.privsep.daemon [-] Spawned new privsep daemon via rootwrap 2022-07-22 04:04:37.598 111769 INFO oslo.privsep.daemon [-] privsep daemon starting 2022-07-22 04:04:37.613 111769 INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 2022-07-22 04:04:37.617 111769 INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none 2022-07-22 04:04:37.617 111769 INFO oslo.privsep.daemon [-] privsep daemon running as pid 111769 2022-07-22 04:04:37.987 111769 ERROR ovn_bgp_agent.privileged.vtysh [-] Unable to execute vtysh with ['/usr/bin/vtysh', '--vty_socket', '/run/frr/', '-c', 'copy /tmp/tmpiz5s_wvs running-config']. Exception: Unexpected error while running command. Command: /usr/bin/vtysh --vty_socket /run/frr/ -c copy /tmp/tmpiz5s_wvs running-config Exit code: 1 Stdout: '% Unknown command: copy /tmp/tmpiz5s_wvs running-config\n' Stderr: '' Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/ovn_bgp_agent/privileged/vtysh.py", line 30, in run_vtysh_config return processutils.execute(*full_args) File "/usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py", line 438, in execute raise ProcessExecutionError(exit_code=_returncode, oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Command: /usr/bin/vtysh --vty_socket /run/frr/ -c copy /tmp/tmpiz5s_wvs running-config Exit code: 1 Stdout: '% Unknown command: copy /tmp/tmpiz5s_wvs running-config\n' Stderr: '' 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service [-] Error starting thread.: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. Command: /usr/bin/vtysh --vty_socket /run/frr/ -c copy /tmp/tmpiz5s_wvs running-config Exit code: 1 Stdout: '% Unknown command: copy /tmp/tmpiz5s_wvs running-config\n' Stderr: '' 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service Traceback (most recent call last): 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/oslo_service/service.py", line 806, in run_service 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service service.start() 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/ovn_bgp_agent/agent.py", line 50, in start 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service self.agent_driver.start() 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/ovn_bgp_agent/drivers/openstack/ovn_bgp_driver.py", line 73, in start 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service frr.vrf_leak(constants.OVN_BGP_VRF, CONF.bgp_AS, CONF.bgp_router_id) 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/ovn_bgp_agent/drivers/openstack/utils/frr.py", line 110, in vrf_leak 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service _run_vtysh_config_with_tempfile(vrf_config) 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/ovn_bgp_agent/drivers/openstack/utils/frr.py", line 93, in _run_vtysh_config_with_tempfile 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service ovn_bgp_agent.privileged.vtysh.run_vtysh_config(f.name) 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service return self.channel.remote_call(name, args, kwargs, 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service raise exc_type(*result[2]) 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command. 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service Command: /usr/bin/vtysh --vty_socket /run/frr/ -c copy /tmp/tmpiz5s_wvs running-config 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service Exit code: 1 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service Stdout: '% Unknown command: copy /tmp/tmpiz5s_wvs running-config\n' 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service Stderr: '' 2022-07-22 04:04:37.990 111761 ERROR oslo_service.service 2022-07-22 04:04:37.993 111761 INFO ovn_bgp_agent.agent [-] Service 'BGPAgent' stopping 2022-07-22 04:04:37.994 111761 INFO ovn_bgp_agent.agent [-] Service 'BGPAgent' stopped

2 3

Regarding Designate as a DNS in Open Stack Xena
by Adivya Singh 23 Jul '22

23 Jul '22

hi Team, I have a use case where Customer want to map the Full qualified domain name to the FLoating IP to connect to the Server. Besides creating a designation lxc Container using ansible and Create Zones, Do we need to do anything else from our side. I mean how the records are manager using designate Regards Adivya Singh

2 1

[dev][designate][dns] Adding private DNS feature
by Sergey Drozdov 22 Jul '22

22 Jul '22

Dear Sir/Madam, We are running OpenStack at scale and now have a requirement to have private DNS and were wondering if the designate team have any appetite for this? If yes, then further discussion is warranted as we would be happy to get the ball rolling on this. Best Regards, Sergey Drozdov Software Engineer The Hut Group

3 3

Mentors Needed - Grace Hopper Open Source Day + OpenStack
by Kendall Nelson 22 Jul '22

22 Jul '22

Hello Everyone! We are again signed up to participate in Open Source Day at the Grace Hopper Conference. It's a virtual event, being held on Friday, September 16, 2022, from 8am to 3pm Pacific Time. If you are interested in mentoring for this one day event, please let me know ASAP. I am supposed to give them a list of mentors by the end of this week. Day of, we will essentially get participants to setup a dev environment (gerrit, etc) and work on a bug and get it pushed. At this point I was thinking of making use of gaps in the SDK/OSC, but if your project has some low hanging fruit that you want to bring along, that works too! Looking forward to working with you!! -Kendall (diablo_rojo)

6 9

[all][TC] Bare rechecks
by Slawek Kaplonski 22 Jul '22

22 Jul '22

Hi, New stats from last 7 days about bare rechecks in each team are available in [1]: +--------------------+---------------+--------------+-------------------+ | Team | Bare rechecks | All Rechecks | Bare rechecks [%] | +--------------------+---------------+--------------+-------------------+ | skyline | 2 | 2 | 100.0 | | sahara | 2 | 2 | 100.0 | | trove | 4 | 4 | 100.0 | | tacker | 6 | 6 | 100.0 | | horizon | 25 | 25 | 100.0 | | magnum | 2 | 2 | 100.0 | | masakari | 2 | 2 | 100.0 | | Telemetry | 1 | 1 | 100.0 | | kolla | 71 | 74 | 95.95 | | OpenStack Charms | 16 | 17 | 94.12 | | requirements | 33 | 37 | 89.19 | | cinder | 137 | 163 | 84.05 | | kuryr | 5 | 6 | 83.33 | | OpenStack-Helm | 23 | 29 | 79.31 | | tripleo | 97 | 125 | 77.6 | | glance | 17 | 22 | 77.27 | | Puppet OpenStack | 23 | 30 | 76.67 | | ironic | 43 | 57 | 75.44 | | keystone | 6 | 8 | 75.0 | | octavia | 32 | 44 | 72.73 | | swift | 8 | 11 | 72.73 | | manila | 27 | 38 | 71.05 | | OpenStackSDK | 17 | 24 | 70.83 | | oslo | 12 | 17 | 70.59 | | ec2-api | 2 | 3 | 66.67 | | Quality Assurance | 13 | 20 | 65.0 | | neutron | 33 | 52 | 63.46 | | nova | 84 | 133 | 63.16 | | heat | 3 | 5 | 60.0 | | Release Management | 1 | 2 | 50.0 | | designate | 4 | 8 | 50.0 | | barbican | 2 | 12 | 16.67 | | OpenStackAnsible | 0 | 1 | 0.0 | +--------------------+---------------+--------------+-------------------+ [1] https://etherpad.opendev.org/p/recheck-weekly-summary[1] -- Slawek Kaplonski Principal Software Engineer Red Hat

3 3