Hi Oslo Team, In the last couple of months the periodic-stable job errors (and thus the mails on openstack-stable-maint mailing list [1], where mails are sent from every failing jobs) increased significantly. I've talked with the infra team as the mail traffic is quite visible for them as well. I've collected the recent failures with examples that are failing constantly. Please take a look at them and try to fix them wherever it is possible. Since the old branches seem quite abandoned in some cases, they might need maintainers to step up to keep those gates healthy, or in case there are no maintainers, then it might worth to think of transitioning those broken old branches to End of Life. :/ And the list: * bandit should be constrained: castellan: pike - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/895fe297233946f98a9e9af03a6c74e2 castellan: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ab967d6815dd4677a2ec88eeb3a34ec7 castellan: queens - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/123fccfdda07427f832edf8b1d4c29b7 castellan: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/6cf6a42727694d54b8af6e67a6b1ca19 castellan: rocky - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/bee5338851fc4b0fb104b475ed330461 castellan: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/8af786c33bdd443988435194e91a7d67 oslo.concurrency: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/2b4f7384965f467cb3bc42596b077f92 oslo.config: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/b0b4d2102ae642d8b7a9e3856edc48b3 oslo.db: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/3c343538cd614e93b891358a76f1184b oslo.i18n: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/139d5b8170914b1f9800d501c249db4c oslo.serialization: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/c151cdf2f455462c894598959d46fb40 oslo.utils: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/526bffa7e1a34180aea9aae427767f57 oslo.versionedobjects: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/600ce22180b5446eb40c2ca166a5386a stevedore: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/4d13f2d9185f427d930c598cb5318e01 * kombu should be constrained: oslo.versionedobjects: train - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/3bd89a5d06dd4dba9f7789e4654c58ef * tenacity should be constrained: tooz: train - openstack-tox-py36 -- https://zuul.opendev.org/t/openstack/build/70100c4c526d4580b0f403ad7848d88e tooz: train - openstack-tox-py37 -- https://zuul.opendev.org/t/openstack/build/6bf70906d98c44b4a1eecd4e54fae9aa tooz: ussuri - openstack-tox-py36 -- https://zuul.opendev.org/t/openstack/build/9587cbf9f2e74b659fcf05ba344fee53 tooz: ussuri - openstack-tox-py37 -- https://zuul.opendev.org/t/openstack/build/207647f362bc4a02bbf5a3d899cf214b * some unit tests fails: tooz: stein - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/88ab5e0fe2254c9fbc9d0d4b992a0b42 tooz: train - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/96834e301c22471897a65249ce906e71 * victoria and wallaby started to be unstable for tooz, eg: tooz: victoria - openstack-tox-py36 -- https://zuul.opendev.org/t/openstack/build/897589432ccf44398494735914973618 * pypi deprecated non-SNI clients, thus easy_install fails to install pbr ( https://github.com/pypa/pypi-support/issues/978 ) this affects rocky, queens and pike of oslo repositories): automaton: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/719a0ab38775446b86a666dd3c054061 automaton: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/5a6319acb5974638a42b52d7ed6c3cf1 automaton: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/4fd5111d609f427fb90667e6a44f8c17 debtcollector: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/68b2af8828cd4572b4ecaec9b36e5424 debtcollector: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/68706fd6ac554eab93cfec17e31cc79a debtcollector: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/f54f4938e10348c3af8e2f14468048cc futurist: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/1eea8623e8ba43e5b8ba8530c0ae90f4 oslo.cache: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/f808347fdc7e4ad98ab561aeddad205a oslo.cache: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/e45c04a5d8cf495bbf9ed8bd971df504 oslo.cache: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/cc46895fb3674e908c3cbab2a6c5ed92 oslo.concurrency: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/c1d0ce803ac34c75b520e1fba7499d02 oslo.concurrency: queens - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/e3350c67cd6c458c9962f7793eda1c4b oslo.concurrency: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/12b652d8eb354d3081d91930717dcec4 oslo.concurrency: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/4d67a5bdf9c44f6d9036ae0d9be7d03f oslo.config: pike - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/b1c36a7eed9c4148955db4373c38db7d oslo.config: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/c4959da6a33147c394aae86e768fa20c oslo.config: queens - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/fb16cd3772de4f38acd581eb2baa5ba7 oslo.config: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/e60c4a9d5a444692b934f245eba04d16 oslo.config: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/d7c6f58061db4f4b9f274221ddcb01b6 oslo.context: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/9113e18fbe454b559f7bdb0d7de31e6a oslo.context: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/3168440071cd449aa989a7f62329e3ed oslo.context: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/b7bb5b23ee5f4756852605a14c2156d6 oslo.db: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/a8d0ae71aac8418394def01ad12d2d5a oslo.db: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/9ccbcd27b0964d9c96cb1a7d8a489dc8 oslo.db: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/25be12a745294755a7b9b690b2620fd3 oslo.i18n: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/a28e38e82303447ca44142e746498e47 oslo.i18n: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/f9c856db930d4f6e91c8633acc742c72 oslo.i18n: rocky - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/cd642d7ab2ac47ea9d3b3fbecc91109e oslo.i18n: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ac45c2167f6b40acbc44256132b59442 oslo.log: pike - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/0fbc509a9f144d33938d39152067cbe2 oslo.log: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ea0becc642de4f14965ef38288bf5873 oslo.log: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/921d4c239042402dae9d2193a9c082c5 oslo.log: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/76f5618b1c5f4c958fcd6d397e0a9df1 oslo.messaging: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/aa9151138c374d70a8a8831ef60d2771 oslo.messaging: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/666ce2de12204d8bbfcee78fa466873a oslo.messaging: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/1d5741ebbbdb40eb80025f6940242353 oslo.middleware: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/573d4928602c40d89c6cf13b668939a9 oslo.middleware: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ac2dd16b2ee54f92bf2f5d898687344c oslo.middleware: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/931b5e9b36bd4ca9a15d67394da45342 oslo.policy: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/c1984679d507466bb435e4fc43bdfc5b oslo.policy: queens - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/2ac005e50e5c4ee4b763dc275ed009a4 oslo.policy: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/415d586288d8455ba3676052c42e0a6d oslo.policy: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/2d02eb18525a476d9df7f5f20b0d13d4 oslo.privsep: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/875d2c7ea297445cbbc75853c208f8e6 oslo.privsep: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/3a87405b33de439f9796fa82c921a5fb oslo.privsep: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/28e1bb032cfa4dc48e870090b45f062a oslo.reports: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/19f6577223364fd98874ca14db940c0c oslo.reports: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/188f3d4531574059b42ef23e74d9e0f9 oslo.reports: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/06d0828c38834303b6c54a95a17c088a oslo.rootwrap: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/5e474c951597456195872cb29d955c5a oslo.rootwrap: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/b91ae91227d44581b5dce0b294cc9774 oslo.rootwrap: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ae561d517acf42bbba55e6bfa1ff5a50 oslo.serialization: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/97dbab1f4e6145ebb1f1ef9de4bdca88 oslo.serialization: queens - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/9d5aa72898c841e08fe735b1e4079e36 oslo.serialization: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/4369aefd217a4ef796cc74fa5e498644 oslo.serialization: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/d766368eb9ed4437b8860f658d9e55cd oslo.service: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/9b688084719748338727d23017b9fe80 oslo.service: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/1980b086eb6044d294320cd7f2e46386 oslo.service: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/b81f4502ec28450995dc71fcb15ff23f oslo.utils: pike - build-openstack-sphinx-docs -- https://zuul.opendev.org/t/openstack/build/1f41fd1ebb5344fdb1ec0a9b3df42531 oslo.utils: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/eeb743c4c2a343b596baa2905a3c746e oslo.utils: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/b0579106ff2b492d9a1d8d8ff7278392 oslo.utils: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/ab8ae31c2a3746339a08fc61eddc1615 oslo.versionedobjects: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/2189be5f9f914b5cb28828ead3cb3576 oslo.versionedobjects: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/cc74b040053145328e09a5f0dcc5d3e7 oslo.versionedobjects: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/a261f4bfe4c540ff8d7f737ada9b5de2 oslotest: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/01277fd253fe4c0a9b20f812c4af02e9 oslotest: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/f30a55be457540ae90a144dafae71c95 oslotest: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/cf7ae6a1fa554ef5880e11b006dbc8d0 stevedore: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/9ce43fcfcd634fbbaf42f4a85878f3b6 stevedore: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/44a9da78dded41329cf79f5da388662d stevedore: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/9e6b8e01531f49bd914a480af65a3527 taskflow: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/04299e6b0cf8442694ebb145bf26e96c taskflow: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/25425358637e4561b8bb63f308d1178e taskflow: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/bbb87a51c5a8462d82630530f43d642f tooz: pike - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/a650be12dc3842ca868f3c9da78ff392 tooz: queens - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/feb0140b4fb242f8ba2bdb0dcff426e2 tooz: rocky - openstack-tox-py27 -- https://zuul.opendev.org/t/openstack/build/5e4c7bd808ae441e8cd073513ac29f2e [1] http://lists.openstack.org/pipermail/openstack-stable-maint/2021-July/thread... Thanks, Előd