[TripleO] Gate blocker - tripleo-ci-centos-9-content-provider
Hello All,
We have gate/check blocker which started late on Friday - and still seems to be hitting jobs in check and gate:
2022-01-16 02:53:58.796730 | primary | Error: 2022-01-16 02:53:58.796795 | primary | Problem: cannot install the best update candidate for package gcc-11.2.1-6.1.el9.x86_64 2022-01-16 02:53:58.796813 | primary | - nothing provides libgomp = 11.2.1-7.4.el9 needed by gcc-11.2.1-7.4.el9.x86_64 2022-01-16 02:53:58.796828 | primary | - nothing provides libgcc >= 11.2.1-7.4.el9 needed by gcc-11.2.1-7.4.el9.x86_64 2022-01-16 02:53:58.796904 | primary | (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not.
It looks like the mirrors do not have this latest content.
The failure is logged at: https://bugs.launchpad.net/tripleo/+bug/1957950.
We will respond to this posting once the failure has been cleared.
Thank you.
On 2022-01-16 05:39:04 -0500 (-0500), Ronelle Landy wrote: [...]
https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not.
It looks like the mirrors do not have this latest content.
[...]
Our mirrors pull updates for that from rsync://dfw.mirror.rackspace.com/centos-stream/9-stream/ and last succeeded at 2022-01-14 14:07 UTC according to the timestamp.txt file. I can see in our update logs that, starting at 2022-01-14 16:07 UTC, we've been getting the following error:
rsync: failed to connect to dfw.mirror.rackspace.com (74.205.112.120): Connection refused (111)
I don't know if that site has ceased providing rsync access or is merely suffering from a temporary problem, but we can switch to pulling updates from another official rsync site if someone can suggest an appropriate change to this file:
https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/...
Hello Jeremy,
On Sun, Jan 16, 2022 at 7:03 PM Jeremy Stanley fungi@yuggoth.org wrote:
On 2022-01-16 05:39:04 -0500 (-0500), Ronelle Landy wrote: [...]
https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not.
It looks like the mirrors do not have this latest content.
[...]
Our mirrors pull updates for that from rsync://dfw.mirror.rackspace.com/centos-stream/9-stream/ and last succeeded at 2022-01-14 14:07 UTC according to the timestamp.txt file. I can see in our update logs that, starting at 2022-01-14 16:07 UTC, we've been getting the following error:
rsync: failed to connect to dfw.mirror.rackspace.com (74.205.112.120): Connection refused (111)I don't know if that site has ceased providing rsync access or is merely suffering from a temporary problem, but we can switch to pulling updates from another official rsync site if someone can suggest an appropriate change to this file:
Thank you for looking into this. Based on https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64, I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829
It might be more reliable, The above missing package is also available on facebook mirror: https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages...
I hope it will help to unblock the CI.
Thanks,
Chandan Kumar
On 2022-01-16 19:44:25 +0530 (+0530), Chandan Kumar wrote: [...]
Thank you for looking into this. Based on https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64, I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829
It might be more reliable, The above missing package is also available on facebook mirror: https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages...
I hope it will help to unblock the CI.
I've update the mirror successfully from the URL you provided, so please check at your earliest convenience that jobs are finding the packages you expect. Thanks!
On Sun, Jan 16, 2022 at 9:46 AM Jeremy Stanley fungi@yuggoth.org wrote:
On 2022-01-16 19:44:25 +0530 (+0530), Chandan Kumar wrote: [...]
Thank you for looking into this. Based on
https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64 ,
I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829
It might be more reliable, The above missing package is also available on facebook mirror:
https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages...
I hope it will help to unblock the CI.
I've update the mirror successfully from the URL you provided, so please check at your earliest convenience that jobs are finding the packages you expect. Thanks!
Thanks Chandan and Jeremy for taking action on this so quickly!
Rekicked a few jobs and it looks like they are proceeding past the failure point.
-- Jeremy Stanley
participants (3)
-
Chandan Kumar
-
Jeremy Stanley
-
Ronelle Landy