[TripleO] Gate blocker - tripleo-ci-centos-9-content-provider
Hello All, We have gate/check blocker which started late on Friday - and still seems to be hitting jobs in check and gate: 2022-01-16 02:53:58.796730 | primary | Error: 2022-01-16 02:53:58.796795 | primary | Problem: cannot install the best update candidate for package gcc-11.2.1-6.1.el9.x86_64 2022-01-16 02:53:58.796813 | primary | - nothing provides libgomp = 11.2.1-7.4.el9 needed by gcc-11.2.1-7.4.el9.x86_64 2022-01-16 02:53:58.796828 | primary | - nothing provides libgcc >= 11.2.1-7.4.el9 needed by gcc-11.2.1-7.4.el9.x86_64 2022-01-16 02:53:58.796904 | primary | (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm <https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm> 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not. It looks like the mirrors do not have this latest content. The failure is logged at: https://bugs.launchpad.net/tripleo/+bug/1957950. We will respond to this posting once the failure has been cleared. Thank you.
On 2022-01-16 05:39:04 -0500 (-0500), Ronelle Landy wrote: [...]
https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm <https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm> 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not.
It looks like the mirrors do not have this latest content. [...]
Our mirrors pull updates for that from rsync://dfw.mirror.rackspace.com/centos-stream/9-stream/ and last succeeded at 2022-01-14 14:07 UTC according to the timestamp.txt file. I can see in our update logs that, starting at 2022-01-14 16:07 UTC, we've been getting the following error: rsync: failed to connect to dfw.mirror.rackspace.com (74.205.112.120): Connection refused (111) I don't know if that site has ceased providing rsync access or is merely suffering from a temporary problem, but we can switch to pulling updates from another official rsync site if someone can suggest an appropriate change to this file: https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/... -- Jeremy Stanley
Hello Jeremy, On Sun, Jan 16, 2022 at 7:03 PM Jeremy Stanley <fungi@yuggoth.org> wrote:
On 2022-01-16 05:39:04 -0500 (-0500), Ronelle Landy wrote: [...]
https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/B... does show libgomp-11.2.1-7.4.el9.x86_64.rpm <https://composes.stream.centos.org/production/latest-CentOS-Stream/compose/BaseOS/x86_64/os/Packages/libgomp-11.2.1-7.4.el9.x86_64.rpm> 2022-01-11 11:59 283K but http://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64... (for example) does not.
It looks like the mirrors do not have this latest content. [...]
Our mirrors pull updates for that from rsync://dfw.mirror.rackspace.com/centos-stream/9-stream/ and last succeeded at 2022-01-14 14:07 UTC according to the timestamp.txt file. I can see in our update logs that, starting at 2022-01-14 16:07 UTC, we've been getting the following error:
rsync: failed to connect to dfw.mirror.rackspace.com (74.205.112.120): Connection refused (111)
I don't know if that site has ceased providing rsync access or is merely suffering from a temporary problem, but we can switch to pulling updates from another official rsync site if someone can suggest an appropriate change to this file:
Thank you for looking into this. Based on https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64, I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829 It might be more reliable, The above missing package is also available on facebook mirror: https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages... I hope it will help to unblock the CI. Thanks, Chandan Kumar
On 2022-01-16 19:44:25 +0530 (+0530), Chandan Kumar wrote: [...]
Thank you for looking into this. Based on https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64, I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829
It might be more reliable, The above missing package is also available on facebook mirror: https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages...
I hope it will help to unblock the CI.
I've update the mirror successfully from the URL you provided, so please check at your earliest convenience that jobs are finding the packages you expect. Thanks! -- Jeremy Stanley
On Sun, Jan 16, 2022 at 9:46 AM Jeremy Stanley <fungi@yuggoth.org> wrote:
On 2022-01-16 19:44:25 +0530 (+0530), Chandan Kumar wrote: [...]
Thank you for looking into this. Based on https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64 , I have proposed a patch to use facebook rsync mirror to pull cs9 contents: https://review.opendev.org/c/opendev/system-config/+/824829
It might be more reliable, The above missing package is also available on facebook mirror:
https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages...
I hope it will help to unblock the CI.
I've update the mirror successfully from the URL you provided, so please check at your earliest convenience that jobs are finding the packages you expect. Thanks!
Thanks Chandan and Jeremy for taking action on this so quickly! Rekicked a few jobs and it looks like they are proceeding past the failure point.
-- Jeremy Stanley
participants (3)
-
Chandan Kumar
-
Jeremy Stanley
-
Ronelle Landy