On 2022-01-20 15:19:45 +0530 (+0530), Chandan Kumar wrote:
Currently CentOS Stream 8 based jobs are hitting RETRY or RETRY_LIMIT.
https://zuul.opendev.org/t/openstack/builds?result=RETRY&result=RETRY_LIMIT&skip=0 Based on the logs, all are hitting with : ``` rrors during downloading metadata for repository 'appstream': 2022-01-20 09:34:18.119377 | primary | - Status code: 404 for https://mirror-int.iad.rax.opendev.org/centos/8-stream/AppStream/x86_64/os/r... (IP: 10.208.224.52) 2022-01-20 09:34:18.119443 | primary | - Status code: 404 for https://mirror-int.iad.rax.opendev.org/centos/8-stream/AppStream/x86_64/os/r... (IP: 10.208.224.52)
``` While taking a look at https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/...
``` 404 for http://mirror.dal10.us.leaseweb.net/centos/8-stream/AppStream/x86_64/os/re podata/09255ba7c10e01afeb0d343667190f9c3e42d0a6099f887619abcb92ea0378db-filelists.xml.gz (IP: 209.58.153.1) ``` It seems the centos mirror have issues. https://review.opendev.org/c/opendev/system-config/+/825446 make the switch to facebook mirror.
It might fix the issue. [...]
The content of /centos/8-stream/AppStream/x86_64/os/repodata/ on mirror.facebook.net is identical to what we're serving already. I checked some other mirrors, e.g. linuxsoft.cern.ch, and see the same. The repomd.xml indices on them all match too. -- Jeremy Stanley