[puppet][TripleO] Is the OpenDev yum-puppetlabs mirror still used?
Hello, The OpenDev team has been looking at our AFS disk utilization with an eye towards pruning and trimming out content that is no longer used. We've noticed that the yum-puppetlabs mirror [0] is fairly sizeable [1] and we're wondering if it is still being used. If it is still being used do you need all of the contents of the mirror or can we trim it back? Currently looks like there is content for older Fedora releases, SLES, and various puppet versions. It also looks like we may not have synced this recently (not sure why yet). Any info you can provide on how this is used is much appreciated. [0] https://mirror.iad.rax.opendev.org/yum-puppetlabs/ [1] https://grafana.opendev.org/d/T5zTt6PGk/afs?viewPanel=33&orgId=1 Clark
On Tue, Jul 20, 2021 at 2:02 PM Clark Boylan <cboylan@sapwetik.org> wrote:
Hello,
The OpenDev team has been looking at our AFS disk utilization with an eye towards pruning and trimming out content that is no longer used. We've noticed that the yum-puppetlabs mirror [0] is fairly sizeable [1] and we're wondering if it is still being used.
If it is still being used do you need all of the contents of the mirror or can we trim it back? Currently looks like there is content for older Fedora releases, SLES, and various puppet versions. It also looks like we may not have synced this recently (not sure why yet).
Yes it's still used by puppet jobs (and to a lesser extent tripleo). https://codesearch.opendev.org/?q=NODEPOOL_PUPPETLABS_MIRROR&i=nope&files=&excludeFiles=&repos= The scripts that reference it are part of the puppet-openstack-integration-run-base zuul job. You could definitely get away with purging any OS's we don't support.
Any info you can provide on how this is used is much appreciated.
[0] https://mirror.iad.rax.opendev.org/yum-puppetlabs/ [1] https://grafana.opendev.org/d/T5zTt6PGk/afs?viewPanel=33&orgId=1
Clark
On Tue, Jul 20, 2021 at 2:07 PM Alex Schultz <aschultz@redhat.com> wrote:
On Tue, Jul 20, 2021 at 2:02 PM Clark Boylan <cboylan@sapwetik.org> wrote:
Hello,
The OpenDev team has been looking at our AFS disk utilization with an eye towards pruning and trimming out content that is no longer used. We've noticed that the yum-puppetlabs mirror [0] is fairly sizeable [1] and we're wondering if it is still being used.
If it is still being used do you need all of the contents of the mirror or can we trim it back? Currently looks like there is content for older Fedora releases, SLES, and various puppet versions. It also looks like we may not have synced this recently (not sure why yet).
Yes it's still used by puppet jobs (and to a lesser extent tripleo). https://codesearch.opendev.org/?q=NODEPOOL_PUPPETLABS_MIRROR&i=nope&files=&excludeFiles=&repos=
The scripts that reference it are part of the puppet-openstack-integration-run-base zuul job.
Specifically it's used to install puppet for all puppet-openstack-integration-* jobs. Here's an example log showing this: https://zuul.opendev.org/t/openstack/build/709f769fe6b5400abea5e8fc6e6de8b9/...
You could definitely get away with purging any OS's we don't support.
Any info you can provide on how this is used is much appreciated.
[0] https://mirror.iad.rax.opendev.org/yum-puppetlabs/ [1] https://grafana.opendev.org/d/T5zTt6PGk/afs?viewPanel=33&orgId=1
Clark
On Tue, Jul 20, 2021, at 1:14 PM, Alex Schultz wrote:
On Tue, Jul 20, 2021 at 2:07 PM Alex Schultz <aschultz@redhat.com> wrote:
On Tue, Jul 20, 2021 at 2:02 PM Clark Boylan <cboylan@sapwetik.org> wrote:
Hello,
The OpenDev team has been looking at our AFS disk utilization with an eye towards pruning and trimming out content that is no longer used. We've noticed that the yum-puppetlabs mirror [0] is fairly sizeable [1] and we're wondering if it is still being used.
If it is still being used do you need all of the contents of the mirror or can we trim it back? Currently looks like there is content for older Fedora releases, SLES, and various puppet versions. It also looks like we may not have synced this recently (not sure why yet).
Yes it's still used by puppet jobs (and to a lesser extent tripleo). https://codesearch.opendev.org/?q=NODEPOOL_PUPPETLABS_MIRROR&i=nope&files=&excludeFiles=&repos=
The scripts that reference it are part of the puppet-openstack-integration-run-base zuul job.
Specifically it's used to install puppet for all puppet-openstack-integration-* jobs. Here's an example log showing this:
https://zuul.opendev.org/t/openstack/build/709f769fe6b5400abea5e8fc6e6de8b9/...
I've put this change, https://review.opendev.org/c/opendev/system-config/+/801529, together based on this feedback. It should remove old Fedora and SLES contents from this mirror. I think that we can probably remove all Fedora contents based on what I see in the puppet integration jobs, but I figured we could do this first then keep chipping away at it later. If you get a chance can you drop a review on that if it appears safe?
You could definitely get away with purging any OS's we don't support.
Any info you can provide on how this is used is much appreciated.
[0] https://mirror.iad.rax.opendev.org/yum-puppetlabs/ [1] https://grafana.opendev.org/d/T5zTt6PGk/afs?viewPanel=33&orgId=1
Clark
participants (2)
-
Alex Schultz
-
Clark Boylan