[OpenStack-Infra] Moving docs-draft to logs.o.o

James E. Blair corvus at inaugust.com
Wed Sep 20 22:23:21 UTC 2017


Hi,

We originally created the docs-draft site (and filesystem partition)
because doc builds were *big* and we had to expire them much more
quickly than build logs.  The expiration times were 21 days for
docs-draft and 6 months for build logs.

The tables have turned.

Docs-draft expiration is still 21 days, but build logs have gotten so
large we've reduced expiration there to 30 days.

Since they are more closely matched now, we can fold docs-draft back
into the logs volume and gain several benefits.  We're currently using
299G of space for docs-draft.  Accounting for the extra 9 days of
retention would bring us to about 427G of space.  Our current headroom
on logs is 3.0T, so we can handle that change immediately with no ill
effect.

Once the existing retention period has expired, we can reclaim the space
from the doc-draft volume and gain an additional 1.5T of capacity in
logs.  Once that is done, accounting for the increased use from
docs-draft jobs, we'll have an overall net gain of 1T of free space.

On top of all that, we will improve the UX of the docs-draft system by
making it easier to switch to the build logs on a successful build.
Currently we have to edit the hostname in the URL to do so; but in the
future, we can simply remove trailing path components.

Assuming there aren't any objections, we can effect this change during
the v3 transition, then perform the volume reclamation 3 weeks later.

-Jim



More information about the OpenStack-Infra mailing list