Open Stack

> On Sep 3, 2019, at 9:04 AM, Stephen Finucane <sfinucan at redhat.com> wrote:
> 
> On Tue, 2019-09-03 at 08:42 -0400, Doug Hellmann wrote:
>>> On Sep 3, 2019, at 5:54 AM, Stephen Finucane <sfinucan at redhat.com> wrote:
>>> 
>>> On Mon, 2019-09-02 at 15:31 -0400, Doug Hellmann wrote:
>>>>> On Sep 2, 2019, at 3:07 AM, Akihiro Motoki <amotoki at gmail.com> wrote:
>>> 
>>> [snip]
>>> 
>>>>> When the goal is defined the docs team thought the doc gate job can
>>>>> handle the PDF build
>>>>> without extra tox env and zuul job configuration. However, during
>>>>> implementing the zuul job support
>>>>> it turns out at least a new tox env or an extra zuul job configuration
>>>>> is required in each project
>>>>> to make the docs job fail when PDF build failure is detected. As a
>>>>> result, we changes the approach
>>>>> and the new tox target is now required in each project repo.
>>>> 
>>>> The whole point of structuring the goal the way we did was that we do
>>>> not want to update every single repo this cycle so we could roll out
>>>> PDF building transparently. We said we would allow the job to pass
>>>> even if the PDF build failed, because this was phase 1 of making all
>>>> of this work.
>>>> 
>>>> The plan was to 1. extend the current job to make PDF building
>>>> optional; 2. examine the results to see how many repos need
>>>> significant work; 3. add a feature flag via a setting somewhere in
>>>> the repo to control whether the job fails if PDFs cannot be built.
>>>> That avoids a second doc job running in parallel, and still allows us
>>>> to roll out the PDF build requirement over time when  we have enough
>>>> information to do so.
>>> 
>>> Unfortunately when we tried to implement this we found that virtually
>>> every project we looked at required _some_ amount of tweaks just to
>>> build, let alone look sensible. This was certainly true of the big
>>> service projects (nova, neutron, cinder, ...) which all ran afoul of a
>>> bug [1] in the Sphinx LaTeX builder. Given the issues with previous
>>> approach, such as the inability to easily reproduce locally and the
>>> general "hackiness" of the thing, along with the fact that we now had
>>> to submit changes against projects anyway, a collective decision was
>>> made [2] to drop that plan and persue the 'pdfdocs' tox target
>>> approach.
>> 
>> We wanted to avoid making a bunch of the same changes to projects just to
>> add the PDF building instructions. If the *content* of a project’s documentation
>> needs work, that’s different. We should make those changes.
> 
> I thought the only reason to hack the docs venv in a Zuul job was to
> avoid having to mass patch projects to add tox configuration? As such,
> if we're already having to mass patch projects because they don't build
> otherwise, why wouldn't we add the tox configuration? Was there another
> reason to pursue the zuul-only approach that I've forgotten about/never
> knew?

I expected to need to fix formatting (even up to the point of commenting things
out, like we found with the giant config sample files). Those are content changes,
and would be mostly unique across projects.

I wanted to avoid a large number of roughly identical changes to add tox environments,
zuul jobs, etc. because having a lot of patches like that across all the repos makes 
extra work for small gain, especially when we can get the same results with a small 
number of changes in one repository.

The approach we discussed was to update the docs job to run some extra steps using
scripts that lived in the openstackdocstheme repository. That shouldn’t require
adding any extra software or otherwise modifying the tox environments. Did that approach
not work out?

Doug