This has been discussed before, not for a while though.  The last time I recall was the first Denver PTG.

In the past we did remove docs as branches were EOLd which resulted in lots of 404s as a search engine would index a page and return it but we had removed it so the user got a 404.

There was also a lengthy discussion about not removing docs that people are using.  I haven't looked at the user survey results but I'm sure you've seen the long tail of people still using very old results.

We could potentially remove the older releases from the index by doing something similar to the crossplane project did.  That has the potential to solve most of the problems we've all seen but doesn't remove the docs for older releases in general.

On Fri, Nov 3, 2023, 07:03 Jake Yip <jake.yip@ardc.edu.au> wrote:
Hi all,

I am not sure if this is encountered by others, but often when I search
for something regarding OpenStack, the first few results are of older
versions. For example, my last search was "keystone config
service_token_roles_required", which returns a Pike[1] URL as first result.

For older versions, the documentation does have a header which is
something like "This release is no longer supported by the community.
The current supported release is 2023.2." It links to new
documentation[2], but drops me to the docs root instead of the new
version of this page and usually is not useful for me. (I understand it
is not possible to drop at the same page as documentation moves around).
I often try to change the version in the URL to 'latest' which works
sometimes.

I wonder if we can help to fix this? Looking at other people with this
issue[3], a few strategies seems to have help. (Disclaimer: I am not a
SEO expert).

1. Prevent Google from indexing the older versions by using `noindex`[4]
2. Removing old documentation so it is flushed from Google

Regards,
Jake

[1]
https://docs.openstack.org/keystone/pike/admin/identity-auth-token-middleware.html
[2] https://docs.openstack.org/2023.2/
[3] https://github.com/crossplane/docs/issues/107
[4]
https://developers.google.com/search/docs/crawling-indexing/block-indexing

--
Jake Yip
Technical Lead, Nectar Research Cloud