Hi Tony, Thanks for answering! On 7/11/2023 10:01 am, Tony Breeds wrote:
This has been discussed before, not for a while though. The last time I recall was the first Denver PTG.
In the past we did remove docs as branches were EOLd which resulted in lots of 404s as a search engine would index a page and return it but we had removed it so the user got a 404.
I think this is similar to what happened to Crossplane and they had to explicitly get Google to reindex those[1].
There was also a lengthy discussion about not removing docs that people are using. I haven't looked at the user survey results but I'm sure you've seen the long tail of people still using very old results.
In that case, removing those docs may be a step too far.
We could potentially remove the older releases from the index by doing something similar to the crossplane project did. That has the potential to solve most of the problems we've all seen but doesn't remove the docs for older releases in general.
I attempted to look into it a bit, but it's not my specialty. Also, eventually, it'll require someone to re-trigger indexing from Google via search console[2], which needs domain ownership verification (via TXT record, etc). [1] https://github.com/crossplane/docs/issues/107#issuecomment-990338800 [2] https://search.google.com/search-console/