Thomas Goirand <thomas@goirand.fr> wrote on ven. [2020-juil.-17 09:47:22 +0200]:
On 7/16/20 3:31 PM, Arnaud Morin wrote:
Hello large-scalers!
TLDR: we opensource a tool to help reducing size of databases. See https://github.com/ovh/osarchiver/
Few months ago, we released a tool, name osarchiver, which we are using on our production environment (at OVH) to help reduce the size of our tables in mariadb (or mysql)
In fact, some tables are well know to grow very quickly.
We use it, for example, to clean the OpenStack mistral database from old tasks, actions and executions which are older than a year.
Another use case could be to archive some data in another table (e.g. with _archived as suffix) if they are 6 months old, and delete this data after 1 year.
The source code of this tool is available here: https://github.com/ovh/osarchiver/
We were wondering if some other users would be interested in using the tool, and maybe move it under the opendev governance?
Feel free to contact us and/or answer this thread.
Cheers,
Hi,
That's very nice, thanks a lot for releasing such a thing.
However, there's room for improvement if you would like to see your tool shipped everywhere:
- please define a requirements.txt - please get the debian folder away from the main master branch, especially considering it's using dh_virtualenv !!! - please tag with a release number
Also, with what release of OpenStack has this been tested? Is this bound to a specific release?
Cheers,
Thomas Goirand (zigo)
Hi Thomas, Thanks for your answer. We will update the repository accordingly. We tested OSArchiver on Newton and Stein releases of OpenStack. By design the tool is agnostic and rely only on the presence of the 'deleted_at' column so for now we do not expect to be bound to a specific release. Best regards, -- PS