[largescale-sig] OpenStack DB Archiver

Thomas Goirand thomas at goirand.fr
Fri Jul 17 07:47:22 UTC 2020


On 7/16/20 3:31 PM, Arnaud Morin wrote:
> Hello large-scalers!
> 
> TLDR: we opensource a tool to help reducing size of databases.
>       See https://github.com/ovh/osarchiver/
> 
> 
> Few months ago, we released a tool, name osarchiver, which we are using
> on our production environment (at OVH) to help reduce the size of our
> tables in mariadb (or mysql)
> 
> In fact, some tables are well know to grow very quickly.
> 
> We use it, for example, to clean the OpenStack mistral database from old
> tasks, actions and executions which are older than a year.
> 
> Another use case could be to archive some data in another table (e.g. with
> _archived as suffix) if they are 6 months old, and delete this data after
> 1 year.
> 
> The source code of this tool is available here:
> https://github.com/ovh/osarchiver/
> 
> We were wondering if some other users would be interested in using the
> tool, and maybe move it under the opendev governance?
> 
> Feel free to contact us and/or answer this thread.
> 
> Cheers,

Hi,

That's very nice, thanks a lot for releasing such a thing.

However, there's room for improvement if you would like to see your tool
shipped everywhere:

- please define a requirements.txt
- please get the debian folder away from the main master branch,
especially considering it's using dh_virtualenv !!!
- please tag with a release number

Also, with what release of OpenStack has this been tested? Is this bound
to a specific release?

Cheers,

Thomas Goirand (zigo)



More information about the openstack-discuss mailing list