[largescale-sig] OpenStack DB Archiver

Pierre-Samuel LE STANG pierre-samuel.le-stang at corp.ovh.com
Fri Jul 17 08:53:27 UTC 2020


Thomas Goirand <thomas at goirand.fr> wrote on ven. [2020-juil.-17 09:47:22 +0200]:
> On 7/16/20 3:31 PM, Arnaud Morin wrote:
> > Hello large-scalers!
> > 
> > TLDR: we opensource a tool to help reducing size of databases.
> >       See https://github.com/ovh/osarchiver/
> > 
> > 
> > Few months ago, we released a tool, name osarchiver, which we are using
> > on our production environment (at OVH) to help reduce the size of our
> > tables in mariadb (or mysql)
> > 
> > In fact, some tables are well know to grow very quickly.
> > 
> > We use it, for example, to clean the OpenStack mistral database from old
> > tasks, actions and executions which are older than a year.
> > 
> > Another use case could be to archive some data in another table (e.g. with
> > _archived as suffix) if they are 6 months old, and delete this data after
> > 1 year.
> > 
> > The source code of this tool is available here:
> > https://github.com/ovh/osarchiver/
> > 
> > We were wondering if some other users would be interested in using the
> > tool, and maybe move it under the opendev governance?
> > 
> > Feel free to contact us and/or answer this thread.
> > 
> > Cheers,
> 
> Hi,
> 
> That's very nice, thanks a lot for releasing such a thing.
> 
> However, there's room for improvement if you would like to see your tool
> shipped everywhere:
> 
> - please define a requirements.txt
> - please get the debian folder away from the main master branch,
> especially considering it's using dh_virtualenv !!!
> - please tag with a release number
> 
> Also, with what release of OpenStack has this been tested? Is this bound
> to a specific release?
> 
> Cheers,
> 
> Thomas Goirand (zigo)

Hi Thomas,

Thanks for your answer. We will update the repository accordingly.

We tested OSArchiver on Newton and Stein releases of OpenStack. By design the
tool is agnostic and rely only on the presence of the 'deleted_at' column so
for now we do not expect to be bound to a specific release.

Best regards,

-- 
PS



More information about the openstack-discuss mailing list