Open Stack

On Tue, Apr 21, 2015 at 2:42 PM, Artom Lifshitz <alifshit at redhat.com> wrote:

> Hello,
>
> I'd like to gauge acceptance of introducing a feature that would give
> operators
> a config option to perform real database deletes instead of soft deletes.
>
> There's definitely a need for *something* that cleans up the database.
> There
> have been a few attempts at a DB purge engine [1][2][3][4][5], and
> archiving to
> shadow tables has been merged [6] (though that currently has some issues
> [7]).
>
> DB archiving notwithstanding, the general response to operators when they
> mention the database becoming too big seems to be "DIY cleanup."
>
> I would like to propose a different approach: add a config option that
> turns
> soft-deletes into real deletes, and start telling operators "if you turn
> this
> on, it's DIY backups."
>
> Would something like that be acceptable and feasible? I'm ready to put in
> the
> work to implement this, however searching the mailing list indicates that
> it
> would be somewhere between non trivial and impossible [8]. Before I start,
> I
> would like some confidence that it's closer to the former than the latter
> :)
>

Acceptable as a deployer option: Yes
Feasible for all tables: Maybe.  The first steps would be:

1) Make a list of all the times we read soft deleted data and note which
tables they impact.
2) Determine if making soft delete optional on the tables impacted by
read_deleted=True, is useful. If so that would be a an easy win.
3) Figure out how to remove the read_deleted=True where used.


> Cheers!
>
> [1] https://blueprints.launchpad.net/nova/+spec/db-purge-engine
> [2] https://blueprints.launchpad.net/nova/+spec/db-purge2
> [3] https://blueprints.launchpad.net/nova/+spec/remove-db-archiving
> [4] https://blueprints.launchpad.net/nova/+spec/database-purge
> [5] https://blueprints.launchpad.net/nova/+spec/db-archiving
> [6] https://review.openstack.org/#/c/18493/
> [7] https://review.openstack.org/#/c/109201/
> [8]
> http://lists.openstack.org/pipermail/openstack-operators/2014-November/005591.html
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150424/7ac0a9f9/attachment.html>