[Openstack-operators] backup to object store - tool recommendations

Fausto Marzi fausto.marzi at gmail.com
Wed Mar 29 11:52:27 UTC 2017


Hi Blair,
if you need just a command line tool to backup files to Swift or ssh or
local, use just the freezer-agent in https://github.com/openstack/freezer

It provides the feature you requested but it does not support S3.

If anyone wants to contribute and add S3 as back end storage, that'd be
fantastic.

Thanks,
Fausto


On Wed, Mar 29, 2017 at 12:31 PM, Mathieu, Pierre-Arthur <
pierre-arthur.mathieu at hpe.com> wrote:

> Hello,
>
> Freezer seems like a perfect fit for your need.
>
> It's an official OpenStack project that provides backup/restore
> capabilities for Filesystem, Volumes, VMs and Applications.
> It supports storing the backups in Object Storage (Swift, Ceph, ...), to
> an ssh server or localy (mounted NFS, GlusterFS, ...).
>
> Here is our Wiki: https://wiki.openstack.org/wiki/Freezer
> The project's code:
>   - https://github.com/openstack/freezer
>   - https://github.com/openstack/freezer-api
>   - https://github.com/openstack/freezer-web-ui
>   - https://github.com/openstack/python-freezerclient
>
> If you have any question, feel free to join our IRC room:
> #openstack-freezer
>
> Kind Regards,
> Pierre
> ________________________________________
> From: Blair Bethwaite <blair.bethwaite at gmail.com>
> Sent: Wednesday, March 29, 2017 8:47:31 AM
> To: Saverio Proto
> Cc: openstack-oper.
> Subject: Re: [Openstack-operators] backup to object store - tool
> recommendations
>
> Hi Saverio. Looks like we will have that issue within a week or two once
> we finally upgrade our rgw (lagging behind the rest of our cluster). I will
> try logging​ this as a priority with Red Hat support.
>
> On 29 Mar. 2017 18:39, "Saverio Proto" <zioproto at gmail.com<mailto:zio
> proto at gmail.com>> wrote:
> Hello all,
>
> we use rclone a lot, and we are happy with it.
>
> the real problem I would say is that a lot of these tools use the
> latest AWS4 signature.
>
> AFAIK the radosgw with Ceph Jewel and Openstack keystone integration
> supports only AWS2 signature because of this bug:
> http://tracker.ceph.com/issues/19056
>
> is anyone else hitting this ?
>
> Saverio
>
> 2017-03-27 22:11 GMT+02:00 John Dickinson <me at not.mn<mailto:me at not.mn>>:
> >
> >
> > On 27 Mar 2017, at 4:39, Blair Bethwaite wrote:
> >
> >> Hi all,
> >>
> >> Does anyone have any recommendations for good tools to perform
> >> file-system/tree backups and restores to/from a (Ceph RGW-based)
> >> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
> >> commercial options please.
> >>
> >> I'm interested in:
> >> 1) tools known to work or not work at all for a basic file-based data
> backup
> >
> > There's a bunch of backup tools that will work with the Swift API and/or
> the S3 API.
> >
> > Veritas, Commvault, Trilio, and CloudBerry all work. There's other
> companies too that can back specific stuff up to Swift (e.g. Percona with
> MySQL).
> >
> > (The above list taken from https://www.swiftstack.com/solutions/backup
> [my employer] because it's the first linkable place I knew of to answer
> your question.)
> >
> >
> > --John
> >
> >
> >
> >
> >>
> >> Plus these extras:
> >> 2) preserves/restores correct file metadata (e.g. owner, group, acls
> etc)
> >> 3) preserves/restores xattrs
> >> 4) backs up empty directories and files
> >> 5) supports some sort of snapshot/versioning/differential
> >> functionality, i.e., will keep a copy or diff or last N versions of a
> >> file or whole backup set, e.g., so that one can restore yesterday's
> >> file/s or last week's but not have to keep two full copies to achieve
> >> it
> >> 6) is readily able to restore individual files
> >> 7) can encrypt/decrypt client side
> >> 8) anything else I should be considering?
> >>
> >> --
> >> Cheers,
> >> ~Blairo
> >>
> >> _______________________________________________
> >> OpenStack-operators mailing list
> >> OpenStack-operators at lists.openstack.org<mailto:OpenStack
> -operators at lists.openstack.org>
> >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org<mailto:OpenStack
> -operators at lists.openstack.org>
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20170329/53fa9500/attachment.html>


More information about the OpenStack-operators mailing list