[Openstack-operators] backup to object store - tool recommendations

Blair Bethwaite blair.bethwaite at gmail.com
Thu Mar 30 03:03:07 UTC 2017


Reported to RH, they don't yet have a downstream issue for this and
are now attempting to reproduce...

On 29 March 2017 at 18:47, Blair Bethwaite <blair.bethwaite at gmail.com> wrote:
> Hi Saverio. Looks like we will have that issue within a week or two once we
> finally upgrade our rgw (lagging behind the rest of our cluster). I will try
> logging this as a priority with Red Hat support.
>
> On 29 Mar. 2017 18:39, "Saverio Proto" <zioproto at gmail.com> wrote:
>>
>> Hello all,
>>
>> we use rclone a lot, and we are happy with it.
>>
>> the real problem I would say is that a lot of these tools use the
>> latest AWS4 signature.
>>
>> AFAIK the radosgw with Ceph Jewel and Openstack keystone integration
>> supports only AWS2 signature because of this bug:
>> http://tracker.ceph.com/issues/19056
>>
>> is anyone else hitting this ?
>>
>> Saverio
>>
>> 2017-03-27 22:11 GMT+02:00 John Dickinson <me at not.mn>:
>> >
>> >
>> > On 27 Mar 2017, at 4:39, Blair Bethwaite wrote:
>> >
>> >> Hi all,
>> >>
>> >> Does anyone have any recommendations for good tools to perform
>> >> file-system/tree backups and restores to/from a (Ceph RGW-based)
>> >> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
>> >> commercial options please.
>> >>
>> >> I'm interested in:
>> >> 1) tools known to work or not work at all for a basic file-based data
>> >> backup
>> >
>> > There's a bunch of backup tools that will work with the Swift API and/or
>> > the S3 API.
>> >
>> > Veritas, Commvault, Trilio, and CloudBerry all work. There's other
>> > companies too that can back specific stuff up to Swift (e.g. Percona with
>> > MySQL).
>> >
>> > (The above list taken from https://www.swiftstack.com/solutions/backup
>> > [my employer] because it's the first linkable place I knew of to answer your
>> > question.)
>> >
>> >
>> > --John
>> >
>> >
>> >
>> >
>> >>
>> >> Plus these extras:
>> >> 2) preserves/restores correct file metadata (e.g. owner, group, acls
>> >> etc)
>> >> 3) preserves/restores xattrs
>> >> 4) backs up empty directories and files
>> >> 5) supports some sort of snapshot/versioning/differential
>> >> functionality, i.e., will keep a copy or diff or last N versions of a
>> >> file or whole backup set, e.g., so that one can restore yesterday's
>> >> file/s or last week's but not have to keep two full copies to achieve
>> >> it
>> >> 6) is readily able to restore individual files
>> >> 7) can encrypt/decrypt client side
>> >> 8) anything else I should be considering?
>> >>
>> >> --
>> >> Cheers,
>> >> ~Blairo
>> >>
>> >> _______________________________________________
>> >> OpenStack-operators mailing list
>> >> OpenStack-operators at lists.openstack.org
>> >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>> >
>> > _______________________________________________
>> > OpenStack-operators mailing list
>> > OpenStack-operators at lists.openstack.org
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>> >



-- 
Cheers,
~Blairo



More information about the OpenStack-operators mailing list