Open Stack

Hi,

We see a need for enhancing Swift to support a federation of swift clusters
such that a set of clusters can work as a unified namespace and allow
control over placement between the clusters.  This requires multiple
extensions to swift.

To promote community inputs and work in this area, I have uploaded today
https://github.com/davidhadas/Autosync.

The uploaded autosync.py middleware allows working with two clusters as a
single entity.
It uses the container-sync mechanism but removes the need for the admin to
configure each and every container with appropriate sync information and
keys.

This code was designed with multiple clusters in mind and assumes that
there is a placement engine deciding which container is placed where (not
included).
As an alternative, configuration directives can be used to define the
default placement (shown as an example configuration)
Yet currently is is aimed only for a first case in which there is a primary
and a backup (secondary) clusters.
Much more work is needed to support a federation of clusters, yet this code
may be useful to some even as is (with some cleanups etc).
Anyone seeking to join and help push this direction forward is most
welcomed.


DH


Regards,
David Hadas,
Openstack Swift ATC, Architect, Master Inventor
IBM Research Labs, Haifa
Tel:    Int+972-4-829-6104
Fax:   Int+972-4-829-6112