[Openstack] Openstack data replication
ambadiaravind at gmail.com
Tue Feb 20 16:32:01 UTC 2018
Any reference or information with regards to how sync process in global
clusters is more efficient than container sync in openstack swift.
Aravind M D
On Mon, Feb 19, 2018 at 11:41 AM, aRaviNd <ambadiaravind at gmail.com> wrote:
> Thanks John.
> You mentioned sync process in global clusters is more efficient. Could you
> please let me know how sync process is more efficient in global clusters
> than container sync?
> On Wed, Feb 14, 2018 at 9:10 PM, John Dickinson <me at not.mn> wrote:
>> A global cluster is one logical cluster that durably stores data across
>> all the available failure domains (the highest level of failure domain is
>> "region"). For example, if you have 2 regions (ie DCs)and you're using 4
>> replicas, you'll end up with 2 replicas in each.
>> Container sync is for taking a subset of data stored in one Swift cluster
>> and synchronizing it with a different Swift cluster. Each Swift cluster is
>> autonomous and handles it's own durability. So, eg if each Swift cluster
>> uses 3 replicas, you'll end up with 6x total storage for the data that is
>> In most cases, people use global clusters and are happy with it. It's
>> definitely been more used than container sync, and the sync process in
>> global clusters is more efficient.
>> However, deploying a multi-region Swift cluster comes with an extra set
>> of challenges above and beyond a single-site deployment. You've got to
>> consider more things with your inter-region networking, your network
>> routing, the access patterns in each region, your requirements around
>> locality, and the data placement of your data.
>> All of these challenges are solvable, of course. Start with
>> https://swift.openstack.org and also feel free to ask here on the
>> mailing list or on freenode IRC in #openstack-swift.
>> Good luck!
>> On 14 Feb 2018, at 6:55, aRaviNd wrote:
>> Hi All,
>> Whats the difference between container sync and global cluster? Which
>> should we use for large data set of 100 Tb ?
>> On Feb 13, 2018 7:52 PM, "aRaviNd" <ambadiaravind at gmail.com> wrote:
>> Hi All,
>> We are working on implementing Openstack swift replication and would like
>> to know whats the better approach, container sync or global cluster, on
>> what scenario we should choose one above the another.
>> Swift cluster will be used as a backend for web application deployed on
>> multiple regions which is configured as active passive using DNS.
>> Data usage can grow upto 100TB starting with 1TB. What will be better
>> option to sync data between regions?
>> Thank You
>> Aravind M D
>> Mailing list: http://lists.openstack.org/cgi
>> Post to : openstack at lists.openstack.org
>> Unsubscribe : http://lists.openstack.org/cgi
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Openstack