[Openstack] (Juno) Multiple rings Swift

Amit Anand aanand at viimed.com
Tue Dec 16 20:06:49 UTC 2014


Thanks again John. Out of curiosity, is it possible to see what is where?
Lets say I have uploaded a video and wanted to see where the three copies
like out of the 4 nodes I have?

And you guys dont have a free version of Swiftstack available per chance do
you :-)




On Tue, Dec 16, 2014 at 12:48 PM, John Dickinson <me at not.mn> wrote:

> Assuming your regions are pretty close to the same size, that's exactly
> what you'll get with 3 replicas across 2 regions. Some data will have 2
> replicas in region 1 and one in region 2. Other data will have 1 in region
> 1 and 2 in region 2.
>
> --John
>
>
>
>
> > On Dec 16, 2014, at 9:39 AM, Amit Anand <aanand at viimed.com> wrote:
> >
> > Ok cool Ill wait it out see what happens. So now I have another stupid
> question - after all is said and done, how many copies of my data will I
> have?! What I am aiming for is something like 2 regions and 3 replicas ie,
> 2 copies of the data in region one and one copy in region 2.
> >
> > On Tue, Dec 16, 2014 at 12:35 PM, John Dickinson <me at not.mn> wrote:
> > That's normal. See the "...or none can be due to min_part_hours". Swift
> is refusing to move more data until the stuff likely currently in flight
> has settled. See
> https://swiftstack.com/blog/2012/04/09/swift-capacity-management/
> >
> > --John
> >
> >
> >
> >
> >
> >
> > > On Dec 16, 2014, at 9:09 AM, Amit Anand <aanand at viimed.com> wrote:
> > >
> > > Hi John thank you!
> > >
> > > So I went ahead and added two more storage nodes to the existing rings
> (object, account, container) and tried to rebalance on the controller I got
> this:
> > >
> > > [root at controller swift]# swift-ring-builder object.builder rebalance
> > > Reassigned 1024 (100.00%) partitions. Balance is now 38.80.
> > >
> -------------------------------------------------------------------------------
> > > NOTE: Balance of 38.80 indicates you should push this
> > >       ring, wait at least 1 hours, and rebalance/repush.
> > >
> -------------------------------------------------------------------------------
> > >
> > >
> > > For all three. So while waiting, I went ahead and added the *.gz files
> and swift.conf to the new nodes and started the Object Storage Services on
> the both the new storage nodes.... Now I am seeing this after I try to
> rebalance after waiting about an hour:
> > >
> > > [root at controller swift]# swift-ring-builder object.builder rebalance
> > > No partitions could be reassigned.
> > > Either none need to be or none can be due to min_part_hours [1].
> > >
> > > Devices 4,5,6,7 are the new ones I added in region 2.
> > >
> > >
> > > [root at controller swift]#  swift-ring-builder object.builder
> > > object.builder, build version 9
> > > 1024 partitions, 3.000000 replicas, 2 regions, 2 zones, 8 devices,
> 38.80 balance
> > > The minimum number of hours before a partition can be reassigned is 1
> > > Devices:    id  region  zone      ip address  port  replication ip
> replication port      name weight partitions balance meta
> > >              0       1     1       10.7.5.51  6000       10.7.5.51
>           6000      sda3 100.00        501   30.47
> > >              1       1     1       10.7.5.51  6000       10.7.5.51
>           6000      sda4 100.00        533   38.80
> > >              2       1     1       10.7.5.52  6000       10.7.5.52
>           6000      sda3 100.00        512   33.33
> > >              3       1     1       10.7.5.52  6000       10.7.5.52
>           6000      sda4 100.00        502   30.73
> > >              4       2     1       10.7.5.53  6000       10.7.5.53
>           6000      sda3 100.00        256  -33.33
> > >              5       2     1       10.7.5.53  6000       10.7.5.53
>           6000      sda4 100.00        256  -33.33
> > >              6       2     1       10.7.5.54  6000       10.7.5.54
>           6000      sda3 100.00        256  -33.33
> > >              7       2     1       10.7.5.54  6000       10.7.5.54
>           6000      sda4 100.00        256  -33.33
> > >
> > >
> > >
> > > All three have -33.33 (container, object, account)  for their balance.
> Is this normal or did do something incorrect? It doesnt seem to be
> replicating the data to the new nodes (or at least it looks like it
> stopped?)  but I am not sure. Would appreciate any insight. Thanks!
> > >
> > > Amit
> > >
> > >
> > >
> > >
> > > On Mon, Dec 15, 2014 at 1:49 PM, John Dickinson <me at not.mn> wrote:
> > > Sounds like you're looking for a global cluster. You don't need
> multiple rings for this. Swift can support this. When you add a new device
> to a ring, you add it in a different region, and Swift takes care of it for
> you.
> > >
> > > Here's some more information:
> > >
> > >
> http://docs.openstack.org/developer/swift/admin_guide.html#geographically-distributed-clusters
> > > https://www.youtube.com/watch?v=mcaTwhP_rPE
> > > https://www.youtube.com/watch?v=LpmBRqevuVU
> > >
> > > https://swiftstack.com/blog/2013/07/02/swift-1-9-0-release/
> > >
> https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/
> > > https://www.swiftstack.com/docs/admin/cluster_management/regions.html
> > >
> > >
> > >
> > > --John
> > >
> > >
> > >
> > >
> > >
> > > > On Dec 15, 2014, at 10:15 AM, Amit Anand <aanand at viimed.com> wrote:
> > > >
> > > > Hi all,
> > > >
> > > > I was wondering if anyone knew of any good blog posts and videos
> that could show/explain what I am trying to do. I have Juno setup and it
> working great (thanks to everyone on heres help)! Now, I would like to add
> two more Object Store nodes, but as a separate "datacenter" as it were and
> replicate between my existing ring and the new one. Now, Im not sure
> exactly what to do for the account/container/object rings and how to get
> them to replicate (so if one goes down the other will still continue to
> serve data). I am also going to try and add another storage node just as a
> backup for existing data. Would anyone have any good links to send me I
> would appreciate it!
> > > >
> > > > Thanks!
> > > > Amit Anand
> > > > _______________________________________________
> > > > Mailing list:
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> > > > Post to     : openstack at lists.openstack.org
> > > > Unsubscribe :
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> > >
> > >
> >
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20141216/a7531238/attachment.html>


More information about the Openstack mailing list