<div dir="ltr">Hi John thank you!<div><br></div><div>So I went ahead and added two more storage nodes to the existing rings (object, account, container) and tried to rebalance on the controller I got this:</div><div><br></div><div><div>[root@controller swift]# swift-ring-builder object.builder rebalance</div><div>Reassigned 1024 (100.00%) partitions. Balance is now 38.80.</div><div>-------------------------------------------------------------------------------</div><div>NOTE: Balance of 38.80 indicates you should push this</div><div> ring, wait at least 1 hours, and rebalance/repush.</div><div>-------------------------------------------------------------------------------</div></div><div><br></div><div><br></div><div>For all three. So while waiting, I went ahead and added the *.gz files and swift.conf to the new nodes and started the Object Storage Services on the both the new storage nodes.... Now I am seeing this after I try to rebalance after waiting about an hour:</div><div><br></div><div><div>[root@controller swift]# swift-ring-builder object.builder rebalance</div><div>No partitions could be reassigned.</div><div>Either none need to be or none can be due to min_part_hours [1].</div></div><div><br></div><div>Devices 4,5,6,7 are the new ones I added in region 2. </div><div><br></div><div><br></div><div><div>[root@controller swift]# swift-ring-builder object.builder</div><div>object.builder, build version 9</div><div>1024 partitions, 3.000000 replicas, 2 regions, 2 zones, 8 devices, 38.80 balance</div><div>The minimum number of hours before a partition can be reassigned is 1</div><div>Devices: id region zone ip address port replication ip replication port name weight partitions balance meta</div><div> 0 1 1 10.7.5.51 6000 10.7.5.51 6000 sda3 100.00 501 30.47</div><div> 1 1 1 10.7.5.51 6000 10.7.5.51 6000 sda4 100.00 533 38.80</div><div> 2 1 1 10.7.5.52 6000 10.7.5.52 6000 sda3 100.00 512 33.33</div><div> 3 1 1 10.7.5.52 6000 10.7.5.52 6000 sda4 100.00 502 30.73</div><div> 4 2 1 10.7.5.53 6000 10.7.5.53 6000 sda3 100.00 256 -33.33</div><div> 5 2 1 10.7.5.53 6000 10.7.5.53 6000 sda4 100.00 256 -33.33</div><div> 6 2 1 10.7.5.54 6000 10.7.5.54 6000 sda3 100.00 256 -33.33</div><div> 7 2 1 10.7.5.54 6000 10.7.5.54 6000 sda4 100.00 256 -33.33</div></div><div><br></div><div><br></div><div><br></div><div>All three have -33.33 (container, object, account) for their balance. Is this normal or did do something incorrect? It doesnt seem to be replicating the data to the new nodes (or at least it looks like it stopped?) but I am not sure. Would appreciate any insight. Thanks!</div><div><br></div><div>Amit</div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 15, 2014 at 1:49 PM, John Dickinson <span dir="ltr"><<a href="mailto:me@not.mn" target="_blank">me@not.mn</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Sounds like you're looking for a global cluster. You don't need multiple rings for this. Swift can support this. When you add a new device to a ring, you add it in a different region, and Swift takes care of it for you.<br>
<br>
Here's some more information:<br>
<br>
<a href="http://docs.openstack.org/developer/swift/admin_guide.html#geographically-distributed-clusters" target="_blank">http://docs.openstack.org/developer/swift/admin_guide.html#geographically-distributed-clusters</a><br>
<a href="https://www.youtube.com/watch?v=mcaTwhP_rPE" target="_blank">https://www.youtube.com/watch?v=mcaTwhP_rPE</a><br>
<a href="https://www.youtube.com/watch?v=LpmBRqevuVU" target="_blank">https://www.youtube.com/watch?v=LpmBRqevuVU</a><br>
<br>
<a href="https://swiftstack.com/blog/2013/07/02/swift-1-9-0-release/" target="_blank">https://swiftstack.com/blog/2013/07/02/swift-1-9-0-release/</a><br>
<a href="https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/" target="_blank">https://swiftstack.com/blog/2012/09/16/globally-distributed-openstack-swift-cluster/</a><br>
<a href="https://www.swiftstack.com/docs/admin/cluster_management/regions.html" target="_blank">https://www.swiftstack.com/docs/admin/cluster_management/regions.html</a><br>
<br>
<br>
<br>
--John<br>
<div><div class="h5"><br>
<br>
<br>
<br>
<br>
> On Dec 15, 2014, at 10:15 AM, Amit Anand <<a href="mailto:aanand@viimed.com">aanand@viimed.com</a>> wrote:<br>
><br>
> Hi all,<br>
><br>
> I was wondering if anyone knew of any good blog posts and videos that could show/explain what I am trying to do. I have Juno setup and it working great (thanks to everyone on heres help)! Now, I would like to add two more Object Store nodes, but as a separate "datacenter" as it were and replicate between my existing ring and the new one. Now, Im not sure exactly what to do for the account/container/object rings and how to get them to replicate (so if one goes down the other will still continue to serve data). I am also going to try and add another storage node just as a backup for existing data. Would anyone have any good links to send me I would appreciate it!<br>
><br>
> Thanks!<br>
> Amit Anand<br>
</div></div>> _______________________________________________<br>
> Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
> Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
> Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br>
</blockquote></div><br></div>