<div dir="ltr">Adam,<div><br></div><div>I understend it, but I see that Swift always make object-replication for all date on cluseter.</div><div>It make big load to hard drives on server.</div><div>Is it normal?</div></div>
<div class="gmail_extra"><br clear="all"><div>--<br>Best regards,<br>Roman Kravets</div>
<br><br><div class="gmail_quote">On Fri, Mar 28, 2014 at 5:29 AM, Adam Lawson <span dir="ltr"><<a href="mailto:alawson@aqorn.com" target="_blank">alawson@aqorn.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Swift is said to be eventually consistent because the data is stored then eventually distributed in a balanced way. You don't need to manually re-balance the rings constantly. Swift will do that for you. Re-balancing rings is usually initiated after you <i>change the ring structure</i> (add/remove regions, add/remove zones, change device weights, etc).<div>
<br></div><div>In your case since you only have one node, Swift will distribute the replicas across all 3 zones assuming you've configured 3x replication. When you add a node and update the rings, yes you'll want to re-balance. That will tell Swift to put a replica on the new node since Swift default behavior is to keep replica placements "as unique as possible". That's the actual Swift vernacular everyone uses. ; )</div>
<div><br></div><div>Unique replica placement strategy is as follows:</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
Region (if defined) > Zone > Node > Device > Device with fewest replicas</blockquote><div><br></div><div>Good luck.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>Adam</div></font></span></div>
<div class="gmail_extra"><div class=""><br clear="all"><div><div dir="ltr">
<div><font><div style="font-family:arial;font-size:small"><b><i><br>Adam Lawson</i></b></div><div><font><font color="#666666" size="1"><div style="font-family:arial;font-size:small">AQORN, Inc.</div><div style="font-family:arial;font-size:small">
427 North Tatnall Street</div><div style="font-family:arial;font-size:small">Ste. 58461</div><div style="font-family:arial;font-size:small">Wilmington, Delaware 19801-2230</div><div style="font-family:arial;font-size:small">
Toll-free: (888) 406-7620</div></font></font></div></font></div><div style="font-family:arial;font-size:small"><img src="http://www.aqorn.com/images/logo.png" width="96" height="39"><br></div></div></div>
<br><br></div><div><div class="h5"><div class="gmail_quote">On Thu, Mar 27, 2014 at 12:48 PM, Roman Kravets <span dir="ltr"><<a href="mailto:softded@gmail.com" target="_blank">softded@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Dear Adam,<div><br></div><div>I have one storage server and 12 hard drives on it.</div><div>For test I split disk to 4 zones. If I rightly understood, swift load date during "re-balance ring" and load data <span style="background-color:rgb(252,252,252);font-family:Arial,sans-serif;font-size:14px;line-height:18px;white-space:pre-wrap">right away to correct node.</span></div>
</div><div class="gmail_extra"><div><br clear="all"><div>--<br>Best regards,<br>Roman Kravets</div>
<br><br></div><div><div><div class="gmail_quote">On Thu, Mar 27, 2014 at 10:05 PM, Adam Lawson <span dir="ltr"><<a href="mailto:alawson@aqorn.com" target="_blank">alawson@aqorn.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Probably has to do with the fact you (I'm guessing) don't have very many drives on that server. Is that a correct statement? I know that even with 50 drives across a cluster (still very small), rings balance is at 100% until the rings are adequately balanced. Look at your ring stats, drive count and 5 zones for more consistent reports.</div>
<span><font color="#888888">
</font></span><div class="gmail_extra"><span><font color="#888888"><br clear="all"><div><div dir="ltr"><div><font><div style="font-family:arial;font-size:small"><b><i><br>Adam Lawson</i></b></div><div><font><font color="#666666" size="1"><div style="font-family:arial;font-size:small">
AQORN, Inc.</div><div style="font-family:arial;font-size:small">427 North Tatnall Street</div><div style="font-family:arial;font-size:small">Ste. 58461</div><div style="font-family:arial;font-size:small">Wilmington, Delaware 19801-2230</div>
<div style="font-family:arial;font-size:small">Toll-free: <a href="tel:%28888%29%20406-7620" value="+18884067620" target="_blank">(888) 406-7620</a></div></font></font></div></font></div><div style="font-family:arial;font-size:small">
<img src="http://www.aqorn.com/images/logo.png" width="96" height="39"><br>
</div></div></div></font></span><div><div>
<br><br><div class="gmail_quote">On Thu, Mar 27, 2014 at 10:20 AM, Кравец Роман <span dir="ltr"><<a href="mailto:softded@gmail.com" target="_blank">softded@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello.<br>
<br>
I installed Openstack Swift to test server and upload 50 gb data.<br>
Now I see it in the log:<br>
root@storage1:/var/staff/softded# tail -n 1000 -f /var/log/syslog |<br>
grep replicated<br>
Mar 27 19:44:24 storage1 object-replicator 112746/187053 (60.27%)<br>
partitions replicated in 300.01s (375.81/sec, 3m remaining)<br>
Mar 27 19:47:44 storage1 object-replicator 187053/187053 (100.00%)<br>
partitions replicated in 499.71s (374.32/sec, 0s remaining)<br>
Mar 27 19:53:14 storage1 object-replicator 112863/187068 (60.33%)<br>
partitions replicated in 300.01s (376.20/sec, 3m remaining)<br>
Mar 27 19:56:29 storage1 object-replicator 187068/187068 (100.00%)<br>
partitions replicated in 494.53s (378.27/sec, 0s remaining)<br>
Mar 27 20:01:59 storage1 object-replicator <a href="tel:112343%2F187080" value="+12343187080" target="_blank">112343/187080</a> (60.05%)<br>
partitions replicated in 300.01s (374.47/sec, 3m remaining)<br>
Mar 27 20:05:18 storage1 object-replicator 187080/187080 (100.00%)<br>
partitions replicated in 498.55s (375.25/sec, 0s remaining)<br>
Mar 27 20:10:48 storage1 object-replicator 112417/187092 (60.09%)<br>
partitions replicated in 300.01s (374.71/sec, 3m remaining)<br>
<br>
Why object-replicator show different percent every time?<br>
<br>
Thank you!<br>
<br>
--<br>
Best regards,<br>
Roman Kravets<br>
<br>
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>