<div dir="ltr">Hi Clint, <div><br></div><div>No it's not necessary to separate a cluster into several zones in general. </div><div>The region and zone information will be invoked by ring-builder to assign partitions as-unique-as possible. <br>
</div><div>If you do have several nodes be placed in a remote datacenter with higher network latency, then these nodes should be in a different region. </div><div>If you do have several nodes in different room but in same building with low network latency, you can indicate these nodes are in different zone. </div>
<div><br></div><div>So basically, for all nodes in same rack, room, DC. You can simply to use a single zone without any problem. </div><div><br></div><div>I observed the replica been set to 1 only. Is this a production environment ? In current Swift implementation, the replica number is not able to change dynamically(Storage policy will make it more flexible). You may want to have at least 3 replicas in production cluster. </div>
<div><br></div><div>For part power, that's fine with higher value. The impact is on the performance and memory consumption. If your cluster will expand to more nodes with over 500TB capacity in the future, you definitely don't want part power 8. It's not hurt with current value. Don't to worry about it for a testing cluster.</div>
<div><br></div><div><br></div><div>Cheers // Hugo </div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-20 4:48 GMT+08:00 Clint Dilks <span dir="ltr"><<a href="mailto:clintd@waikato.ac.nz" target="_blank">clintd@waikato.ac.nz</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Thanks Hugo,<br><br></div>That did help I have a combined proxy and storage node up and running with following rings now to scale things out to more storage nodes. From the documentation its not clear to me but I believe as I add storage nodes I should create them each in a separate zone ?<br>
<br></div>Based on a Swift Partition Power calculator I found I believe I should recreate things using a part power of 8 <a href="http://rackerlabs.github.io/swift-ppc/" target="_blank">http://rackerlabs.github.io/swift-ppc/</a><br>
<div><div class="">
<br>[root@comet swift]# swift-ring-builder account.builder <br>account.builder, build version 1<br>262144 partitions, 1.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance<br>The minimum number of hours before a partition can be reassigned is 1<br>
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta<br></div> 0 1 1 130.217.78.2 6002 130.217.78.2 6002 sda4 100.00 262144 0.00 <br>
<div class="">
<br>[root@comet swift]# swift-ring-builder container.builder <br>container.builder, build version 1<br></div><div class="">262144 partitions, 1.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance<br>The minimum number of hours before a partition can be reassigned is 1<br>
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta<br></div> 0 1 1 130.217.78.2 6001 130.217.78.2 6001 sda4 100.00 262144 0.00 <br>
<div class="">
<br>[root@comet swift]# swift-ring-builder object.builder <br>object.builder, build version 1<br></div><div class="">262144 partitions, 1.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance<br>The minimum number of hours before a partition can be reassigned is 1<br>
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta<br></div> 0 1 1 130.217.78.2 6000 130.217.78.2 6000 sda4 100.00 262144 0.00 <br>
<br><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, May 19, 2014 at 4:36 PM, Kuo Hugo <span dir="ltr"><<a href="mailto:tonytkdk@gmail.com" target="_blank">tonytkdk@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Client, <div><br></div><div>Two problems : <br><div><br></div><div>1. Those rings are incorrect. Your rings indicate all workers are listening on same port 6002. That's why the PUT request of container was handled by account-server in your log. </div>
<div>2. You need at least 3 devices for 3 replicas testing. </div><div><br></div><div><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px">
<font color="#999999">[root@comet swift]# swift-ring-builder account.builder
account.builder, build version 1
262144 partitions, 3.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta
0 1 1 130.217.78.2 </font><font color="#ff0000">6002</font><font color="#999999"> 130.217.78.2 6005 sda4 100.00 786432 0.00
[root@comet swift]# swift-ring-builder container.builder
container.builder, build version 1
262144 partitions, 3.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta
0 1 1 130.217.78.2 </font><font color="#ff0000">6002</font><font color="#999999"> 130.217.78.2 6005 sda4 100.00 786432 0.00
[root@comet swift]# swift-ring-builder object.builder
object.builder, build version 1
262144 partitions, 3.000000 replicas, 1 regions, 1 zones, 1 devices, 0.00 balance
The minimum number of hours before a partition can be reassigned is 1
Devices: id region zone ip address port replication ip replication port name weight partitions balance meta
0 1 1 130.217.78.2 </font><font color="#ff0000">6002</font><font color="#999999"> 130.217.78.2 6005 sda4 100.00 786432 0.00</font></pre><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px;color:rgb(0,0,0)">
<br></pre><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px;color:rgb(0,0,0)">Hope it help</pre><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px;color:rgb(0,0,0)">
Hugo Kuo</pre><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px;color:rgb(0,0,0)"><br></pre><pre style="margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:'Bitstream Vera Sans Mono',monospace;font-size:13px;color:rgb(0,0,0)">
<br></pre></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-19 0:31 GMT-04:00 Clint Dilks <span dir="ltr"><<a href="mailto:clintd@waikato.ac.nz" target="_blank">clintd@waikato.ac.nz</a>></span>:<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi Hugo,<br><br>Thanks for responding.<br><br><a href="http://paste.openstack.org/show/80857/" target="_blank">http://paste.openstack.org/show/80857/</a><br>
<br></div><div>Please let me know if the swift-ring-builder information is not what you need in relation to rings.<br>
<br></div><div>My Long term goal is 3 storage nodes with one proxy but as I am currently having issue I simplified this to 1 proxy and 1 storage node running on the same host.<br><br></div><div><br><br></div></div><div>
<div><div class="gmail_extra">
<br><br><div class="gmail_quote">On Mon, May 19, 2014 at 4:11 PM, Kuo Hugo <span dir="ltr"><<a href="mailto:tonytkdk@gmail.com" target="_blank">tonytkdk@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Clint, <div><br></div><div>Would you please paster the proxy-server.conf and rings on <a href="http://paste.openstack.org/" target="_blank">http://paste.openstack.org/</a> ?</div><div>Also please show me the output of $>sudo ls -al /srv/node/sda4 </div>
<div><br></div><div>Thanks // Hugo</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-05-18 23:45 GMT-04:00 Clint Dilks <span dir="ltr"><<a href="mailto:clintd@waikato.ac.nz" target="_blank">clintd@waikato.ac.nz</a>></span>:<div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Nope, <br><br></div>This install is pointing to the RDO repositories as per earlier in the installation guide, but does not use packstack.<br>
<br></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Mon, May 19, 2014 at 3:38 PM, Remo Mattei <span dir="ltr"><<a href="mailto:remo@italy1.com" target="_blank">remo@italy1.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="auto"><div>Hi did u use packstack ? <br><br>Inviato da <span style="background-color:rgba(255,255,255,0)">iPhone ()</span></div><div><br>Il giorno May 18, 2014, alle ore 20:22, Clint Dilks <<a href="mailto:clintd@waikato.ac.nz" target="_blank">clintd@waikato.ac.nz</a>> ha scritto:<br>
<br></div><blockquote type="cite"><div><div><div><div dir="ltr"><div><div><div><div>Hi I am installing icehouse on CentOS 6.5 for the first time and looking for some help with swift.<br><br></div>I have followed the guide here <a href="http://docs.openstack.org/icehouse/install-guide/install/yum/content/verify-object-storage-installation.html" target="_blank">http://docs.openstack.org/icehouse/install-guide/install/yum/content/verify-object-storage-installation.html</a><br>
<br></div>Currently swift stat appears to be working but uploading files fails. <br><br>[root@comet swifttest]# swift stat<br> Account: AUTH_d39dfee7f2ce4a86b8721365805eb858<br> Containers: 0<br> Objects: 0<br>
Bytes: 0<br> Accept-Ranges: bytes<br> X-Timestamp: 1400466597.29362<br> X-Trans-Id: txa6295ab356d94e7baede8-0053797190<br> Content-Type: text/plain; charset=utf-8<br><br>[root@comet swifttest]# swift upload myfiles test.txt <br>
Error trying to create container 'myfiles': 404 Not Found: <html><h1>Not Found</h1><p>The resource could not be found.<<br>Object HEAD failed: <a href="http://comet.cms.waikato.ac.nz:8080:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/myfiles/test.txt" target="_blank">http://comet.cms.waikato.ac.nz:8080:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/myfiles/test.txt</a> 400 Bad Request<br>
<br></div>Looking in the Logs I see the following, which doesn't give me a clue as to the issue.<br></div><br>Any thoughts as to what the problem might be or how to diagnose the problem further would be appreciated.<br>
<div><br></div><div>Thanks<br></div><div><br><div>May 19 15:10:15 comet container-replicator: Beginning replication run<br>May 19 15:10:15 comet container-replicator: Replication run OVER<br>May 19 15:10:15 comet container-replicator: Attempted to replicate 0 dbs in 0.00175 seconds (0.00000/s)<br>
May 19 15:10:15 comet container-replicator: Removed 0 dbs<br>May 19 15:10:15 comet container-replicator: 0 successes, 0 failures<br>May 19 15:10:15 comet container-replicator: no_change:0 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0<br>
May 19 15:10:16 comet object-replicator: Starting object replication pass.<br>May 19 15:10:16 comet object-replicator: Nothing replicated for 0.00157809257507 seconds.<br>May 19 15:10:16 comet object-replicator: Object replication complete. (0.00 minutes)<br>
May 19 15:10:16 comet object-auditor: Begin object audit "forever" mode (ZBF)<br>May 19 15:10:16 comet object-auditor: Begin object audit "forever" mode (ALL)<br>May 19 15:10:16 comet object-auditor: Object audit (ZBF) "forever" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 0.00, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00<br>
May 19 15:10:16 comet object-auditor: Object audit (ALL) "forever" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 0.00, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00<br>
May 19 15:10:36 comet account-replicator: Beginning replication run<br>
May 19 15:10:36 comet account-replicator: Replication run OVER<br>May 19 15:10:36 comet account-replicator: Attempted to replicate 0 dbs in 0.00179 seconds (0.00000/s)<br>May 19 15:10:36 comet account-replicator: Removed 0 dbs<br>
May 19 15:10:36 comet account-replicator: 0 successes, 0 failures<br>May 19 15:10:36 comet account-replicator: no_change:0 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0<br>May 19 15:10:40 comet account-server: 130.217.78.2 - - [19/May/2014:03:10:40 +0000] "HEAD /sda4/57207/AUTH_d39dfee7f2ce4a86b8721365805eb858" 204 - "tx6aa17b19d2974be088b8a-0053797630" "HEAD <a href="http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858" target="_blank">http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858</a>" "proxy-server 113431" 0.0029 ""<br>
May 19 15:10:40 comet account-server: 130.217.78.2 - - [19/May/2014:03:10:40 +0000] "PUT /sda4/71034/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint" 404 - "tx6aa17b19d2974be088b8a-0053797630" "PUT <a href="http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint" target="_blank">http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint</a>" "proxy-server 113431" 0.0004 ""<br>
May 19 15:10:41 comet account-server: 130.217.78.2 - - [19/May/2014:03:10:41 +0000] "HEAD /sda4/71034/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint" 400 69 "tx453bedf548144a8b8518c-0053797631" "HEAD <a href="http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint" target="_blank">http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint</a>" "proxy-server 113431" 0.0014 ""<br>
May 19 15:10:41 comet account-server: 130.217.78.2 - - [19/May/2014:03:10:41 +0000] "HEAD /sda4/22389/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint/blob.txt" 400 78 "tx453bedf548144a8b8518c-0053797631" "HEAD <a href="http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint/blob.txt" target="_blank">http://comet.cms.waikato.ac.nz:8080/v1/AUTH_d39dfee7f2ce4a86b8721365805eb858/clint/blob.txt</a>" "proxy-server 113431" 0.0003 ""<br>
<br><br><br></div></div></div></div></div>
!DSPAM:1,53797b95200128318916264!
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
<span>Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a></span><br><span>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
<span></span><br><span></span><br><span>!DSPAM:1,53797b95200128318916264!</span><br></div></blockquote></div></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div></div></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div></div></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>