<div dir="ltr">Hi Remo,<div><br></div><div>I have heard that there has been some work to integrate Hadoop with Swift, but know very little about it. Integration with MS exchange, but could be an interesting use case.</div>
<div><br></div><div>Partitions can be thought of as virtual buckets that objects are assigned to. They are an abstract concept and don't have any inherent size. Buckets then are assigned to storage devices. The partition power just determines how many partitions are distributed across the storage devices.</div>
<div><br></div><div>One of my coworkers wrote the following tool to help calculate the partition power: <a href="http://rackerlabs.github.io/swift-ppc/">http://rackerlabs.github.io/swift-ppc/</a><br></div><div><br></div><div>
--</div><div>Chuck</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, May 30, 2014 at 1:03 AM, Remo Mattei <span dir="ltr"><<a href="mailto:remo@italy1.com" target="_blank">remo@italy1.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div>Thanks Chuck</div><div>This is great I want to use an object store which allows me to work well with Hadoop and if possible with MS exchange IIS etc. If you do have tips on this that will be great. I also would love your point of partition power in how you describe it. I have my own ideas on it so I m curious to see how to get an idea on object calculation on a partition. One of the question I have always been asked was if the partition is sizex but the object is sizez which is bigger how is that handle? </div>
<div><br></div><div>Thanks for you sharing I m sure everyone will take a good lesson. </div><div><br></div><div>Ciao </div><div class=""><div><br>Inviato da <span style="background-color:rgba(255,255,255,0)">iPhone ()</span></div>
</div><div><br>Il giorno May 29, 2014, alle ore 22:39, Chuck Thier <<a href="mailto:cthier@gmail.com" target="_blank">cthier@gmail.com</a>> ha scritto:<br><br></div><blockquote type="cite"><div><div><div class="h5">
<div dir="ltr">Hello Remo,<div><br></div><div>That is quite an open ended question :) If you could share a bit more about your use case, then it would be easier to provide more detailed information, but I'll try to cover some of the basics.</div>
<div><br></div><div>First, a disclaimer. I am one of the original Openstack Swift developers, so I *may* be a bit biased.</div><div><br></div><div>Both Swift and Ceph are capable object storage systems. Swift focuses purely on object storage, while Ceph provides object, block and filesystem storage. This leads to, what I believe is, the biggest fundamental difference between Swift and Ceph. Since Ceph also provides block and filesystem storage, it chooses consistency and partition tolerance over availability. Swift was designed to be eventually consistent (similar to S3) favoring availability and partition tolerance over consistency. If you are not familiar with the CAP theorem, then I suggest starting with the Wikipedia article about it [1] (oh and btw, all the images that you see on Wikipedia are stored in a Swift cluster ;))</div>
<div><br></div><div>I can't speak directly to the performance characteristics of Ceph, but I gave a talk [2] at the Hong Kong summit where I go into quite a bit of detail about how well swift has performed at Rackspace over the past 5 years, and how far we have been able to scale it. Openstack Swift is also in use by a substantial number of other companies and institutions all over the world.</div>
<div><br></div><div>All of that said, you can't trust anything you read on the internet, or even me. If you are interested in running either Swift or Ceph, then I would recommend evaluating your use case with both systems.</div>
<div><br></div><div>--</div><div>Chuck</div><div><br></div><div>[1] <a href="http://en.wikipedia.org/wiki/CAP_theorem" target="_blank">http://en.wikipedia.org/wiki/CAP_theorem</a></div><div>[2] <a href="https://www.youtube.com/watch?v=YxnFUQHIwNs" target="_blank">https://www.youtube.com/watch?v=YxnFUQHIwNs</a></div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, May 29, 2014 at 9:34 PM, Remo Mattei <span dir="ltr"><<a href="mailto:remo@italy1.com" target="_blank">remo@italy1.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi all does anyone have done any testing or comparison between swift and ceph I want to get some others people prospectives.<br>
<br>
Thanks.<br>
<br>
Inviato da iPhone ()<br>
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
</blockquote></div><br></div></div></div>
!DSPAM:1,53881b75141238639619343!
</div></blockquote></div></blockquote></div><br></div>