<div dir="ltr">Using RamDisk to simulate spindles</div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><div>+Hugo Kuo+</div><div><a href="mailto:hugo@swiftstack.com" target="_blank">hugo@swiftstack.com</a><br>
</div><div><a href="mailto:tonytkdk@gmail.com" target="_blank">tonytkdk@gmail.com<br></a></div><div>+886 935004793<br></div></div></div>
<br><br><div class="gmail_quote">2013/9/3 Jonathan Lu <span dir="ltr"><<a href="mailto:jojokururu@gmail.com" target="_blank">jojokururu@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi, pangj<br>
While putting small objects, the bottleneck will not be the network bandwidth, and the server's cpu/mem will be low. It will be a matter of inode and cache. You can check the iowait of your storage node server and it may be a "filesystem" problem. As a estimate of the performance of your swift, take a look at this:<br>
<a href="http://www.zmanda.com/blogs/?p=894" target="_blank">http://www.zmanda.com/blogs/?<u></u>p=894</a><br>
<br>
Robert van Leeuwen once post a report of their experience in the mail list and I think it's such a good sharing.<br>
<a href="http://engineering.spilgames.com/openstack-swift-lots-small-files/" target="_blank">http://engineering.spilgames.<u></u>com/openstack-swift-lots-<u></u>small-files/</a><br>
<br>
Hope it helpful.<span class="HOEnZb"><font color="#888888"><br>
<br>
Jonathan Lu</font></span><div class="HOEnZb"><div class="h5"><br>
<br>
On 2013/9/3 13:53, pangj wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
For each test file the size is 4KB.<br>
Network connection is 1Gb.<br>
But the bandwidth never got full, it's about only 70 - 80 Mb at peak.<br>
And all servers' cpu/mem usage are low.<br>
Thanks.<br>
<br>
On 2013-9-3 13:32, Jonathan Lu wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
What is the average size of the objects? And your network<br>
condition? Maybe the bottleneck of performance is not Swift, but the<br>
network or other things.<br>
<br>
Best Regards<br>
Jonathan Lu<br>
<br>
On 2013/9/2 19:51, pangj wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
<br>
We have benched the swift, the cluster is with one proxy server, one<br>
combined account/container server, five object servers. All are<br>
separated physical servers.<br>
<br>
We benched from 12 clients (each with 200 threads), got the results as<br>
below:<br>
<br>
| node | PUT | GET | DELETE |<br>
|--------+-------+-------+----<u></u>----|<br>
| sb2 A | 35.6 | 57.1 | 44 |<br>
| sb2 B | 35.6 | 56.1 | 43.4 |<br>
| sb3 A | 35.4 | 58.1 | 43.4 |<br>
| sb3 B | 35.6 | 56.1 | 43.4 |<br>
| ad61 A | 35.5 | 57.2 | 43.8 |<br>
| ad61 B | 35.5 | 55.2 | 43.5 |<br>
| sb64 A | 35.4 | 53.4 | 43.7 |<br>
| sb64 B | 35.5 | 54.9 | 43.5 |<br>
| sb65 A | 35.7 | 53.3 | 43.6 |<br>
| sb65 B | 35.6 | 52.5 | 44.1 |<br>
| sb27 A | 35.4 | 49.4 | 44.1 |<br>
| sb27 B | 35.4 | 51.1 | 43.9 |<br>
|--------+-------+-------+----<u></u>----|<br>
| total | 426.2 | 654.4 | 524.4 |<br>
<br>
<br>
The total IOPS for PUT is 426, means 426 PUT requests per second.<br>
But our application design requires 3000 PUT requests per second.<br>
So how to improve swift's performance to match the requirement?<br>
<br>
Thanks.<br>
<br>
______________________________<u></u>_________________<br>
Mailing list:<br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe :<br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack</a><br>
</blockquote>
<br>
<br>
</blockquote>
<br>
</blockquote>
<br>
<br>
______________________________<u></u>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack</a><br>
</div></div></blockquote></div><br></div>