[Openstack] questions about storing balance

Robert van Leeuwen Robert.vanLeeuwen at spilgames.com
Mon Aug 26 14:27:03 UTC 2013


First you need to make sure you create enough containers.
Especially if you the container servers on spinning disks you should keep it below 1 million objects.

However, I would highly recommend running the containers on SSD's.

Another thing you will have to take in account is the number of files per node/disk.
Expect the cluster to slow down when you have more and more files on the node.
Depending on the number of puts you expect to get the 5 nodes with 10 disks will be on the low side 
to handle 300 million files (assuming a replication factor of 3).

Just on the numbers I would suggest to run with more & smaller disks.
Best way to know for sure is running swift-bench or cosbench and fill the cluster with data to see how it performs.


From: pangj [pangj at laposte.net]
Sent: Monday, August 26, 2013 3:59 PM
To: openstack
Subject: [Openstack] questions about storing balance


We will have a swift cluster, it's two proxy nodes and five storage
nodes, there are 10*2T disks in each storage node.

We don't need the complicated auth way, but to use the tempauth.
I add a system account into tempauth, for example, AUTH_system.
And I create an username with a password under the account, for example,
testuser and testpasswd.
Then I tell the clients to store all objects under this account and
We have a lot of objects to be stored, it's far more than 100 millions IMO.

My question is, will all the objects be stored in the cluster balanced?
Since I have only one account:username in the system for storage access.


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to     : openstack at lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

More information about the Openstack mailing list