[Openstack] [OpenStack][Swift] Fast way of uploading 200GB of 200KB files to Swift
Leander Bessa Beernaert
leanderbb at gmail.com
Mon Jan 14 11:02:14 UTC 2013
Hello all,
I'm trying to upload 200GB of 200KB files to Swift. I'm using 4 clients
(each hosted on a different machine) with 10 threads each uploading files
using the official python-swiftclient. Each thread is uploading to a
separate container.
I have 5 storage nodes and 1 proxy node. The nodes are all running with a
replication factor of 3. Each node has a quad-core i3 processor, 4GB of RAM
and a gigabit network interface.
Is there any way I can speed up this process? At the moment it takes about
20 seconds per file or more.
Regards,
Leander
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130114/ba135067/attachment.html>
More information about the Openstack
mailing list