[Openstack] [OpenStack][Swift] Fast way of uploading 200GB of 200KB files to Swift

Leander Bessa Beernaert leanderbb at gmail.com
Mon Jan 14 11:06:09 UTC 2013


I forgot to mention that I'm also using the suggestions mentioned here:
http://docs.openstack.org/developer/swift/deployment_guide.html#general-system-tuning


On Mon, Jan 14, 2013 at 11:02 AM, Leander Bessa Beernaert <
leanderbb at gmail.com> wrote:

> Hello all,
>
>
> I'm trying to upload 200GB of 200KB files to Swift. I'm using 4 clients
> (each hosted on a different machine) with 10 threads each uploading files
> using the official python-swiftclient. Each thread is uploading to a
> separate container.
>
> I have 5 storage nodes and 1 proxy node. The nodes are all running with a
> replication factor of 3. Each node has a quad-core i3 processor, 4GB of RAM
> and a gigabit network interface.
>
> Is there any way I can speed up this process? At the moment it takes about
> 20 seconds per file or more.
>
> Regards,
>
> Leander
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130114/00a5ef44/attachment.html>


More information about the Openstack mailing list