[Openstack] [OpenStack][Swift] Fast way of uploading 200GB of 200KB files to Swift

Leander Bessa Beernaert leanderbb at gmail.com
Mon Jan 14 14:06:02 UTC 2013


I see. With replication switched off during upload, does inserting into
various containers speed up the process or is it irrelevant?


On Mon, Jan 14, 2013 at 1:49 PM, Robert van Leeuwen <
Robert.vanLeeuwen at spilgames.com> wrote:

>  > According to the info below, i think the current size is 256 right?
> > If I format the storage partition, will that automatically clear all the
> contents from the storage or do I need to clean something else as well?
> >
> > Output from xfs_info:
> > meta-data=/dev/sda3              isize=256    agcount=4, agsize=13309312
> blks
>
> Yes, this is the wrong inode size.
>
> When you format the disk on one node it will start to sync the removed
> data back from the other nodes to this machine (as long as the
> object-replicator is running on the other nodes).
> Note that this can take a pretty long time. (our nodes with millions of
> files more then a week to sync)
>
> If you want to throw away everything and start with a empty cluster my
> guess is you would need to stop everything and also remove the account and
> container databases.
> I've never done this so I can't tell you for sure if that does not break
> anything or if it needs any manual intervention to re-create the databases.
>
> Cheers,
> Robert
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130114/d8878787/attachment.html>


More information about the Openstack mailing list