[Openstack] swift and disk usage

Paras pradhan pradhanparas at gmail.com
Mon May 13 17:11:46 UTC 2013


Thanks Christian you have been a good help !

Paras.


On Sat, May 11, 2013 at 3:14 AM, Christian Schwede <info at cschwede.de> wrote:

> Hi Paras,
>
> Am 08.05.13 22:02, schrieb Paras pradhan:
> > Thanks Christian. How do we keep track of the usage? For example with 5
> > nodes i.e 40TB. How do we know how much space has been consumed out of
> > this 40TB?
>
> well, that depends on the used authentication scheme. If you are using
> swauth and don't have thousands of users, this gist might help you:
>
> https://gist.github.com/cschwede/5559268
>
> It reports the used bytes for every account and the total size. Please
> note that the returned account list is not sorted.
>
> On the other side you can simply monitor all of your disks, sum up all
> used byte values and divide by the number of replicas (3).
>
> You might also use account_quotas, which blocks further write requests
> if the quota on an account is exceeded. It is especially useful for
> smaller private storage clusters.
>
>
> http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.account_quotas
>
>
> Christian
>
>
> >
> > Paras.
> >
> >
> >
> > On Wed, May 8, 2013 at 2:44 PM, Christian Schwede <info at cschwede.de
> > <mailto:info at cschwede.de>> wrote:
> >
> >     Am 08.05.13 21:18, schrieb Paras pradhan:
> >     > I have a three nodes swift cluster. I can see the objects being
> >     > replicated to all three nodes.  Each node has 12 2TB disks. Since I
> >     > have 3 replicas the usable space is only 24TB ?
> >
> >     Yes, that's correct.
> >
> >     > How this will scale up if we add two more storage nodes of the same
> >     > capacity?
> >
> >     5 * 12 * 2 / 3: ~ 40TB usable capacity.
> >
> >     > Also, is there any tool to monitor the usage, health of the whole
> >     > cluster?
> >
> >     To detect failed drives you might have a look at
> >
> http://docs.openstack.org/developer/swift/admin_guide.html#detecting-failed-drives
> >
> >     For Swift-related monitoring please refer to
> >
> http://docs.openstack.org/trunk/openstack-object-storage/admin/content/ch_introduction-to-openstack-object-storage-monitoring.html
> >
> >     For general node monitoring you can use your preferred tool (Nagios,
> >     Icinga, Shinken, RHQ, Hyperic...).
> >
> >     _______________________________________________
> >     Mailing list: https://launchpad.net/~openstack
> >     Post to     : openstack at lists.launchpad.net
> >     <mailto:openstack at lists.launchpad.net>
> >     Unsubscribe : https://launchpad.net/~openstack
> >     More help   : https://help.launchpad.net/ListHelp
> >
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130513/90a3caeb/attachment.html>


More information about the Openstack mailing list