[Openstack] swift and disk usage
Paras pradhan
pradhanparas at gmail.com
Mon May 13 17:11:46 UTC 2013
Thanks Christian you have been a good help !
Paras.
On Sat, May 11, 2013 at 3:14 AM, Christian Schwede <info at cschwede.de> wrote:
> Hi Paras,
>
> Am 08.05.13 22:02, schrieb Paras pradhan:
> > Thanks Christian. How do we keep track of the usage? For example with 5
> > nodes i.e 40TB. How do we know how much space has been consumed out of
> > this 40TB?
>
> well, that depends on the used authentication scheme. If you are using
> swauth and don't have thousands of users, this gist might help you:
>
> https://gist.github.com/cschwede/5559268
>
> It reports the used bytes for every account and the total size. Please
> note that the returned account list is not sorted.
>
> On the other side you can simply monitor all of your disks, sum up all
> used byte values and divide by the number of replicas (3).
>
> You might also use account_quotas, which blocks further write requests
> if the quota on an account is exceeded. It is especially useful for
> smaller private storage clusters.
>
>
> http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.account_quotas
>
>
> Christian
>
>
> >
> > Paras.
> >
> >
> >
> > On Wed, May 8, 2013 at 2:44 PM, Christian Schwede <info at cschwede.de
> > <mailto:info at cschwede.de>> wrote:
> >
> > Am 08.05.13 21:18, schrieb Paras pradhan:
> > > I have a three nodes swift cluster. I can see the objects being
> > > replicated to all three nodes. Each node has 12 2TB disks. Since I
> > > have 3 replicas the usable space is only 24TB ?
> >
> > Yes, that's correct.
> >
> > > How this will scale up if we add two more storage nodes of the same
> > > capacity?
> >
> > 5 * 12 * 2 / 3: ~ 40TB usable capacity.
> >
> > > Also, is there any tool to monitor the usage, health of the whole
> > > cluster?
> >
> > To detect failed drives you might have a look at
> >
> http://docs.openstack.org/developer/swift/admin_guide.html#detecting-failed-drives
> >
> > For Swift-related monitoring please refer to
> >
> http://docs.openstack.org/trunk/openstack-object-storage/admin/content/ch_introduction-to-openstack-object-storage-monitoring.html
> >
> > For general node monitoring you can use your preferred tool (Nagios,
> > Icinga, Shinken, RHQ, Hyperic...).
> >
> > _______________________________________________
> > Mailing list: https://launchpad.net/~openstack
> > Post to : openstack at lists.launchpad.net
> > <mailto:openstack at lists.launchpad.net>
> > Unsubscribe : https://launchpad.net/~openstack
> > More help : https://help.launchpad.net/ListHelp
> >
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130513/90a3caeb/attachment.html>
More information about the Openstack
mailing list