[Openstack] [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

Alejandro Comisario alejandro.comisario at mercadolibre.com
Mon Oct 15 13:56:01 UTC 2012


Its worth to know that the objects in the cluster, are going to be from
200KB the biggest and 50KB the tiniest.
Any considerations regarding this ?

-----
alejandrito

On Thu, Oct 11, 2012 at 8:28 PM, Alejandro Comisario <
alejandro.comisario at mercadolibre.com> wrote:

> Hi Stackers !
> This is the thing, today we have a 24 datanodes (3 copies, 90TB usables)
> each datanode has 2 intel hexacores CPU with HT and 96GB of RAM, and 6
> Proxies with the same hardware configuration, using swift 1.4.8 with
> keystone.
> Regarding the networking, each proxy / datanodes has a dual 1Gb nic,
> bonded in LACP mode 4, each of the proxies are behind an F5 BigIP Load
> Balancer ( so, no worries over there ).
>
> Today, we are receiving 5000 RPM ( Requests per Minute ) with 660 RPM per
> Proxies, i know its low, but now ... with a new product migration, soon (
> really soon ) we are expecting to receive about a total of 90.000 RPM
> average ( 1500 req / s ) with weekly peaks of 200.000 RPM ( 3500 req / s )
> to the swift api, witch will be 90% public gets ( no keystone auth ) and
> 10% authorized PUTS (keystone in the middle, worth to know that we have a
> 10 keystone vms pool, connected to a 5 nodes galera mysql cluster, so no
> worries there either )
>
> So, 3500 req/s divided by 6 proxy nodes doesnt sounds too much, but well,
> its a number that we cant ignore.
> What do you think about this numbers? does this 6 proxies sounds good, or
> we should double or triple the proxies ? Does anyone has this size of
> requests and can share their configs ?
>
> Thanks a lot, hoping to ear from you guys !
>
> -----
> alejandrito
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20121015/257cbc9d/attachment.html>


More information about the Openstack mailing list