[Openstack] [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

Kiall Mac Innes kiall at managedit.ie
Mon Oct 15 14:59:15 UTC 2012


While I can't answer your question (I've never used swift) - it's worth
mentioning many of the openstack folks are en-route/at the design summit.

Also - you might have more luck on the openstack-operators list, rather
than the general list.

Kiall
On Oct 15, 2012 2:57 PM, "Alejandro Comisario" <
alejandro.comisario at mercadolibre.com> wrote:

> Its worth to know that the objects in the cluster, are going to be from
> 200KB the biggest and 50KB the tiniest.
> Any considerations regarding this ?
>
> -----
> alejandrito
>
> On Thu, Oct 11, 2012 at 8:28 PM, Alejandro Comisario <
> alejandro.comisario at mercadolibre.com> wrote:
>
>> Hi Stackers !
>> This is the thing, today we have a 24 datanodes (3 copies, 90TB usables)
>> each datanode has 2 intel hexacores CPU with HT and 96GB of RAM, and 6
>> Proxies with the same hardware configuration, using swift 1.4.8 with
>> keystone.
>> Regarding the networking, each proxy / datanodes has a dual 1Gb nic,
>> bonded in LACP mode 4, each of the proxies are behind an F5 BigIP Load
>> Balancer ( so, no worries over there ).
>>
>> Today, we are receiving 5000 RPM ( Requests per Minute ) with 660 RPM per
>> Proxies, i know its low, but now ... with a new product migration, soon (
>> really soon ) we are expecting to receive about a total of 90.000 RPM
>> average ( 1500 req / s ) with weekly peaks of 200.000 RPM ( 3500 req / s )
>> to the swift api, witch will be 90% public gets ( no keystone auth ) and
>> 10% authorized PUTS (keystone in the middle, worth to know that we have a
>> 10 keystone vms pool, connected to a 5 nodes galera mysql cluster, so no
>> worries there either )
>>
>> So, 3500 req/s divided by 6 proxy nodes doesnt sounds too much, but well,
>> its a number that we cant ignore.
>> What do you think about this numbers? does this 6 proxies sounds good, or
>> we should double or triple the proxies ? Does anyone has this size of
>> requests and can share their configs ?
>>
>> Thanks a lot, hoping to ear from you guys !
>>
>> -----
>> alejandrito
>>
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20121015/8d95113d/attachment.html>


More information about the Openstack mailing list