[OpenStack-Infra] stackalytics-dump file

Ilya Shakhat ishakhat at mirantis.com
Fri Nov 6 15:59:15 UTC 2015


I confirm that 8Gb is not enough. Currently the production is 16Gb - 3.5
for memcached, 3.5 for every uwsgi process and up to 2 may be consumed by
the processor.

--Ilya

2015-11-06 17:27 GMT+03:00 Paul Belanger <pabelanger at redhat.com>:

> On Mon, Nov 02, 2015 at 08:25:19AM -0500, Paul Belanger wrote:
> > On Thu, Oct 29, 2015 at 07:14:00AM +0300, Ilya Shakhat wrote:
> > > Hi Paul,
> > >
> > > Using existing dump makes the cold start much more pleasant. Full data
> > > reload usually needed only when some incompatible changes are
> introduced. I
> > > mark such commits with the warning note and bump release number. To
> help
> > > you with the initial setup I can grab the dump from production and
> share it
> > > with you. The raw size is about 2G, hope it compressible.
> > >
> > Great. I'm sure if you jump into #openstack-infra we can find a
> > location to upload it too.
> >
> > > This week I'm at the summit. If you are not, we can schedule a chat
> next
> > > week, e.g. on Thu would be ok.
> > >
> > Yup, that works for me too. Again, I'll be idling in #openstack-infra
> when you
> > have free time.
> >
> > > Thanks,
> > > Ilya
> > >
> > > 2015-10-28 18:20 GMT+03:00 Paul Belanger <pabelanger at redhat.com>:
> > >
> > > > Greetings Ilya,
> > > >
> > > > I was hoping you could help save me some time doing the initial
> import of
> > > > stackalytics.o.o by using a stackalytics-dump from your instance? If
> I
> > > > understand correctly, this is how you currently do backups /
> persistent
> > > > data
> > > > from memcached?
> > > >
> > > > Additionally, maybe we could setup some time next week to chat about
> how to
> > > > currently do maintenance on stackalytics.org, so I can include that
> > > > functionality
> > > > into puppet-stackalytics[1]. Things like how often you dump memcached
> > > > data, if
> > > > any existing scripts exists, current backup / restore procedures.
> > > >
> > > > PB
> > > >
> > > > [1] https://github.com/openstack-infra/puppet-stackalytics
> > > >
> >
> Just a follow up to this thread, we've successfully merged 2 patches that
> now
> allow -infra to launch stackalytics.o.o[1][2].  At the moment, we are
> holding
> off on doing so because we'd like to confirm with you the current system
> requirements for stackalytics.com.  In my testing I found 8GB not to be
> enough
> RAM for importing the stats and running uwsgi.  We are considering
> launching a
> node with 15GB of RAM however would like to hear back from you first.
>
> Also, do you mind connecting with on of the infra-roots to discuss an
> upload
> location for your current memcached dump?
>
> ---
> [1] https://review.openstack.org/#/c/190765/
> [2] https://review.openstack.org/#/c/190708/
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-infra/attachments/20151106/6505f4a5/attachment.html>


More information about the OpenStack-Infra mailing list