Open Stack

On Fri, Nov 06, 2015 at 06:59:15PM +0300, Ilya Shakhat wrote:
> I confirm that 8Gb is not enough. Currently the production is 16Gb - 3.5
> for memcached, 3.5 for every uwsgi process and up to 2 may be consumed by
> the processor.
> 
Out of curiosity, are you using nginx or apache?  I've currently setup Apache,
but might test nginx tomorrow. If you are using nginx how much RAM is consumed
by each process.

> --Ilya
> 
> 2015-11-06 17:27 GMT+03:00 Paul Belanger <pabelanger at redhat.com>:
> 
> > On Mon, Nov 02, 2015 at 08:25:19AM -0500, Paul Belanger wrote:
> > > On Thu, Oct 29, 2015 at 07:14:00AM +0300, Ilya Shakhat wrote:
> > > > Hi Paul,
> > > >
> > > > Using existing dump makes the cold start much more pleasant. Full data
> > > > reload usually needed only when some incompatible changes are
> > introduced. I
> > > > mark such commits with the warning note and bump release number. To
> > help
> > > > you with the initial setup I can grab the dump from production and
> > share it
> > > > with you. The raw size is about 2G, hope it compressible.
> > > >
> > > Great. I'm sure if you jump into #openstack-infra we can find a
> > > location to upload it too.
> > >
> > > > This week I'm at the summit. If you are not, we can schedule a chat
> > next
> > > > week, e.g. on Thu would be ok.
> > > >
> > > Yup, that works for me too. Again, I'll be idling in #openstack-infra
> > when you
> > > have free time.
> > >
> > > > Thanks,
> > > > Ilya
> > > >
> > > > 2015-10-28 18:20 GMT+03:00 Paul Belanger <pabelanger at redhat.com>:
> > > >
> > > > > Greetings Ilya,
> > > > >
> > > > > I was hoping you could help save me some time doing the initial
> > import of
> > > > > stackalytics.o.o by using a stackalytics-dump from your instance? If
> > I
> > > > > understand correctly, this is how you currently do backups /
> > persistent
> > > > > data
> > > > > from memcached?
> > > > >
> > > > > Additionally, maybe we could setup some time next week to chat about
> > how to
> > > > > currently do maintenance on stackalytics.org, so I can include that
> > > > > functionality
> > > > > into puppet-stackalytics[1]. Things like how often you dump memcached
> > > > > data, if
> > > > > any existing scripts exists, current backup / restore procedures.
> > > > >
> > > > > PB
> > > > >
> > > > > [1] https://github.com/openstack-infra/puppet-stackalytics
> > > > >
> > >
> > Just a follow up to this thread, we've successfully merged 2 patches that
> > now
> > allow -infra to launch stackalytics.o.o[1][2].  At the moment, we are
> > holding
> > off on doing so because we'd like to confirm with you the current system
> > requirements for stackalytics.com.  In my testing I found 8GB not to be
> > enough
> > RAM for importing the stats and running uwsgi.  We are considering
> > launching a
> > node with 15GB of RAM however would like to hear back from you first.
> >
> > Also, do you mind connecting with on of the infra-roots to discuss an
> > upload
> > location for your current memcached dump?
> >
> > ---
> > [1] https://review.openstack.org/#/c/190765/
> > [2] https://review.openstack.org/#/c/190708/
> >