[Openstack] openstack mitaka high memory issue

Satish Patel satish.txt at gmail.com
Fri Aug 19 19:30:00 UTC 2016


I moved from mikata to Liberty and now i can see stability its using
4G on controller now. Happy!..

What big stuff i am going to miss if i run my production on liberty?

On Fri, Aug 19, 2016 at 2:43 AM, Jose Manuel Ferrer Mosteiro
<jmferrer.paradigmatecnologico at gmail.com> wrote:
> Same memory problems with Ubuntu 16.04 and Mitaka packages included by
> default.
>
> Looks like each new version uses more and more memory. I began using 4GB in
> Juno but now I use 8GB in Mitaka. I need HA so I need three servers -> 24GB
> .
>
> It looks like each component spends low memory but, there are a lot of
> components!
>
> The memory usage increases with time. Heat module and horizon are my
> biggests problems.
>
> This is my top after rebooting yesterday at 17:00 :
>
> +++
>
> top - 07:57:59 up 13:43,  1 user,  load average: 1.12, 0.96, 0.91
> Tasks: 275 total,   4 running, 271 sleeping,   0 stopped,   0 zombie
> %Cpu(s): 19.7 us,  6.4 sy,  0.0 ni, 70.8 id,  0.9 wa,  0.0 hi,  1.3 si,  0.9
> st
> KiB Mem :  8175464 total,  2376492 free,  4866088 used,   932884 buff/cache
> KiB Swap:   248828 total,   248828 free,        0 used.  2890088 avail Mem
>
>   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
>  3246 mysql     20   0  699632 235384  15040 S   0.9  2.9   8:05.70 mysqld
>  3260 rabbitmq  20   0 1309020 193068   5140 S   0.0  2.4   6:46.55 beam.smp
>  7648 nova      20   0  381248 166412   8344 S   0.0  2.0   0:15.51 nova-api
>  7650 nova      20   0  380440 165652   8344 S   0.0  2.0   0:15.18 nova-api
>  7554 nova      20   0  374644 160024   8344 S   0.0  2.0   0:03.55 nova-api
>  7555 nova      20   0  374388 159824   8400 S   1.7  2.0   0:22.22 nova-api
>  6915 nova      20   0  361488 157552  15128 S   0.9  1.9   7:41.08 nova-api
>  6865 glance    20   0  613692 142644  19988 S   0.9  1.7   7:22.74
> glance-api
>  6916 neutron   20   0  341992 142012  15220 S   1.7  1.7  27:45.77
> neutron-server
>  6791 nova      20   0  298848 139456  12236 S   0.0  1.7   1:34.21
> nova-scheduler
>  6912 nova      20   0  310588 139296  12596 S   0.0  1.7   1:18.89
> nova-cert
>  6938 nova      20   0  296560 137484  12392 S   0.0  1.7   1:18.61
> nova-consoleaut
>  7533 neutron   20   0  346136 136416   5600 S   0.0  1.7   9:34.36
> neutron-server
>  7534 neutron   20   0  346260 136340   5452 S   0.9  1.7  16:26.55
> neutron-server
>  7532 neutron   20   0  343696 134192   5600 S   0.0  1.6   0:11.06
> neutron-server
>  7428 nova      20   0  287608 123452   7436 R   3.4  1.5  34:39.59
> nova-conductor
>  7427 nova      20   0  287200 123028   7436 S   2.6  1.5  34:33.64
> nova-conductor
>  7535 neutron   20   0  329496 119204   5324 S   1.7  1.5  15:45.72
> neutron-server
>  2647 heat      20   0  360108 118964  18724 S   1.7  1.5   7:52.39
> heat-engine
>  6944 nova      20   0  268900 115664  12196 S   0.9  1.4   7:16.63
> nova-conductor
>  7246 glance    20   0  602392 114728   7532 S   0.0  1.4   0:00.66
> glance-api
>  7245 glance    20   0  602392 114656   7532 S   0.0  1.4   0:00.68
> glance-api
>  7315 heat      20   0  367120 111952   8976 S   0.0  1.4   0:19.07
> heat-engine
>  7316 heat      20   0  367120 111948   8976 S   0.0  1.4   0:19.32
> heat-engine
>  7318 heat      20   0  367120 111944   8976 S   0.0  1.4   0:19.41
> heat-engine
>  7314 heat      20   0  367120 111932   8976 S   0.0  1.4   0:21.93
> heat-engine
>  7010 nova      20   0  293424 110600  14784 S   0.0  1.4   0:23.89
> nova-novncproxy
>  2639 heat      20   0  351792 110524  18732 S   0.0  1.4   0:01.91 heat-api
>  2642 heat      20   0  351276 109872  18560 S   0.0  1.3   0:02.26
> heat-api-cfn
>  6871 glance    20   0  219776 106296  11764 S   0.0  1.3   0:01.84
> glance-registry
>  7155 glance    20   0  227556 104544   6492 S   0.0  1.3   0:00.80
> glance-registry
>  7154 glance    20   0  227044 104188   6492 S   0.0  1.3   0:00.74
> glance-registry
>  7790 neutron   20   0  249672  97980  12176 R   5.2  1.2  27:52.52
> neutron-openvsw
>  6918 neutron   20   0  248556  96980  12508 S   1.7  1.2  15:48.44
> neutron-l3-agen
>  6946 neutron   20   0  248192  96276  12168 S   1.7  1.2  15:36.30
> neutron-dhcp-ag
>   429 keystone  20   0  415944  95992  10152 S   0.0  1.2   0:03.23 apache2
>   426 keystone  20   0  415944  95980  10152 S   0.0  1.2   0:03.52 apache2
>  7183 heat      20   0  351792  95880   4084 S   0.0  1.2   0:00.32 heat-api
>  7184 heat      20   0  351792  95876   4084 S   0.0  1.2   0:00.29 heat-api
>   427 keystone  20   0  415688  95768  10152 S   0.0  1.2   0:02.94 apache2
>   425 keystone  20   0  415688  95764  10152 S   0.0  1.2   0:03.00 apache2
>  6913 neutron   20   0  239924  92332  12176 S   2.6  1.1  18:50.89
> neutron-lbaas-a
>  6914 neutron   20   0  243752  91964  12164 S   1.7  1.1  15:10.37
> neutron-metadat
>  7172 neutron   20   0  244264  87276   7092 S   1.7  1.1  14:23.84
> neutron-metadat
> 20015 neutron   20   0  186940  46012   4252 S   0.0  0.6   0:01.06
> neutron-ns-meta
> 18217 neutron   20   0  186524  45832   4304 S   0.0  0.6   0:00.82
> neutron-ns-meta
> 16980 neutron   20   0  186412  45784   4380 S   0.0  0.6   0:00.51
> neutron-ns-meta
> 20083 neutron   20   0  186548  45756   4284 S   0.0  0.6   0:00.59
> neutron-ns-meta
>
> +++
>
> When controller is getting out of memory everything goes extremely slow.
> Restarting apache2 and heat solves the problem. ;-)
>
> Be lucky next week. :-)
>
>
>
>
>
> On 2016-08-18 20:53, Satish Patel wrote:
>
> How many folks using mitaka in production? I have search on google and
> i didn't find people using mitaka because its very new and people are
> not use to with it
>
> On Thu, Aug 18, 2016 at 2:45 PM, Satish Patel <satish.txt at gmail.com> wrote:
>
> we are running out of time.. this installation will go to production
> in next week.. I need to deliver something soon.
>
> I am installing liberty now. and see how it works..!
>
> On Thu, Aug 18, 2016 at 1:41 PM, Nasir Mahmood <nasir.mahmood at gmail.com>
> wrote:
>
> Did you try to locate whats causing to use all your memory. Try using htop,
> truss/strace and other debugging tools. You might also be a victim of
> resource bottlenecks, like your HDD are serving slow or it may be that your
> neutron conf is inappropriate at some point. If this ain't a production
> environment,  try troubleshooting rather than going for old installation.
>
>
> On Aug 18, 2016 21:56, "Satish Patel" <satish.txt at gmail.com> wrote:
>
> I have recently install mitaka openstack using RDO on HP DL360 G9
> server with 16GB memory. but after installation it took all of my
> memory and suck all my swap memory too. and it was extremely slow. I
> have found neutron-server and nova-conductor and other component was
> eating most memory and growing. is this normal?
>
> I didn't find related solution on google so now i have no option
> except going back to older liberty version.
>
> Any suggestion folks?
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>
>
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>




More information about the Openstack mailing list