<div dir="ltr"><div><div><div>Hi Arne, <br>Thanks for your reply. Currently all these services are running on ubuntu controller under screen.<br></div>Do we have any option to set the file limit option for n-api service in this case?. I am not using systemd in my setup to run these services.<br><br></div>Thanks,<br></div>Prashant<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 19, 2016 at 10:19 PM, Arne Wiebalck <span dir="ltr"><<a href="mailto:Arne.Wiebalck@cern.ch" target="_blank">Arne.Wiebalck@cern.ch</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div>Prashant,</div>
<div><br>
</div>
<div>If this is for systemd, how about changing the nova-api unit file?</div>
<div><br>
</div>
<div>Something like</div>
<div><br>
</div>
<div>—></div>
<div>
<div>[Service]</div>
<div>...</div>
<div>LimitNOFILE=65536</div>
</div>
<div><—</div>
<div><br>
</div>
<div>should do it. </div>
<div><br>
</div>
<div>Cheers,</div>
<div> Arne</div>
<div><br>
</div>
<div><br>
</div>
<br>
<div>
<blockquote type="cite"><div><div class="h5">
<div>On 19 Dec 2016, at 17:23, Prashant Shetty <<a href="mailto:prashantshetty1985@gmail.com" target="_blank">prashantshetty1985@gmail.com</a>> wrote:</div>
<br class="m_8343404362413844012Apple-interchange-newline">
</div></div><div><div><div class="h5">
<div dir="ltr"><font size="2"><span style="font-family:verdana,sans-serif">Team,<br>
<br>
I have scale setup and metadata requests are seems to fail from instance. Main reason for failure is "Max open files" limit(1024) set on nova-api service.
<br>
Though on controller we have set max open file limit of 65k(limit.conf), nova-api always comes up with 1024 limit causing failure.<br>
<br>
Could someone let me know how can we change the max open files limit of nova-api service?<br>
<br>
Setup Details:<br>
<br>
· Single controller<br>
· 500 KVM computes<br>
· Devstack branch: stable/newton<br>
· We have native metadata and dhcp running on platform<br>
· 3750 instances<br>
<br>
<br>
stack@controller:/opt/stack/<wbr>logs$ ps aux | grep nova-api<br>
stack 14998 2.2 0.3 272104 121648 pts/8 S+ 09:53 0:14 /usr/bin/python /usr/local/bin/nova-api<br>
stack@controller:/opt/stack/<wbr>logs$<br>
stack@controller:/opt/stack/<wbr>logs$<br>
stack@controller:/opt/stack/<wbr>logs$ cat /proc/14998/limits<br>
Limit Soft Limit Hard Limit Units<br>
Max cpu time unlimited unlimited seconds<br>
Max file size unlimited unlimited bytes<br>
Max data size unlimited unlimited bytes<br>
Max stack size 8388608 unlimited bytes<br>
Max core file size unlimited unlimited bytes<br>
Max resident set unlimited unlimited bytes<br>
Max processes 128611 128611 processes<br>
Max open files 1024 4096 files<br>
Max locked memory 65536 65536 bytes<br>
Max address space unlimited unlimited bytes<br>
Max file locks unlimited unlimited locks<br>
Max pending signals 128611 128611 signals<br>
Max msgqueue size 819200 819200 bytes<br>
Max nice priority 0 0<br>
Max realtime priority 0 0<br>
Max realtime timeout unlimited unlimited us<br>
stack@controller:/opt/stack/<wbr>logs$<br>
<br>
n-api:<br>
</span></font><br>
<div style="margin:0px;padding:0px;border-width:0px;border-style:none;border-color:-moz-use-text-color;outline:0px none;font-size:13px;vertical-align:baseline;background:rgb(255,255,255) none repeat scroll 0% 0%;color:rgb(51,51,51);font-family:monospace;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px" class="m_8343404362413844012gmail-norm">
2016-11-08 18:44:26.168 30069 INFO nova.metadata.wsgi.server [req-fb4d729b-a1cd-4df1-aaf8-<wbr>3f854a739cce - -] (30069) wsgi exited, is_accepting=True<br>
Traceback (most recent call last):<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/hubs/<wbr>hub.py", line 457, in fire_timers<br>
timer()<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/hubs/<wbr>timer.py", line 58, in __call__<br>
cb(*args, **kw)<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/event.<wbr>py", line 168, in _do_send<br>
waiter.switch(result)<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/<wbr>greenthread.py", line 214, in main<br>
result = function(*args, **kwargs)<br>
File "/opt/stack/nova/nova/utils.<wbr>py", line 1066, in context_wrapper<br>
return func(*args, **kwargs)<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/wsgi.<wbr>py", line 865, in server<br>
client_socket = sock.accept()<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/<wbr>greenio/base.py", line 214, in accept<br>
res = socket_accept(fd)<br>
File "/usr/local/lib/python2.7/<wbr>dist-packages/eventlet/<wbr>greenio/base.py", line 56, in socket_accept<br>
return descriptor.accept()<br>
File "/usr/lib/python2.7/socket.py"<wbr>, line 206, in accept<br>
sock, addr = self._sock.accept()<br>
error: [Errno 24] Too many open files<br>
</div>
<span style="color:rgb(51,51,51);font-family:monospace;font-size:13px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-color:rgb(255,255,255);display:inline;float:none"><br>
</span><font size="2"><span style="font-family:verdana,sans-serif">Thanks,<br>
Prashant</span></font><br>
<br>
</div></div></div>
______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
</div>
</blockquote>
</div>
<br>
<div>--<br>
Arne Wiebalck<br>
CERN IT </div>
<br>
</div>
</blockquote></div><br></div>