<div dir="ltr"><div>Hi Preshant,</div><div><br></div><div>You can change the open file limit of the running process by echoing the value to it. For example...</div><div><br></div><div><pre style="white-space:pre-wrap;color:rgb(80,0,80)"><code><span class="gmail-il">echo</span> -n "Max open files=8192:unlimited" > /proc/<PID>/<wbr><span class="gmail-il">limits</span></code></pre><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="margin-top:8px;margin-bottom:8px;font-family:helvetica,verdana,arial,sans-serif;font-size:0.85em;color:rgb(51,51,51);line-height:1.4"><span style="font-size:0.85em;line-height:1.4">___</span><br></p><p style="margin-top:8px;margin-bottom:8px;font-family:helvetica,verdana,arial,sans-serif;font-size:1.1em;color:rgb(51,51,51);line-height:1.4">John Petrini</p><p style="margin-top:8px;margin-bottom:8px;font-family:helvetica,verdana,arial,sans-serif;font-size:0.85em;color:rgb(51,51,51);line-height:1.6"><br></p></div></div></div></div><a href="http:///" target="_blank"></a></div></div></div></div>
<br><div class="gmail_quote">On Mon, Dec 19, 2016 at 12:21 PM, Prashant Shetty <span dir="ltr"><<a href="mailto:prashantshetty1985@gmail.com" target="_blank">prashantshetty1985@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div>Hi Arne, <br>Thanks for your reply. Currently all these services are running on ubuntu controller under screen.<br></div>Do we have any option to set the file limit option for n-api service in this case?. I am not using systemd in my setup to run these services.<br><br></div>Thanks,<br></div>Prashant<br></div><div class="gmail-HOEnZb"><div class="gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Dec 19, 2016 at 10:19 PM, Arne Wiebalck <span dir="ltr"><<a href="mailto:Arne.Wiebalck@cern.ch" target="_blank">Arne.Wiebalck@cern.ch</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word">
<div>Prashant,</div>
<div><br>
</div>
<div>If this is for systemd, how about changing the nova-api unit file?</div>
<div><br>
</div>
<div>Something like</div>
<div><br>
</div>
<div>—></div>
<div>
<div>[Service]</div>
<div>...</div>
<div>LimitNOFILE=65536</div>
</div>
<div><—</div>
<div><br>
</div>
<div>should do it. </div>
<div><br>
</div>
<div>Cheers,</div>
<div> Arne</div>
<div><br>
</div>
<div><br>
</div>
<br>
<div>
<blockquote type="cite"><div><div class="gmail-m_2676013432257320070h5">
<div>On 19 Dec 2016, at 17:23, Prashant Shetty <<a href="mailto:prashantshetty1985@gmail.com" target="_blank">prashantshetty1985@gmail.com</a>> wrote:</div>
<br class="gmail-m_2676013432257320070m_8343404362413844012Apple-interchange-newline">
</div></div><div><div><div class="gmail-m_2676013432257320070h5">
<div dir="ltr"><font size="2"><span style="font-family:verdana,sans-serif">Team,<br>
<br>
I have scale setup and metadata requests are seems to fail from instance. Main reason for failure is "Max open files" limit(1024) set on nova-api service.
<br>
Though on controller we have set max open file limit of 65k(limit.conf), nova-api always comes up with 1024 limit causing failure.<br>
<br>
Could someone let me know how can we change the max open files limit of nova-api service?<br>
<br>
Setup Details:<br>
<br>
· Single controller<br>
· 500 KVM computes<br>
· Devstack branch: stable/newton<br>
· We have native metadata and dhcp running on platform<br>
· 3750 instances<br>
<br>
<br>
stack@controller:/opt/stack/lo<wbr>gs$ ps aux | grep nova-api<br>
stack 14998 2.2 0.3 272104 121648 pts/8 S+ 09:53 0:14 /usr/bin/python /usr/local/bin/nova-api<br>
stack@controller:/opt/stack/lo<wbr>gs$<br>
stack@controller:/opt/stack/lo<wbr>gs$<br>
stack@controller:/opt/stack/lo<wbr>gs$ cat /proc/14998/limits<br>
Limit Soft Limit Hard Limit Units<br>
Max cpu time unlimited unlimited seconds<br>
Max file size unlimited unlimited bytes<br>
Max data size unlimited unlimited bytes<br>
Max stack size 8388608 unlimited bytes<br>
Max core file size unlimited unlimited bytes<br>
Max resident set unlimited unlimited bytes<br>
Max processes 128611 128611 processes<br>
Max open files 1024 4096 files<br>
Max locked memory 65536 65536 bytes<br>
Max address space unlimited unlimited bytes<br>
Max file locks unlimited unlimited locks<br>
Max pending signals 128611 128611 signals<br>
Max msgqueue size 819200 819200 bytes<br>
Max nice priority 0 0<br>
Max realtime priority 0 0<br>
Max realtime timeout unlimited unlimited us<br>
stack@controller:/opt/stack/lo<wbr>gs$<br>
<br>
n-api:<br>
</span></font><br>
<div style="margin:0px;padding:0px;border-width:0px;border-style:none;outline:none 0px;font-size:13px;vertical-align:baseline;color:rgb(51,51,51);font-family:monospace;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;background-image:none;background-color:rgb(255,255,255);background-size:initial;background-origin:initial;background-clip:initial;background-position:0% 0%;background-repeat:repeat" class="gmail-m_2676013432257320070m_8343404362413844012gmail-norm">
2016-11-08 18:44:26.168 30069 INFO nova.metadata.wsgi.server [req-fb4d729b-a1cd-4df1-aaf8-3<wbr>f854a739cce - -] (30069) wsgi exited, is_accepting=True<br>
Traceback (most recent call last):<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/hubs/hub.<wbr>py", line 457, in fire_timers<br>
timer()<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/hubs/timer.<wbr>py", line 58, in __call__<br>
cb(*args, **kw)<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/event.py", line 168, in _do_send<br>
waiter.switch(result)<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/greenthread<wbr>.py", line 214, in main<br>
result = function(*args, **kwargs)<br>
File "/opt/stack/nova/nova/utils.py<wbr>", line 1066, in context_wrapper<br>
return func(*args, **kwargs)<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/wsgi.py", line 865, in server<br>
client_socket = sock.accept()<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/greenio/<wbr>base.py", line 214, in accept<br>
res = socket_accept(fd)<br>
File "/usr/local/lib/python2.7/dist<wbr>-packages/eventlet/greenio/<wbr>base.py", line 56, in socket_accept<br>
return descriptor.accept()<br>
File "/usr/lib/python2.7/socket.py"<wbr>, line 206, in accept<br>
sock, addr = self._sock.accept()<br>
error: [Errno 24] Too many open files<br>
</div>
<span style="color:rgb(51,51,51);font-family:monospace;font-size:13px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:pre-wrap;word-spacing:0px;display:inline;float:none;background-color:rgb(255,255,255)"><br>
</span><font size="2"><span style="font-family:verdana,sans-serif">Thanks,<br>
Prashant</span></font><br>
<br>
</div></div></div>
______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
</div>
</blockquote>
</div>
<br>
<div>--<br>
Arne Wiebalck<br>
CERN IT </div>
<br>
</div>
</blockquote></div><br></div>
</div></div><br>______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
<br></blockquote></div><br></div></div></div>