<div dir="ltr">Does "top" reveal a single process using a large amount of swap?<div><br></div><div>You can sort by "swap" in top by pressing capital O and then capital P as described <a href="http://stackoverflow.com/questions/479953/how-to-find-out-which-processes-are-swapping-in-linux">here</a>. That link also links to <a href="http://northernmost.org/blog/find-out-what-is-using-your-swap/">this page</a> which has a small bash script that might help reveal the usage.</div>
<div><br></div><div>It's possible these methods won't provide a correct or accurate answer, but they'd only take a few minutes to try :)</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Oct 16, 2013 at 7:43 AM, Samuel Winchenbach <span dir="ltr"><<a href="mailto:swinchen@gmail.com" target="_blank">swinchen@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:courier new,monospace">I don't think it is anything running on the VMs. We have three nodes. The two nodes that the experience the problem are also running the l3-agent. Perhaps that could be the culprit?</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Oct 15, 2013 at 1:15 PM, Damian <span dir="ltr"><<a href="mailto:avghacker@gmail.com" target="_blank">avghacker@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div>Is the same application run across all of the VMs? A common symptom usually stems from apps that don't behave properly and have a lot of frequent writes. If possible you should spin up a blank compute node and see if the symptoms are similar.</div>
<div><div><div><br>On Oct 15, 2013, at 11:43 AM, Samuel Winchenbach <<a href="mailto:swinchen@gmail.com" target="_blank">swinchen@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr">
<div class="gmail_default" style="font-family:'courier new',monospace">Hi all,</div><div class="gmail_default" style="font-family:'courier new',monospace"><br></div><div class="gmail_default" style="font-family:'courier new',monospace">
I have a 16 process/64GB RAM compute node running Grizzly with some odd memory usage behavior. The node is currently running 17 lightly used VMs.</div><div class="gmail_default" style="font-family:'courier new',monospace">
<br></div><div class="gmail_default"><div class="gmail_default"><font face="courier new, monospace">root@test1:~/scripts# free -m</font></div><div class="gmail_default"><font face="courier new, monospace"> total used free shared buffers cached</font></div>
<div class="gmail_default"><font face="courier new, monospace">Mem: 64429 48742 15687 0 0 28479</font></div><div class="gmail_default"><font face="courier new, monospace">-/+ buffers/cache: 20263 44166</font></div>
<div class="gmail_default"><font face="courier new, monospace">Swap: 4093 4026 67</font></div><div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default">
<font face="courier new, monospace">As you can see I have over 15GB free (44 if you remove cached memory!) yet the swap space is almost completely full.</font></div><div class="gmail_default"><font face="courier new, monospace"><br>
</font></div><div class="gmail_default"><font face="courier new, monospace">Any idea what might be going on?</font></div><div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default">
<font face="courier new, monospace">Thanks,</font></div><div class="gmail_default"><font face="courier new, monospace">Sam</font></div><div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default">
<font face="courier new, monospace"><br></font></div></div></div>
</div></blockquote></div></div><blockquote type="cite"><div><span>_______________________________________________</span><br><span>OpenStack-operators mailing list</span><br><span><a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a></span><br>
<span><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a></span><br></div></blockquote></div></blockquote>
</div><br></div>
<br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Joe Topjian<div>Systems Architect</div><div>Cybera Inc.</div><div><br></div><div><a href="http://www.cybera.ca" target="_blank">www.cybera.ca</a></div>
<div><br></div><div><font color="#666666"><span>Cybera</span><span> is a not-for-profit organization that works to spur and support innovation, for the economic benefit of Alberta, through the use of cyberinfrastructure.</span></font></div>
</div>
</div>