[OpenStack-Infra] Zuul memory leak

James E. Blair corvus at inaugust.com
Fri Jan 8 20:20:34 UTC 2016


Hi,

Some time before December 17th we merged a change to Zuul that causes a
memory leak.  Prior to then, the amount of used memory on OpenStack's
Zuul server consumed a very steady 5GB.  Now it continually increases.
We can see the behavior start very clearly with our December 17 restart
of Zuul.  But it had been running for quite some time (perhaps a month
or more?) before then, so that is not much use in narrowing down the
change, and several changes were merged in that time period that could
have an effect.

See this graph:

  http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=392&rra_id=4&view_type=&graph_start=1449499887&graph_end=1452197778&graph_height=120&graph_width=500&title_font_size=10

If anyone else running a Zuul from git master has observed increased
memory usage, would you please let us know any dates where you restarted
Zuul (with the latest commit) and either did or did not observe
increased memory usage?  That may help us quickly narrow down what we
need to look at.

Thanks,

Jim



More information about the OpenStack-Infra mailing list