<div dir="ltr"><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Mar 21, 2014 at 5:13 PM, Joe Gordon <span dir="ltr"><<a href="mailto:joe.gordon0@gmail.com" target="_blank">joe.gordon0@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote"><div><div class="h5">On Fri, Mar 21, 2014 at 8:58 AM, Doug Hellmann <span dir="ltr"><<a href="mailto:doug.hellmann@dreamhost.com" target="_blank">doug.hellmann@dreamhost.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div style="font-size:small"><br></div><div class="gmail_extra"><br><br><div class="gmail_quote"><div><div>
On Fri, Mar 21, 2014 at 7:04 AM, Sean Dague <span dir="ltr"><<a href="mailto:sean@dague.net" target="_blank">sean@dague.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>On 03/20/2014 06:18 PM, Joe Gordon wrote:<br>
><br>
><br>
><br>
> On Thu, Mar 20, 2014 at 3:03 PM, Alexei Kornienko<br>
</div><div>> <<a href="mailto:alexei.kornienko@gmail.com" target="_blank">alexei.kornienko@gmail.com</a> <mailto:<a href="mailto:alexei.kornienko@gmail.com" target="_blank">alexei.kornienko@gmail.com</a>>> wrote:<br>
><br>
> Hello,<br>
><br>
> We've done some profiling and results are quite interesting:<br>
> during 1,5 hour ceilometer inserted 59755 events (59755 calls to<br>
> record_metering_data)<br>
> this calls resulted in total 2591573 SQL queries.<br>
><br>
> And the most interesting part is that 291569 queries were ROLLBACK<br>
> queries.<br>
> We do around 5 rollbacks to record a single event!<br>
><br>
> I guess it means that MySQL backend is currently totally unusable in<br>
> production environment.<br>
><br>
><br>
> It should be noticed that SQLAlchemy is horrible for performance, in<br>
> nova we usually see sqlalchemy overheads of well over 10x (time<br>
> nova.db.api call vs the time MySQL measures when slow log is recording<br>
> everything).<br>
<br>
</div>That's not really a fair assessment. Python object inflation takes time.<br>
I do get that there is SQLA overhead here, but even if you trimmed it<br>
out you would not get the the mysql query time.<br>
<br>
That being said, having Ceilometer's write path be highly tuned and not<br>
use SQLA (and written for every back end natively) is probably appropriate.<br></blockquote><div><br></div></div></div><div><div style="font-size:small">I have been working to get Mike Bayer (author of SQLAlchemy) to the summit in Atlanta. He is interested in working with us to improve SQLAlchemy, so if we have specific performance or feature issues like this, it would be good to make a list. If we have enough, maybe we can set aside a session in the Oslo track, otherwise we can at least have some hallway conversations.</div>
</div></div></div></div></blockquote><div><br></div><div><br></div></div></div><div>That would be really amazing. Is he on IRC, so we can get the ball rolling?</div></div></div></div></blockquote><div><br></div><div><div class="gmail_default" style="font-size:small">
I'll ask him to join #openstack-dev if he is.</div><div class="gmail_default" style="font-size:small"><br></div><div class="gmail_default" style="font-size:small">Doug</div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><span><font color="#888888">
<div style="font-size:small"><br></div><div style="font-size:small">Doug</div><br></font></span></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>
<div><div><br>
-Sean<br>
<br>
--<br>
Sean Dague<br>
Samsung Research America<br>
<a href="mailto:sean@dague.net" target="_blank">sean@dague.net</a> / <a href="mailto:sean.dague@samsung.com" target="_blank">sean.dague@samsung.com</a><br>
<a href="http://dague.net" target="_blank">http://dague.net</a><br>
<br>
</div></div><br></div><div>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></div></blockquote></div><br></div></div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div></div><br></div></div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div></div>