<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>
<div>Cern is running ceilometer at scale with many thousands of compute nodes. I think their blog goes into some detail about it [1], but I don’t have a direct link to it. </div>
<div><br>
</div>
<div>
<div id="">
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri"><br>
</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">[1] - </font></font>http://openstack-in-production.blogspot.com/</div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">___________________________________________________________________</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">Kris Lindgren</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri"><span class="Apple-style-span" style="font-size: 14px;">Senior Linux Systems Engineer</span></font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri"><span class="Apple-style-span" style="font-size: 14px;">GoDaddy</span></font></font></div>
</div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:12pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Bill Jones <<a href="mailto:bill.jones@sungardas.com">bill.jones@sungardas.com</a>><br>
<span style="font-weight:bold">Date: </span>Tuesday, June 14, 2016 at 9:03 AM<br>
<span style="font-weight:bold">To: </span>"openstack-oper." <<a href="mailto:openstack-operators@lists.openstack.org">openstack-operators@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>[Openstack-operators] Scaling Ceilometer compute agent?<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div style="font-size:13px">Has anyone had any experience with scaling ceilometer compute agents?<br>
</div>
<div style="font-size:13px"><br>
</div>
<span style="font-size:13px">We're starting to see messages like this in logs for some of our compute agents:</span>
<div style="font-size:13px"><br>
</div>
<blockquote style="font-size:13px;margin:0px 0px 0px 40px;border:none;padding:0px">
<div>WARNING ceilometer.openstack.common.loopingcall [-] task <function interval_task at 0x2092cf8> run outlasted interval by 293.25 sec</div>
<div><br>
</div>
</blockquote>
<span style="font-size:13px">This is an indication that the compute agent failed to execute its pipeline processing within the allotted interval (in our case 10 min). The result of this is that less instance samples are generated per hour than expected, and
this causes billing issues for us due to the way we calculate usage. </span>
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px">It looks like we have three options for addressing this: make the pipeline run faster, increase the interval time, or scale the compute agents. I'm investigating the latter.</div>
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px">I think I read in the ceilometer architecture docs that the agents are designed to scale, but I don't see anything in the docs on how to facilitate that. Any pointers would be appreciated.</div>
<div style="font-size:13px"><br>
</div>
<div style="font-size:13px">Thanks,</div>
<div style="font-size:13px">Bill</div>
<div class="" style="margin:2px 0px 0px;font-size:13px"></div>
</div>
</div>
</div>
</span>
</body>
</html>