Do you want this to be done in Ceilometer? I mean, complex calculations are normally executed in the metric backend, such as Gnocchi. You could collect data for all clusters, and persist in the backend. Then, you do the calculation mean/min/max/rate:xxx, and so on in Gnocchi for instance.

The calculation can be done in the dynamic pollsters as well though. They accept python expressions, where you can do basically anything you want. Also, it is possible to use nested dynamic pollsters to collect and combine data from different sources together.

On Tue, Jan 31, 2023 at 1:19 PM Uday Dikshit <uday.dikshit@myrealdata.in> wrote:
Hey Thomas
This was really helpful. I had another doubt, how can I add a complex calculation such as taking mean of CPU utilization of all nodes that are present in a senlin cluster with senlin cluster ID as its primary key.

Thanks & Regards,
Uday Dikshit
Cloud DevOps Engineer, Product Development
809-A Udyog Vihar,
Phase 5, Gurugram - 122015, Haryana
From: Thomas Goirand <zigo@debian.org>
Sent: Friday, January 27, 2023 8:54 PM
To: Uday Dikshit <uday.dikshit@myrealdata.in>; openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org>
Subject: Re: How to create a dynamic pollster subsystem to create a pollster for senlin cluster
 
On 1/25/23 10:04, Uday Dikshit wrote:
> Hello Team
> We are a public cloud provider based on Openstack.
> We are working to create Autoscaling with aodh and senlin in
> Kolla-ansible Openstack Wallaby release. We are facing an issue as
> ceilometer does not support metrics for senlin cluster as a resource.
> Our aim is to use
> https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceilometer_wallaby_admin_telemetry-2Ddynamic-2Dpollster.html&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=58AkTXQK-t27foam0JxQj_p2S7oML-5RlT2bY2LISOk&m=KrUyOp7R8Eq0a_TOSOboQA2IOuHFlEtSswxM7uAB0f4&s=-LMnIXpO63G3i6FF9aX_zIGELd_4Z32B8jN24N8Yy2Y&e= <https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceilometer_wallaby_admin_telemetry-2Ddynamic-2Dpollster.html&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=58AkTXQK-t27foam0JxQj_p2S7oML-5RlT2bY2LISOk&m=KrUyOp7R8Eq0a_TOSOboQA2IOuHFlEtSswxM7uAB0f4&s=-LMnIXpO63G3i6FF9aX_zIGELd_4Z32B8jN24N8Yy2Y&e=> to generate a pollster to collect data for senlin. We were looking if anybody in the community has ever used this feature.

Hi,

Not only we use that feature in production, but I also used the dynamic
pollster stuff on the compute pollster using the command-line thingy.
The result is this project:

https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openstack-2Dteam_services_ceilometer-2Dinstance-2Dpoller_&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=58AkTXQK-t27foam0JxQj_p2S7oML-5RlT2bY2LISOk&m=KrUyOp7R8Eq0a_TOSOboQA2IOuHFlEtSswxM7uAB0f4&s=PZG_y8gQzPmKPmaCX1OWHNA5Zg9tFJ0O4zdZZkrUnIY&e=

You can also read bits of docs of OCI about it:
https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openstack-2Dteam_debian_openstack-2Dcluster-2Dinstaller-23configuring-2Da-2Dcustom-2Dmetric-2Dand-2Dbilling&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=58AkTXQK-t27foam0JxQj_p2S7oML-5RlT2bY2LISOk&m=KrUyOp7R8Eq0a_TOSOboQA2IOuHFlEtSswxM7uAB0f4&s=HB4uQxN4HzA-iHQ1Cvlt-UVhF6oH5jzY0xmJ8Afu5i8&e=

I hope this helps. If you need more help, please do reply ...

Cheers,

Thomas Goirand (zigo)



----------

This email has been scanned for spam and viruses by Proofpoint Essentials. Visit the following link to report this email as spam:
https://us1.proofpointessentials.com/index01.php?mod_id=11&mod_option=logitem&mail_id=1674833071-prElz2OKrtG9&r_address=uday.dikshit%40myrealdata.in&report=1


--
Rafael Weingärtner