How to create a dynamic pollster subsystem to create a pollster for senlin cluster
Hello Team We are a public cloud provider based on Openstack. We are working to create Autoscaling with aodh and senlin in Kolla-ansible Openstack Wallaby release. We are facing an issue as ceilometer does not support metrics for senlin cluster as a resource. Our aim is to use https://docs.openstack.org/ceilometer/wallaby/admin/telemetry-dynamic-pollst... to generate a pollster to collect data for senlin. We were looking if anybody in the community has ever used this feature. OpenStack Docs: Introduction to dynamic pollster subsystemhttps://docs.openstack.org/ceilometer/wallaby/admin/telemetry-dynamic-pollster.html Current limitations of the dynamic pollster system¶. Currently, the following types of APIs are not supported by the dynamic pollster system: Tenant APIs: Tenant APIs are the ones that need to be polled in a tenant fashion. docs.openstack.org
Thanks & Regards, [https://acefone.com/email-signature/logo-new.png] [https://acefone.com/email-signature/facebook.png]https://www.facebook.com/real.time.data.services/ [https://acefone.com/email-signature/linkedin.png]https://www.linkedin.com/company/real-time-data-services/mycompany/ [https://acefone.com/email-signature/twitter.png]https://twitter.com/rtdsindia [https://acefone.com/email-signature/youtube.png]https://www.youtube.com/channel/UCq93lA3ch6Pt5GzOAhRwgpw [https://acefone.com/email-signature/glassdoor.png]https://www.glassdoor.co.in/Reviews/Real-Time-Data-Services-Reviews-E527061.htm Uday Dikshit Cloud DevOps Engineer, Product Development uday.dikshit@myrealdata.in www.myrealdata.inhttp://www.myrealdata.in/ 809-A Udyog Vihar, Phase 5, Gurugram - 122015, Haryana
On 1/25/23 10:04, Uday Dikshit wrote:
Hello Team We are a public cloud provider based on Openstack. We are working to create Autoscaling with aodh and senlin in Kolla-ansible Openstack Wallaby release. We are facing an issue as ceilometer does not support metrics for senlin cluster as a resource. Our aim is to use https://docs.openstack.org/ceilometer/wallaby/admin/telemetry-dynamic-pollst... https://docs.openstack.org/ceilometer/wallaby/admin/telemetry-dynamic-pollster.html to generate a pollster to collect data for senlin. We were looking if anybody in the community has ever used this feature.
Hi,
Not only we use that feature in production, but I also used the dynamic pollster stuff on the compute pollster using the command-line thingy. The result is this project:
https://salsa.debian.org/openstack-team/services/ceilometer-instance-poller/
You can also read bits of docs of OCI about it: https://salsa.debian.org/openstack-team/debian/openstack-cluster-installer#c...
I hope this helps. If you need more help, please do reply ...
Cheers,
Thomas Goirand (zigo)
Hey Thomas This was really helpful. I had another doubt, how can I add a complex calculation such as taking mean of CPU utilization of all nodes that are present in a senlin cluster with senlin cluster ID as its primary key.
Thanks & Regards, [https://acefone.com/email-signature/logo-new.png] [https://acefone.com/email-signature/facebook.png]https://www.facebook.com/real.time.data.services/ [https://acefone.com/email-signature/linkedin.png]https://www.linkedin.com/company/real-time-data-services/mycompany/ [https://acefone.com/email-signature/twitter.png]https://twitter.com/rtdsindia [https://acefone.com/email-signature/youtube.png]https://www.youtube.com/channel/UCq93lA3ch6Pt5GzOAhRwgpw [https://acefone.com/email-signature/glassdoor.png]https://www.glassdoor.co.in/Reviews/Real-Time-Data-Services-Reviews-E527061.htm Uday Dikshit Cloud DevOps Engineer, Product Development uday.dikshit@myrealdata.in www.myrealdata.inhttp://www.myrealdata.in/ 809-A Udyog Vihar, Phase 5, Gurugram - 122015, Haryana ________________________________ From: Thomas Goirand zigo@debian.org Sent: Friday, January 27, 2023 8:54 PM To: Uday Dikshit uday.dikshit@myrealdata.in; openstack-discuss@lists.openstack.org openstack-discuss@lists.openstack.org Subject: Re: How to create a dynamic pollster subsystem to create a pollster for senlin cluster
On 1/25/23 10:04, Uday Dikshit wrote:
Hello Team We are a public cloud provider based on Openstack. We are working to create Autoscaling with aodh and senlin in Kolla-ansible Openstack Wallaby release. We are facing an issue as ceilometer does not support metrics for senlin cluster as a resource. Our aim is to use https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceil... https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceilometer_wallaby_admin_telemetry-2Ddynamic-2Dpollster.html&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=58AkTXQK-t27foam0JxQj_p2S7oML-5RlT2bY2LISOk&m=KrUyOp7R8Eq0a_TOSOboQA2IOuHFlEtSswxM7uAB0f4&s=-LMnIXpO63G3i6FF9aX_zIGELd_4Z32B8jN24N8Yy2Y&e= to generate a pollster to collect data for senlin. We were looking if anybody in the community has ever used this feature.
Hi,
Not only we use that feature in production, but I also used the dynamic pollster stuff on the compute pollster using the command-line thingy. The result is this project:
https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openst...
You can also read bits of docs of OCI about it: https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openst...
I hope this helps. If you need more help, please do reply ...
Cheers,
Thomas Goirand (zigo)
----------
This email has been scanned for spam and viruses by Proofpoint Essentials. Visit the following link to report this email as spam: https://us1.proofpointessentials.com/index01.php?mod_id=11&mod_option=lo...
Do you want this to be done in Ceilometer? I mean, complex calculations are normally executed in the metric backend, such as Gnocchi. You could collect data for all clusters, and persist in the backend. Then, you do the calculation mean/min/max/rate:xxx, and so on in Gnocchi for instance.
The calculation can be done in the dynamic pollsters as well though. They accept python expressions, where you can do basically anything you want. Also, it is possible to use nested dynamic pollsters to collect and combine data from different sources together.
On Tue, Jan 31, 2023 at 1:19 PM Uday Dikshit uday.dikshit@myrealdata.in wrote:
Hey Thomas This was really helpful. I had another doubt, how can I add a complex calculation such as taking mean of CPU utilization of all nodes that are present in a senlin cluster with senlin cluster ID as its primary key.
*Thanks & Regards,* https://www.facebook.com/real.time.data.services/ https://www.linkedin.com/company/real-time-data-services/mycompany/ https://twitter.com/rtdsindia https://www.youtube.com/channel/UCq93lA3ch6Pt5GzOAhRwgpw
https://www.glassdoor.co.in/Reviews/Real-Time-Data-Services-Reviews-E527061.htm
Uday Dikshit Cloud DevOps Engineer, Product Development uday.dikshit@myrealdata.in www.myrealdata.in 809-A Udyog Vihar, Phase 5, Gurugram - 122015, Haryana
*From:* Thomas Goirand zigo@debian.org *Sent:* Friday, January 27, 2023 8:54 PM *To:* Uday Dikshit uday.dikshit@myrealdata.in; openstack-discuss@lists.openstack.org < openstack-discuss@lists.openstack.org> *Subject:* Re: How to create a dynamic pollster subsystem to create a pollster for senlin cluster
On 1/25/23 10:04, Uday Dikshit wrote:
Hello Team We are a public cloud provider based on Openstack. We are working to create Autoscaling with aodh and senlin in Kolla-ansible Openstack Wallaby release. We are facing an issue as ceilometer does not support metrics for senlin cluster as a resource. Our aim is to use
https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceil... < https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_ceil... to generate a pollster to collect data for senlin. We were looking if anybody in the community has ever used this feature.
Hi,
Not only we use that feature in production, but I also used the dynamic pollster stuff on the compute pollster using the command-line thingy. The result is this project:
https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openst...
You can also read bits of docs of OCI about it:
https://urldefense.proofpoint.com/v2/url?u=https-3A__salsa.debian.org_openst...
I hope this helps. If you need more help, please do reply ...
Cheers,
Thomas Goirand (zigo)
This email has been scanned for spam and viruses by Proofpoint Essentials. Visit the following link to report this email as spam:
https://us1.proofpointessentials.com/index01.php?mod_id=11&mod_option=lo...
participants (3)
-
Rafael Weingärtner
-
Thomas Goirand
-
Uday Dikshit