[Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi
Hi all, I installed devstack and ceilometer by adding the following lines in the local.conf file: enable_plugin ceilometer https://opendev.org/openstack/ceilometer.git CEILOMETER_BACKEND=gnocchi Devstack (yoga) works correctly (I am able to create images, instances, etc.). The problem is that I cannot visualize the metrics. Using "gnocchi metric list" and "gnocchi resource list" commands the result is empty. When I use the "--debug" option, no errors are plotted but the body response is empty. "ceilometer-upgrade" gives the following error: DEBUG ceilometer.cmd.storage Upgrade Gnocchi resource types upgrade /opt/stack/ceilometer/ceilometer/cmd/storage.py:42 "ceilometer-polling" prints "The resource could not be found". I have a running instance. Could you help me in retrieving the metrics from openstack?
On 2/28/22 17:58, Molka Gharbaoui wrote:
Hi all,
I installed devstack and ceilometer by adding the following lines in the local.conf file:
enable_plugin ceilometer https://opendev.org/openstack/ceilometer.git CEILOMETER_BACKEND=gnocchi
Devstack (yoga) works correctly (I am able to create images, instances, etc.). The problem is that I cannot visualize the metrics. Using "gnocchi metric list" and "gnocchi resource list" commands the result is empty.
When I use the "--debug" option, no errors are plotted but the body response is empty.
"ceilometer-upgrade" gives the following error: DEBUG ceilometer.cmd.storage Upgrade Gnocchi resource types upgrade /opt/stack/ceilometer/ceilometer/cmd/storage.py:42
"ceilometer-polling" prints "The resource could not be found".
I have a running instance.
Could you help me in retrieving the metrics from openstack?
That means, that ceilometer apparently either doesn't get any updates from the underlying services OR it doesn't send the metrics over to gnocchi. You should check the ceilometer logs for errors. Also gnocchi logs could reveal issues. Matthias
Thank you Matthias for your reply. Unfortunately, from the logs I still cannot understand what is the issue. Could someone kindly indicate me how ceilometer and gnocchi should be configured to get the data? For example in this link: https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.htm... the endpoints should use the following URL: http://controller:8041 while in my case the 8041 port is not even listening and the API indicated in the dashboard for Gnocchi is http://<http://controller:8041>x.x.x.x/metric. Thank you in advance. ________________________________ Da: Matthias Runge <mrunge@matthias-runge.de> Inviato: lunedì 28 febbraio 2022 19:37 A: openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org> Oggetto: Re: [Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi On 2/28/22 17:58, Molka Gharbaoui wrote:
Hi all,
I installed devstack and ceilometer by adding the following lines in the local.conf file:
enable_plugin ceilometer https://opendev.org/openstack/ceilometer.git CEILOMETER_BACKEND=gnocchi
Devstack (yoga) works correctly (I am able to create images, instances, etc.). The problem is that I cannot visualize the metrics. Using "gnocchi metric list" and "gnocchi resource list" commands the result is empty.
When I use the "--debug" option, no errors are plotted but the body response is empty.
"ceilometer-upgrade" gives the following error: DEBUG ceilometer.cmd.storage Upgrade Gnocchi resource types upgrade /opt/stack/ceilometer/ceilometer/cmd/storage.py:42
"ceilometer-polling" prints "The resource could not be found".
I have a running instance.
Could you help me in retrieving the metrics from openstack?
That means, that ceilometer apparently either doesn't get any updates from the underlying services OR it doesn't send the metrics over to gnocchi. You should check the ceilometer logs for errors. Also gnocchi logs could reveal issues. Matthias
This situation can be caused by a lot of different things. - "gnocchi resource-type list" will show you the resource-types configured. Make sure you have configured the resource types that Ceilometer is pushing resources to - Make sure you have enabled metrics to be collected via polling.yml file - Make sure you have configured the "gnocchi_resources.yaml" file, and that the link between metrics, resources, and attributes to be pushed are correctly created - If want to generate metrics based on events, you then need to check : meters.yaml file, to see if everything is fine there - Make sure Ceilometer is pushing metrics and resource attributes to gnocchi. When the push is executed you will see the following DEBUG log messages: - Processing sample [%s] for resource ID [%s] - %d measures posted against %d metrics through %d resources - metric %s is not handled by Gnocchi (this one will appear if the metric is not configured to be pushed in the "gnocchi_resources.yaml") On Thu, Mar 3, 2022 at 6:33 AM Molka Gharbaoui < Molka.Gharbaoui@santannapisa.it> wrote:
Thank you Matthias for your reply.
Unfortunately, from the logs I still cannot understand what is the issue.
Could someone kindly indicate me how ceilometer and gnocchi should be configured to get the data?
For example in this link: https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.htm... the endpoints should use the following URL: http://controller:8041 while in my case the 8041 port is not even listening and the API indicated in the dashboard for Gnocchi is http:// <http://controller:8041>x.x.x.x/metric.
Thank you in advance.
------------------------------ *Da:* Matthias Runge <mrunge@matthias-runge.de> *Inviato:* lunedì 28 febbraio 2022 19:37 *A:* openstack-discuss@lists.openstack.org < openstack-discuss@lists.openstack.org> *Oggetto:* Re: [Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi
On 2/28/22 17:58, Molka Gharbaoui wrote:
Hi all,
I installed devstack and ceilometer by adding the following lines in the local.conf file:
enable_plugin ceilometer https://opendev.org/openstack/ceilometer.git CEILOMETER_BACKEND=gnocchi
Devstack (yoga) works correctly (I am able to create images, instances, etc.). The problem is that I cannot visualize the metrics. Using "gnocchi metric list" and "gnocchi resource list" commands the result is empty.
When I use the "--debug" option, no errors are plotted but the body response is empty.
"ceilometer-upgrade" gives the following error: DEBUG ceilometer.cmd.storage Upgrade Gnocchi resource types upgrade /opt/stack/ceilometer/ceilometer/cmd/storage.py:42
"ceilometer-polling" prints "The resource could not be found".
I have a running instance.
Could you help me in retrieving the metrics from openstack?
That means, that ceilometer apparently either doesn't get any updates from the underlying services OR it doesn't send the metrics over to gnocchi.
You should check the ceilometer logs for errors. Also gnocchi logs could reveal issues.
Matthias
-- Rafael Weingärtner
On 3/3/22 10:29, Molka Gharbaoui wrote:
Thank you Matthias for your reply.
Unfortunately, from the logs I still cannot understand what is the issue.
Could someone kindly indicate me how ceilometer and gnocchi should be configured to get the data?
For example in this link: https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.htm... <https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.html> the endpoints should use the following URL: http://controller:8041 <http://controller:8041> while in my case the 8041 port is not even listening and the API indicated in the dashboard for Gnocchi is http:// <http://controller:8041>x.x.x.x/metric.
Thank you in advance.
OpenStack configuration is complex. The guide does not remotely touch on production environments. Please do not confuse devstack with production envionments. Also the doc you linked is not for devstack itself. The flow in general is: data is generated by the services like nova or glance. Ceilometer listens on the bus and also polls for information. The info is sent then over (as configured in publishers.yaml) to gnocchi. Gnocchi has an api, ceilometer has not. Reading your response, this makes me suspicious if there is gnocchi running. From the initial question it suggests it is, from your most recent response, it is not. Matthias
Hi Matthias, Sorry for the confusion. Gnocchi is running and I am able to execute commands like "gnocchi metric list" and "gnocchi resource list" without errors even though the response is empty. Also checking mysql, the gnocchi database is correctly created. By the link I previously shared I wanted just to highlight that there are some differences between what was written there and between the environemnt I installed. I was searching there because I would have expected that Devstack installs and configures every component in automatic with no or minimum external intervention (in fact if I don't consider the Telemetry aspect, the rest works perfectly fine). I will follow Rafael guidelines to better undrstand where is the issue. Thanks. ________________________________ Da: Matthias Runge <mrunge@matthias-runge.de> Inviato: giovedì 3 marzo 2022 11:59 A: openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org> Oggetto: Re: R: [Devstack][Gnocchi][Ceilometer] Not able to retrieve metrics using ceilometer and gnocchi On 3/3/22 10:29, Molka Gharbaoui wrote:
Thank you Matthias for your reply.
Unfortunately, from the logs I still cannot understand what is the issue.
Could someone kindly indicate me how ceilometer and gnocchi should be configured to get the data?
For example in this link: https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.htm... <https://docs.openstack.org/ceilometer/latest/install/install-base-ubuntu.html> the endpoints should use the following URL: http://controller:8041 <http://controller:8041> while in my case the 8041 port is not even listening and the API indicated in the dashboard for Gnocchi is http:// <http://controller:8041>x.x.x.x/metric.
Thank you in advance.
OpenStack configuration is complex. The guide does not remotely touch on production environments. Please do not confuse devstack with production envionments. Also the doc you linked is not for devstack itself. The flow in general is: data is generated by the services like nova or glance. Ceilometer listens on the bus and also polls for information. The info is sent then over (as configured in publishers.yaml) to gnocchi. Gnocchi has an api, ceilometer has not. Reading your response, this makes me suspicious if there is gnocchi running. From the initial question it suggests it is, from your most recent response, it is not. Matthias
participants (3)
-
Matthias Runge
-
Molka Gharbaoui
-
Rafael Weingärtner