<div dir="ltr"><div><br></div><div>Hello,</div><div><br></div><div>I didn't find the issue. Somebody could help me ?</div><div><br></div><div>Thanks.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le mer. 8 juil. 2020 à 17:55, Samuel Mutel <<a href="mailto:samuel.mutel@gmail.com">samuel.mutel@gmail.com</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hello,</div><div><br></div><div>Thanks for your help. I tried to test the pushgateway manually and it seems to work fine. The pushgateway wrote some things on the stdout.</div><div>But when I start the ceilometer, nothing happens. I tried to change the IP to use 127.0.0.1 but nothing.</div><div><br></div><div>Here is my ceilometer.conf:</div><div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>[DEFAULT]<br>auth_strategy = keystone<br>debug = False<br>event_dispatchers = gnocchi<br>meter_dispatchers = gnocchi<br>transport_url = rabbit://openstack:xxxxxx@xx.xx.x.xx,openstack:xxxxxxx@xx.xx.x.xx,openstack:xxxxxxxxx@xx.xx.x.xx/<br><br>[cache]<br>backend = dogpile.cache.memcached<br>enabled = True<br>memcache_servers = xx.xx.x.xx:11211,xx.xx.x.xx:11211,xx.xx.x.xx:11211<br><br>[keystone_authtoken]<br>auth_type = password<br>auth_uri = <a href="https://xxxxxxxxxxxx:5000/v3" target="_blank">https://xxxxxxxxxxxx:5000/v3</a><br>auth_url = <a href="https://xxxxxxxxxxxx:5000" target="_blank">https://xxxxxxxxxxxx:5000</a><br>memcached_servers = xx.xx.x.xx:11211,xx.xx.x.xx:11211,xx.xx.x.xx:11211<br>password = xxxxxx<br>project_domain_id = default<br>project_name = service<br>region_name = RegionOne<br>user_domain_id = default<br>username = ceilometer<br>www_authenticate_uri = <a href="https://xxxxxxxxxxxx:5000" target="_blank">https://xxxxxxxxxxxx:5000</a><br><br>[notification]<br>pipelines = meter<br><br>[oslo_messaging_notifications]<br>driver = messagingv2<br><br>[oslo_middleware]<br>enable_proxy_headers_parsing = True<br><br>[publisher]<br>telemetry_secret = xxxxxxxxx<br><br>[service_credentials]<br>auth_type = password<br>auth_url =<a href="https://xxxxxxxxxxxx:5000" target="_blank">https://xxxxxxxxxxxx:5000</a><br>password = xxxxxxxxx<br>project_domain_id = default<br>project_name = service<br>region_name = RegionOne<br>user_domain_id = default<br>username = ceilometer</div></blockquote><div><br></div><div>Here is my event_pipeline.yaml:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>sources:<br> - name: meter_file<br> events:<br> - "*"<br> sinks:<br> - prometheus<br><br>sinks:<br> - name: prometheus<br> publishers:<br> - prometheus://<a href="http://127.0.0.1:9091/metrics/job/ceilometer" target="_blank">127.0.0.1:9091/metrics/job/ceilometer</a></div></blockquote><div><br></div><div>Here is my pipeline.yaml:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>sources:<br> - name: meter_file<br> interval: 30<br> meters:<br> - "*"<br> sinks:<br> - prometheus<br><br>sinks:<br> - name: prometheus<br> publishers:<br> - prometheus://<a href="http://127.0.0.1:9091/metrics/job/ceilometer" target="_blank">127.0.0.1:9091/metrics/job/ceilometer</a></div></blockquote><div><br></div><div>Here is my polling.yaml:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>---<br>sources:<br> - name: some_pollsters<br> interval: 300<br> meters:<br> - cpu<br> - cpu_l3_cache<br> - memory.usage<br> - network.incoming.bytes<br> - network.incoming.packets<br> - network.outgoing.bytes<br> - network.outgoing.packets<br> - disk.device.read.bytes<br> - disk.device.read.requests<br> - disk.device.write.bytes<br> - disk.device.write.requests<br> - hardware.cpu.util<br> - hardware.memory.used<br> - hardware.memory.total<br> - hardware.memory.buffer<br> - hardware.memory.cached<br> - hardware.memory.swap.avail<br> - hardware.memory.swap.total<br> - hardware.system_stats.io.outgoing.blocks<br> - hardware.system_stats.io.incoming.blocks<br> - hardware.network.ip.incoming.datagrams<br> - hardware.network.ip.outgoing.datagrams</div></blockquote><div><br></div><div>Here is my ceilometer-rootwrap:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div># Configuration for ceilometer-rootwrap<br># This file should be owned by (and only-writeable by) the root user<br><br>[DEFAULT]<br># List of directories to load filter definitions from (separated by ',').<br># These directories MUST all be only writeable by root !<br>filters_path=/etc/ceilometer/rootwrap.d,/usr/share/ceilometer/rootwrap<br><br># List of directories to search executables in, in case filters do not<br># explicitely specify a full path (separated by ',')<br># If not specified, defaults to system PATH environment variable.<br># These directories MUST all be only writeable by root !<br>exec_dirs=/sbin,/usr/sbin,/bin,/usr/bin,/usr/local/sbin,/usr/local/bin<br><br># Enable logging to syslog<br># Default value is False<br>use_syslog=False<br><br># Which syslog facility to use.<br># Valid values include auth, authpriv, syslog, user0, user1...<br># Default value is 'syslog'<br>syslog_log_facility=syslog<br><br># Which messages to log.<br># INFO means log all usage<br># ERROR means only log unsuccessful attempts<br>syslog_log_level=ERROR</div></blockquote><div><br></div><div>What configuration is wrong ? <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le ven. 3 juil. 2020 à 13:53, Matthias Runge <<a href="mailto:mrunge@matthias-runge.de" target="_blank">mrunge@matthias-runge.de</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Okay, that doesn't really help with debugging though.<br>
<br>
Method not allowed is returned eg. when the endpoint expected an http<br>
push where your browser did an http get (that's correct).<br>
<br>
What I'd do next is to configure ceilometer to send to a different http<br>
endpoint (like a webserver on your workstation, just for debugging<br>
purposes).<br>
<br>
Verify that the push gateway works as expected,<br>
<a href="https://github.com/prometheus/pushgateway" rel="noreferrer" target="_blank">https://github.com/prometheus/pushgateway</a><br>
has some curl commands mentioned for debugging purposes.<br>
<br>
<br>
Matthias<br>
<br>
On 03/07/2020 13:07, Samuel Mutel wrote:<br>
> If I go to <a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a> with the web<br>
> browser I receive: Method Not Allowed but i think it's normal.<br>
> <a href="http://10.60.4.11:9091/metrics" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics</a> is working with metrics.<br>
> <br>
> The pushgateway and the ceilometer is working on the same host for my<br>
> test so no network/firewall issue.<br>
> <br>
> Logs of the pushgateway is only these ones:<br>
> level=info ts=2020-07-03T11:04:35.907Z caller=main.go:83 msg="starting<br>
> pushgateway" version="(version=1.2.0, branch=HEAD,<br>
> revision=b7e0167e9574f4f88404dde9653ee1d3c940f2eb)"<br>
> level=info ts=2020-07-03T11:04:35.908Z caller=main.go:84<br>
> build_context="(go=go1.13.8, user=root@0e823ccfff84,<br>
> date=20200311-18:51:01)"<br>
> level=info ts=2020-07-03T11:04:35.911Z caller=main.go:137<br>
> listen_address=:9091<br>
> <br>
> Le ven. 3 juil. 2020 à 12:14, Matthias Runge <<a href="mailto:mrunge@matthias-runge.de" target="_blank">mrunge@matthias-runge.de</a><br>
> <mailto:<a href="mailto:mrunge@matthias-runge.de" target="_blank">mrunge@matthias-runge.de</a>>> a écrit :<br>
> <br>
> On 03/07/2020 11:25, Samuel Mutel wrote:<br>
> > Hello,<br>
> ><br>
> > I have two questions about ceilometer (openstack version rocky).<br>
> ><br>
> > * First of all, it seems that ceilometer is sending metrics<br>
> every hour<br>
> > and I don't understand why.<br>
> > * Next, I am not able to setup ceilometer to send metrics to<br>
> > prometheus pushgateway.<br>
> ><br>
> > Here is my configuration:<br>
> ><br>
> > sources:<br>
> > - name: meter_file<br>
> > interval: 30<br>
> > meters:<br>
> > - "*"<br>
> > sinks:<br>
> > - prometheus<br>
> ><br>
> > sinks:<br>
> > - name: prometheus<br>
> > publishers:<br>
> > -<br>
> prometheus://<a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">10.60.4.11:9091/metrics/job/ceilometer</a><br>
> <<a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a>><br>
> > <<a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a>><br>
> ><br>
> ><br>
> > Here is the error I received:<br>
> ><br>
> > vcpus{resource_id="7fab268b-ca7c-4692-a103-af4a69f817e4"} 2<br>
> > # TYPE memory gauge<br>
> > memory{resource_id="7fab268b-ca7c-4692-a103-af4a69f817e4"} 2048<br>
> > # TYPE disk.ephemeral.size gauge<br>
> > <br>
> disk.ephemeral.size{resource_id="7fab268b-ca7c-4692-a103-af4a69f817e4"}<br>
> > 0<br>
> > # TYPE disk.root.size gauge<br>
> > <br>
> disk.root.size{resource_id="7fab268b-ca7c-4692-a103-af4a69f817e4"} 0<br>
> > : HTTPError: 400 Client Error: Bad Request for url:<br>
> > <a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a><br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http<br>
> > Traceback (most recent call last):<br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http<br>
> File<br>
> > "/usr/lib/python2.7/dist-packages/ceilometer/publisher/http.py",<br>
> > line 178, in _do_post<br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http <br>
> > res.raise_for_status()<br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http<br>
> File<br>
> > "/usr/lib/python2.7/dist-packages/requests/models.py", line<br>
> 935, in<br>
> > raise_for_status<br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http <br>
> > raise HTTPError(http_error_msg, response=self)<br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http<br>
> > HTTPError: 400 Client Error: Bad Request for url:<br>
> > <a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a><br>
> > 2020-07-01 17:00:12.272 11375 ERROR ceilometer.publisher.http<br>
> ><br>
> ><br>
> > Thanks for your help on this topic.<br>
> <br>
> <br>
> Hi,<br>
> <br>
> first obvious question:<br>
> <br>
> are you sure that there is something listening under<br>
> <a href="http://10.60.4.11:9091/metrics/job/ceilometer" rel="noreferrer" target="_blank">http://10.60.4.11:9091/metrics/job/ceilometer</a> ?<br>
> <br>
> Would you have some error logs from the other side? It seems that<br>
> ceilometer is trying to dispatch as expected.<br>
> <br>
> Matthias<br>
> <br>
<br>
</blockquote></div>
</blockquote></div>