Open Stack

We are jubilant to announce the release of:

ceilometer 6.0.0: OpenStack Telemetry

This release is part of the mitaka release series.

For more details, please see below.

6.0.0
^^^^^


New Features
************

* Add support for batch processing of messages from queue. This will
  allow the collector and notification agent to grab multiple messages
  per thread to enable more efficient processing.

* To minimise load on Nova API, an additional configuration option
  was added to control discovery interval vs metric polling interval.
  If resource_update_interval option is configured in compute section,
  the compute agent will discover new instances based on defined
  interval. The agent will continue to poll the discovered instances
  at the interval defined by pipeline.

* [bug 1480333 (https://bugs.launchpad.net/ceilometer/+bug/1480333)]
  Support ability to configure collector to capture events or meters
  mutally exclusively, rather than capturing both always.

* Support for CORS is added. More information can be found [here
  (http://specs.openstack.org/openstack/openstack-specs/specs/cors-
  support.html)]

* Support resource caching in Gnocchi dispatcher to improve write
  performance to avoid additional queries.

* Gnocchi dispatcher now uses client rather than direct http
  requests

* [bug 1518338 (https://bugs.launchpad.net/ceilometer/+bug/1518338)]
  Add support for storing SNMP metrics in Gnocchi.This functionality
  requires Gnocchi v2.1.0 to be installed.

* Add support for Keystone v3 authentication

* Ceilometer alarms code is now fully removed from code base.
  Equivalent functionality is handled by Aodh.

* Support for CADF-only payload in HTTP dispatcher is dropped as
  audit middleware in pyCADF was dropped in Kilo cycle.

* Remove eventlet from Ceilometer in favour of threaded approach

* RPC collector support is dropped. The queue-based notifier
  publisher and collector was added as the recommended alternative as
  of Icehouse cycle.

* Support for polling Neutron's LBaaS v2 API was added as v1 API in
  Neutron is deprecated. The same metrics are available between v1 and
  v2.

* [bug 1513731 (https://bugs.launchpad.net/ceilometer/+bug/1513731)]
  Add support for hardware cpu_util in snmp.yaml

* [bug 1506959 (https://bugs.launchpad.net/ceilometer/+bug/1506959)]
  Add support to query unique set of meter names rather than meters
  associated with each resource. The list is available by adding
  unique=True option to request.


Known Issues
************

* Neutron API is not designed to be polled against. When polling
  against Neutron is enabled, Ceilometer's polling agents may generage
  a significant load against the Neutron API. It is recommended that a
  dedicated API be enabled for polling while Neutron's API is improved
  to handle polling.


Upgrade Notes
*************

* The options >>`<<requeue_event_on_dispatcher_error' and
  >>`<<requeue_sample_on_dispatcher_error' have been enabled and
  removed.

  <SYSTEM MESSAGE: <string>:47: (WARNING/2) Inline interpreted text or
  phrase reference start-string without end-string.>

  <SYSTEM MESSAGE: <string>:47: (WARNING/2) Inline interpreted text or
  phrase reference start-string without end-string.>

* batch_size and batch_timeout configuration options are added to
  both [notification] and [collector] sections of configuration. The
  batch_size controls the number of messages to grab before
  processing. Similarly, the batch_timeout defines the wait time
  before processing.

* The api-paste.ini file can be modified to include or exclude the
  CORs middleware. Additional configurations can be made to middleware
  as well.

* gnocchiclient library is now a requirement if using
  ceilometer+gnocchi.

* gnocchi_resources.yaml in Ceilometer should be updated.

* To utilize the new policy support. The policy.json file should be
  updated accordingly. The pre-existing policy.json file will continue
  to function as it does if policy changes are not required.

* Run db-sync to add new indices.

* audit middleware in keystonemiddleware library should be used for
  similar support.

* Pipeline.yaml files for agents should be updated to notifier:// or
  udp:// publishers. The rpc:// publisher is no longer supported.

* By default, Ceilometer will poll the v2 API. To poll legacy v1
  API, add neutron_lbaas_version=v1 option to configuration file.


Critical Issues
***************

* The previous configuration options default for
  >>`<<requeue_sample_on_dispatcher_error' and
  >>`<<requeue_event_on_dispatcher_error' allowed to lose data very
  easily: if the dispatcher failed to send data to the backend (e.g.
  Gnocchi is down), then the dispatcher raised and the data were lost
  forever. This was completely unacceptable, and nobody should be able
  to configure Ceilometer in that way."

  <SYSTEM MESSAGE: <string>:71: (WARNING/2) Inline interpreted text or
  phrase reference start-string without end-string.>

  <SYSTEM MESSAGE: <string>:71: (WARNING/2) Inline interpreted text or
  phrase reference start-string without end-string.>

* [bug 1533787 (https://bugs.launchpad.net/ceilometer/+bug/1533787)]
  Fix an issue where agents are not properly getting registered to
  group when multiple notification agents are deployed. This can
  result in bad transformation as the agents are not coordinated. It
  is still recommended to set heartbeat_timeout_threshold = 0 in
  [oslo_messaging_rabbit] section when deploying multiple agents.

* [bug 1519767 (https://bugs.launchpad.net/ceilometer/+bug/1519767)]
  fnmatch functionality in python <= 2.7.9 is not threadsafe. this
  issue and  its potential race conditions are now patched.


Bug Fixes
*********

* [bug 1531626 (https://bugs.launchpad.net/ceilometer/+bug/1531626)]
  Ensure aggregator transformer timeout is honoured if size is not
  provided.

* [bug 1550436 (https://bugs.launchpad.net/ceilometer/+bug/1550436)]
  Cache json parsers when building parsing logic to handle event and
  meter definitions. This will improve agent startup and setup time.

* [bug 1254800 (https://bugs.launchpad.net/ceilometer/+bug/1254800)]
  Add better support to catch race conditions when creating
  event_types

* [bug 1539163 (https://bugs.launchpad.net/ceilometer/+bug/1539163)]
  Add ability to define whether to use first or last timestamps when
  aggregating samples. This will allow more flexibility when chaining
  transformers.

* [bug 1536338 (https://bugs.launchpad.net/ceilometer/+bug/1536338)]
  Patch was added to fix the broken floatingip pollster that polled
  data from nova api, but since the nova api filtered the data by
  tenant, ceilometer was not getting any data back. The fix changes
  the pollster to use the neutron api instead to get the floating ip
  info.

* [bug 1530793 (https://bugs.launchpad.net/ceilometer/+bug/1530793)]
  network.services.lb.incoming.bytes meter was previous set to
  incorrect type. It should be a gauge meter.

* [bug 255569 (https://bugs.launchpad.net/ceilometer/+bug/255569)]
  Fix caching support in Gnocchi dispatcher. Added better locking
  support to enable smoother cache access.

* Fix samples from Heat to map to correct Gnocchi resource type

* [bug 1523124 (https://bugs.launchpad.net/ceilometer/+bug/1523124)]
  Fix gnocchi dispatcher to support UDP collector

* [bug 1542189 (https://bugs.launchpad.net/ceilometer/+bug/1542189)]
  Handle malformed resource definitions in gnocchi_resources.yaml
  gracefully. Currently we raise an exception once we hit a bad
  resource and skip the rest. Instead the patch skips the bad resource
  and proceeds with rest of the definitions.

* [bug 1504495 (https://bugs.launchpad.net/ceilometer/+bug/1504495)]
  Configure ceilometer to handle policy.json rules when possible.

* [bug 1526793 (https://bugs.launchpad.net/ceilometer/+bug/1526793)]
  Additional indices were added to better support querying of event
  data.

* [bug 1536699 (https://bugs.launchpad.net/ceilometer/+bug/1536699)]
  Patch to fix volume field lookup in meter definition file. In case
  the field is missing in the definition, it raises a keyerror and
  aborts. Instead we should skip the missing field meter and continue
  with the rest of the definitions.

* [bug 1532661 (https://bugs.launchpad.net/ceilometer/+bug/1532661)]
  Fix statistics query failures due to large numbers stored in
  MongoDB. Data from MongoDB is returned as Int64 for big numbers when
  int and float types are expected. The data is cast to appropriate
  type to handle large data.

* [bug 1536498 (https://bugs.launchpad.net/ceilometer/+bug/1536498)]
  Patch to fix duplicate meter definitions causing duplicate samples.
  If a duplicate is found, log a warning and skip the meter
  definition. Note that the first occurance of a meter will be used
  and any following duplicates will be skipped from processing.

* [bug 1506738 (https://bugs.launchpad.net/ceilometer/+bug/1506738)]
  [bug 1509677 (https://bugs.launchpad.net/ceilometer/+bug/1509677)]
  Optimise SQL backend queries to minimise query load

* [bug 1388680 (https://bugs.launchpad.net/ceilometer/+bug/1388680)]
  Suppose ability to query for None value when using SQL backend.


Other Notes
***********

* Configure individual dispatchers by specifying meter_dispatchers
  and event_dispatchers in configuration file.

* A dogpile.cache supported backend is required to enable cache.
  Additional configuration options
  (http://docs.openstack.org/developer/oslo.cache/opts.html#cache) are
  also required.

Changes in ceilometer 6.0.0.0rc2..6.0.0
---------------------------------------

2444399 collector: never allow to lose data
acd1faf Imported Translations from Zanata

Diffstat (except docs and test files)
-------------------------------------

ceilometer/collector.py                            | 36 ++++------------------
ceilometer/locale/ceilometer.pot                   | 14 ++++++---
ceilometer/locale/ja/LC_MESSAGES/ceilometer.po     | 29 +++++++++--------
.../notes/always-requeue-7a2df9243987ab67.yaml     | 15 +++++++++
5 files changed, 46 insertions(+), 83 deletions(-)