Open Stack

We are gleeful to announce the release of:

gnocchi 3.0.0: Metric as a Service

For more details, please see below.

3.0.0
^^^^^


New Features
************

* A new REST API endpoint have been added to be able to update a
  resource-type: "PATCH /v1/resource-type/foobar". The expected
  payload is in RFC6902 format. Some examples can be found in the
  documentation.

* The Carbonara based storage engine has been updated and greatly
  improved. It now features fast write for Ceph (no change for file
  and Swift based drivers) by using an append method. It also features
  on the fly data compression (using LZ4) of the aggregated time
  serie, reducing the data space usage by at least 50Â %.

* Swift now supports authentication with Keystone v3 API.


Upgrade Notes
*************

* gnocchi-upgrade must be run before running the new version of
  gnocchi-metricd and the HTTP REST API in order to upgrade from
  version 2 of the Carbonara storage engine to version 3. It will read
  all metrics and convert them to new version 3 serialization format
  (compressing the data), which might take some time.

Changes in gnocchi 2.2.0..3.0.0
-------------------------------

252e7bf track the metric locked time
d28daa2 Fix gnocchi-metricd shutdown
39ee599 resource_type: check that min is not None before comparing with max
d66b6ef cli: do not run tooz watchers in parallel
51a0950 metricd: fix a data type inconsistent bug
72fb45f ceph: rename optional extra names
aa3d0ae Fix PostgreSQL migration script with resource_type_state_enum
96dd4ed carbonara-drivers: elapsed can be zero
f22cacc Fix a typo in sqlalchemy.py
12affbb devstack: rename werkzeug to simple
ec055f5 carbonara: replace msgpack encoding with struct for new measures
f067210 carbonara: implement compressed format for BoundTimeSerie
52f4e5e devstack-gate: do not create legacy resources
dc0de1d storage: increase default processing delays
1a85b4c Allow to retry to delete a resource
c4f6b6e lower processor job polling and handle queuing
85b6854 releasenotes: fix typo in storage-engine-v3
e8dc20a carbonara: retrieve unaggregated timeserie only once for upgrade
db37885 doc: remove the rolling upgrade documentation
f89f404 ceph: Fix metricd start
fccda01 ceph: fix setup extra
db2afd1 This patch is used to delete batch of resources
2338948 tox: remove useless keyword
230bda7 cleanup metricd shutdown process
b7619c5 doc: reverse release note order
d0406db reno: fix formatting in resource type patch
9cec107 gendoc: allow DELETE to have body
d327620 swift: bump swiftclient dependency to 3.1.0 and set retries=0
593fd45 Allow to update resource-type (delete attributes)
6163dfb Allow to update resource-type (add attributes)
7acd3b5 cleanup carbonara - drop update method
8abc05b share groupings across aggregates
e326a06 Put the regex first
5474eae swift: switch default auth version to 3
cf413a4 tests/carbonara: use _serialize_v2 without mocking
0b50825 carbonara: Timeserie.aggregate
c6e7751 carbonara: optimize uncompressed serialization
c74c5c9 carbonara: compress non padded timeseries
1a42586 carbonara: use calcsize rather than hard coded value
452a238 storage: re-store/write read-only splits
187304c carbonara: write full data when the split is going read-only
0ca090c search: Fix in operator
ab0d2a5 Put CORS middleware at the pipeline beginning
b2d64d2 block oslo.db 4.13.2
6a8054c Check whether the resource type attribute min is less than or equal to max
0903b5c storage: test splits existing after delete
5ab6cf3 ceph: fix write emulation
c062916 Pin oslo.db<=4.13.0
10fd269 Ignore EEXIST when removing measures directories
8b3b780 indexer: fix retry on PostgreSQL transaction error
2576d30 test: fix a random failure with metric listing
30050ee storage: return list of split as a set
a373a9a swift: remove retrying code
c19bd9e carbonara: factorize out _get_unaggregated_timeserie_and_unserialize
8ca82d9 correct the debug log info, add a blank in log info
84443ca drop non-I/O threading in upgrade
21e57ad paginate on upgrade
73ed979 remove default=None for config options
f916f43 carbonara: avoid using futures altogether if no aggregation workers
039e8db storage: make sure the deletion tests are synchronous
96b9aa6 storage: do not list metrics on each measure processing
c27b8b7 storage: add an intermediate verification
ec2ef51 carbonara: expose first_block_timestamp as public
b8366fd Fix Gnocchi tempest.conf generation
fc38382 ceph: fix write emulation
9c0a918 Remove null drivers
abcd34c Add bindep.txt to express binary dependencies
f1f81c5 statsd: simplify testing code
b8e9d91 Merge documentation and release notes
ccfe751 Update reno for stable/2.2
313f033 doc: remove unused devstack.rst
a8c8260 Add 2.2 series release note
0798a1e only look for v2 objects on upgrade
72a2091 add support to process measures on GET
f25e1a4 storage: remove unused mock in tests
c5a8465 rest: fix status test
4390238 swift: optimize metric reporting in detail mode
fec094a carbonara: fix benchmark output now that compression is out
5f9e39b carbonara: remove unused class
82509d7 rest: allow to specify reaggregation methods in aggregation
d012a60 rest: remove aggregation dead code
9bc426d change to 3600 point object size
cf34b97 highlight pagination more prominently
c13a21a storage: allow to specify regaggregation over aggregation retrieval
8a8f19e Put py34 first in the env order of tox
b6bc670 ceph - write only new points
970aa60 offset serialisation
1c64f5e statsd: tweak logging
a59c759 statsd+metric: make retry code common
2bf39a5 drop v1.3 to v2.x migration, drop TimeSerieArchive


Diffstat (except docs and test files)
-------------------------------------

bindep.txt                                         |   6 +
devstack/gate/post_test_hook.sh                    |   5 +-
devstack/plugin.sh                                 |   8 +-
devstack/settings                                  |   2 +-
.../source => doc/source/releasenotes}/2.1.rst     |   0
.../source/releasenotes}/unreleased.rst            |   0
etc/gnocchi/policy.json                            |   2 +
gnocchi/carbonara.py                               | 618 ++++++++++++---------
gnocchi/cli.py                                     |  79 +--
gnocchi/gendoc.py                                  |  10 +
gnocchi/indexer/__init__.py                        |   5 +
...d2a1d205ff_add_updating_resource_type_states.py |  89 +++
gnocchi/indexer/null.py                            |  20 -
gnocchi/indexer/sqlalchemy.py                      | 189 +++++--
gnocchi/indexer/sqlalchemy_base.py                 |  11 +-
gnocchi/resource_type.py                           |  18 +-
gnocchi/rest/__init__.py                           | 332 +++++++----
gnocchi/rest/app.py                                |   8 +-
gnocchi/statsd.py                                  |   7 +-
gnocchi/storage/__init__.py                        |  12 +-
gnocchi/storage/_carbonara.py                      | 489 +++++++++++-----
gnocchi/storage/ceph.py                            |  91 +--
gnocchi/storage/file.py                            |  99 ++--
gnocchi/storage/null.py                            |  20 -
gnocchi/storage/swift.py                           | 130 ++---
gnocchi/tempest/plugin.py                          |   3 +-
gnocchi/utils.py                                   |  18 +-
.../notes/delete-resources-f10d21fc02f53f16.yaml   |   3 +
.../resource-type-patch-8b6a85009db0671c.yaml      |   6 +
.../notes/storage-engine-v3-b34bd0723abf292f.yaml  |  13 +
.../notes/swift_keystone_v3-606da8228fc13a32.yaml  |   3 +
releasenotes/source/_static/.placeholder           |   0
releasenotes/source/_templates/.placeholder        |   0
releasenotes/source/conf.py                        | 274 ---------
releasenotes/source/index.rst                      |  18 -
requirements.txt                                   |   1 +
setup.cfg                                          |  12 +-
tools/measures_injector.py                         |   6 +-
tox.ini                                            |  24 +-
62 files changed, 3132 insertions(+), 1676 deletions(-)


Requirements updates
--------------------

diff --git a/requirements.txt b/requirements.txt
index 88ef618..23cf70d 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -13,0 +14 @@ futures
+jsonpatch