[openstack-dev] [ceilometer] Blueprint proposals for 'file' publisher: Compression and CSV file format

Waines, Greg Greg.Waines at windriver.com
Thu Nov 16 17:44:40 UTC 2017

Hey there,

I am looking for some feedback on 2x enhancement / blueprint proposals for the ‘file’ publisher in ceilometer.
i.e.   https://github.com/openstack/ceilometer/blob/master/ceilometer/publisher/file.py

Are the Ceilometer owners open to looking at blueprints for the following ?

1.       Compression of files (within file rotation) to minimize disk usage and minimize bandwidth in FTP-ing these files off server

o    i.e. as part of file rotation, the newly rotated file would be gzip’d to compress the file

o    this would be an optional parameter in the pipeline definition in /etc/ceilometer/pipeline.yaml
name: meter_file
    - "*"
    - file:///var/test?max_bytes=10000000&backup_count=5&compress=true

o    again,
minimizing disk usage and minimizing network bandwidth in FTP-ing these files off server.

2.       CSV (Comma Separated Values) File Format

o    CSV is widely supported for many off-box Statistical Analysis-type Tools; especially in Telecom,

o    again this would be done as an optional argument to the file publisher

§  the existing format (python dictionary print) would remain as the default format

§  ‘format=csv’ would be the argument added to the publisher line in order to enable CSV format
name: meter_file
    - "*"
    - file:///var/test?max_bytes=10000000&backup_count=5&format=csv

let me know your feedback,

I think these would be valuable addons to the Ceilometer File Publisher,


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20171116/236cdff7/attachment.html>

More information about the OpenStack-dev mailing list