Open Stack

Hi there...

Catching up on that thread to what it’s worth. As part of the LMA (Logging, Monitoring, Alerting) toolchain initiative at Mirantis we developed a series of Heka plugins to parse and process the OpenStack logs. Those plugins are available on stackforge in project https://github.com/stackforge/fuel-plugin-lma-collector/
That’s not for Logstach but for those who have a preference for heka you may find that valuable. Feel free to ping us on that list if you’d like to discuss this further.
+1 for participating on ops tooling discussion.  
 -Patrick

On 2 Jun 2015 at 18:28:09, Cynthia Lopes (clsacramento at gmail.com) wrote:

Hello,

Just a +1, because it's really good idea. I'm working on that too and I'd love to participate with you.

Regards,
Cynthia

2015-06-02 14:00 GMT+02:00 Bajin, Joseph <jbajin at verisign.com>:
I’d definitely like to be a part of this.  I think this is one of the items that fits under the Monitoring/Ops Tools Working Group topics that we discussed at the Summit. Not sure if you were able to attend, but this was the etherpad on the topics discussed: https://etherpad.openstack.org/p/YVR-ops-tools

With help from Graeme Gillies and Debo Dutta, I am working on trying to find a time that works for us to start having bi-weekly (initially) meetings to discuss Monitoring and Ops Tools.  I think there are many topics that we can discuss and I think logstash filters is a major one.

—Joe
IRC: RaginBajin

From: Jesse Pretorius <jesse.pretorius at gmail.com>
Date: Tuesday, June 2, 2015 at 7:50 AM
To: "openstack-operators at lists.openstack.org" <openstack-operators at lists.openstack.org>
Subject: [Openstack-operators] Collaborative Logstash filter development

Hi everyone,

During the summit at Vancouver and at time both prior and after there has been expressed interest in more collaborative development of Logstash filters in an OpenStack environment.

Current examples which I'm aware of include:
 - https://github.com/godaddy/openstack-logstash
 - https://github.com/osops/tools-logging
 - http://docs.openstack.org/infra/system-config/logstash.html
 - https://github.com/rcbops/rpc-extras/tree/master/rpcd/playbooks/roles/logstash/templates

There was some discussion in the Operators track at the design summit about setting up a collaborative location, but to my knowledge there has been no firm decision about it.

It is plausible that we could put together a repository which is purely focused on the filters (not the input/output sections) and which could be consumed by downstream users (eg: openstack-infra). To do this, however, will require a group of interested parties to agree on how this will be done. Considering that it will likely be accepted into the Big Tent it will likely also require a PTL and core reviewing team.

We (Rackspace Private Cloud) are happy to seed initial configurations and work with a team of other parties to put together a standardised set of filters which are usable and useful. When agreed that the filters are ready we will also work with openstack-infra to implement the filters into logstash.openstack.org.

How would the Operator community like to proceed with this? Shall we arrange some sort of IRC discussion to figure out how best to organise this and to identify next steps?

--
Jesse Pretorius
IRC: odyssey4me

_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


_______________________________________________  
OpenStack-operators mailing list  
OpenStack-operators at lists.openstack.org  
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20150608/f120afd4/attachment.html>