Open Stack

On Wed, May 27, 2015 at 12:27 PM, Joseph Bajin <josephbajin at gmail.com>
wrote:

> I think those from the Infra Project are a great start, but I do think
> they are missing a lot.
>

I am sure they are, and we would love contributions to make them better.
The filters from the infra project are used every day by developers use to
hunt down issues. And the more similar the developer and operator
experience is here the easier it will be for the two groups to talk about
the same problems.


>
> Instead of breaking down the message into parts, it just breaks down the
> type (INFO, DEBUG, etc) and then makes the rest of the message greedy.
> That doesn't help searching or graphing or anything like that (or at least
> makes it more difficult over time). At least that is what I have seen.
>

One of the reasons for this is because most of the log messages are very
unstructured. But I have a hunch we can do better then what we have today.


>
> We are using a little bit tweaked version of the godaddy's scripts.  That
> seems to give us a good amount of detail that we can search and filter on.
> I'll see if I can post my versions of them to the repo.
>

Are you talking about https://github.com/osops/tools-logging
<https://github.com/osops/tools-logging/pull/3> or the infra repo? It would
be great to have both developer and operator communities  collaborate on
this and improve everyones ELK configuration.


>
> On Wed, May 27, 2015 at 2:00 PM, Mark Voelker <mvoelker at vmware.com> wrote:
>
>> Sounds like a fine thing to point people to…thanks Joe.
>>
>> https://github.com/osops/tools-logging/pull/3
>>
>> At Your Service,
>>
>> Mark T. Voelker
>>
>>
>> > On May 27, 2015, at 1:12 PM, Joe Gordon <joe.gordon0 at gmail.com> wrote:
>> >
>> >
>> >
>> > On Mon, May 18, 2015 at 3:11 PM, Tom Fifield <tom at openstack.org> wrote:
>> > There's some stuff in the osops repo:
>> >
>> > https://github.com/osops/tools-logging
>> >
>> > Please contribute if you can!
>> >
>> > Regards,
>> >
>> > Tom
>> >
>> >
>> > On 18/05/15 14:56, Anand Kumar Sankaran wrote:
>> > Hi all
>> >
>> > Is there a set of open source ELK configurations available?  (log stash
>> > filters, templates, kibana dashboards).  I see a github repository from
>> > Godaddy, wondering if there is a standard set that is used.
>> >
>> > OpenStack has an ELK stack running at logstash.openstack.org to help
>> debug test jobs.
>> >
>> > The logstash filters can be found at:
>> http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logstash/indexer.conf.erb
>> >
>> >
>> > Thanks.
>> >
>> > —
>> > anand
>> >
>> >
>> > _______________________________________________
>> > OpenStack-operators mailing list
>> > OpenStack-operators at lists.openstack.org
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>> >
>> >
>> > _______________________________________________
>> > OpenStack-operators mailing list
>> > OpenStack-operators at lists.openstack.org
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>> >
>> > _______________________________________________
>> > OpenStack-operators mailing list
>> > OpenStack-operators at lists.openstack.org
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>>
>> _______________________________________________
>> OpenStack-operators mailing list
>> OpenStack-operators at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20150527/a5f85d7f/attachment.html>