<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 27, 2015 at 12:27 PM, Joseph Bajin <span dir="ltr"><<a href="mailto:josephbajin@gmail.com" target="_blank">josephbajin@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr">I think those from the Infra Project are a great start, but I do think they are missing a lot. </div></blockquote><div><br></div><div>I am sure they are, and we would love contributions to make them better. The filters from the infra project are used every day by developers use to hunt down issues. And the more similar the developer and operator experience is here the easier it will be for the two groups to talk about the same problems.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>Instead of breaking down the message into parts, it just breaks down the type (INFO, DEBUG, etc) and then makes the rest of the message greedy. That doesn't help searching or graphing or anything like that (or at least makes it more difficult over time). At least that is what I have seen.</div></div></blockquote><div><br></div><div>One of the reasons for this is because most of the log messages are very unstructured. But I have a hunch we can do better then what we have today.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>We are using a little bit tweaked version of the godaddy's scripts. That seems to give us a good amount of detail that we can search and filter on. I'll see if I can post my versions of them to the repo. </div></div></blockquote><div><br></div><div>Are you talking about <a href="https://github.com/osops/tools-logging/pull/3" target="_blank">https://github.com/osops/tools-logging</a> or the infra repo? It would be great to have both developer and operator communities collaborate on this and improve everyones ELK configuration.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div class=""><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 27, 2015 at 2:00 PM, Mark Voelker <span dir="ltr"><<a href="mailto:mvoelker@vmware.com" target="_blank">mvoelker@vmware.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Sounds like a fine thing to point people to…thanks Joe.<br>
<br>
<a href="https://github.com/osops/tools-logging/pull/3" target="_blank">https://github.com/osops/tools-logging/pull/3</a><br>
<br>
At Your Service,<br>
<br>
Mark T. Voelker<br>
<div><div><br>
<br>
> On May 27, 2015, at 1:12 PM, Joe Gordon <<a href="mailto:joe.gordon0@gmail.com" target="_blank">joe.gordon0@gmail.com</a>> wrote:<br>
><br>
><br>
><br>
> On Mon, May 18, 2015 at 3:11 PM, Tom Fifield <<a href="mailto:tom@openstack.org" target="_blank">tom@openstack.org</a>> wrote:<br>
> There's some stuff in the osops repo:<br>
><br>
> <a href="https://github.com/osops/tools-logging" target="_blank">https://github.com/osops/tools-logging</a><br>
><br>
> Please contribute if you can!<br>
><br>
> Regards,<br>
><br>
> Tom<br>
><br>
><br>
> On 18/05/15 14:56, Anand Kumar Sankaran wrote:<br>
> Hi all<br>
><br>
> Is there a set of open source ELK configurations available? (log stash<br>
> filters, templates, kibana dashboards). I see a github repository from<br>
> Godaddy, wondering if there is a standard set that is used.<br>
><br>
> OpenStack has an ELK stack running at <a href="http://logstash.openstack.org" target="_blank">logstash.openstack.org</a> to help debug test jobs.<br>
><br>
> The logstash filters can be found at: <a href="http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logstash/indexer.conf.erb" target="_blank">http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logstash/indexer.conf.erb</a><br>
><br>
><br>
> Thanks.<br>
><br>
> —<br>
> anand<br>
><br>
><br>
> _______________________________________________<br>
> OpenStack-operators mailing list<br>
> <a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
><br>
><br>
> _______________________________________________<br>
> OpenStack-operators mailing list<br>
> <a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
><br>
> _______________________________________________<br>
> OpenStack-operators mailing list<br>
> <a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br>
_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>