<div dir="ltr"><font face="monospace, monospace">After reading the docs in github, i do not think Snap can handle logs very<br>well. Snap introduce itself as "The open telemetry framework". I think it is<br>more like ceilometer/collectd/zabbix. I also can not find how to create a mock<br>syslog socket to collect logs[0], how to use regexp to split the logs?.<div class="gmail_default" style="font-family:monospace,monospace;font-size:small;display:inline">I do</div></font><div><font face="monospace, monospace"><div class="gmail_default" style="font-family:monospace,monospace;font-size:small;display:inline">not think we have enough time and energy to waiting until Snap fix it.</div><br><br><br>It may be a cool tool. But it is not mature, imo. Why not use a well used and<br>mature software, even though it may be slower than others? But it works very<br>well and lots of guys are familiar with it.<div class="gmail_default" style="font-family:monospace,monospace;font-size:small;display:inline"></div><br><br><br>[0] <a href="https://github.com/intelsdi-x/snap/issues/1117">https://github.com/intelsdi-x/snap/issues/1117</a></font></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Nov 27, 2016 at 9:46 PM, Michał Jastrzębski <span dir="ltr"><<a href="mailto:inc007@gmail.com" target="_blank">inc007@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hey,<br>
<br>
I am also working with Snap community to enable log forwarding with it [1].<br>
Snap is super lightweight and additional benefit of this solution<br>
would be that it can also handle monitoring, which was it's initial<br>
role. One service to handle both would be elegant. I'll keep you<br>
posted but let's not throw away this idea just yet.<br>
<br>
Cheers,<br>
Michal<br>
<br>
[1] <a href="https://github.com/intelsdi-x/snap" rel="noreferrer" target="_blank">https://github.com/intelsdi-x/<wbr>snap</a><br>
<div><div class="h5"><br>
On 26 November 2016 at 23:55, Jeffrey Zhang <<a href="mailto:zhang.lei.fly@gmail.com">zhang.lei.fly@gmail.com</a>> wrote:<br>
> Heka is marked deprecated in Kolla during Newton cycle[0]. And Now we have a<br>
> blueprint for this[1]. Two alternatives, fluentd[3] and Filebeat.<br>
><br>
> For Filebeat, it is just a replacement of logstash-forward[2]. It is not<br>
> intent<br>
> to replace the Logstash at all.<br>
><br>
>> Filebeat is based on the Logstash Forwarder source code and replaces<br>
>> Logstash<br>
>> Forwarder as the method to use for tailing log files and forwarding them<br>
>> to<br>
>> Logstash.<br>
><br>
> Fillebeat is a log transport tool rather than log processing too. I do not<br>
> treat it as an alternative at all.<br>
><br>
> To be honest, I'd like back to Logstash, and Logstash 5.x is released with<br>
> high<br>
> performance improvement[4].<br>
><br>
>> In our performance testing, we've seen consistent throughput increases<br>
>> across multiple configurations. In some cases, we observed up to 75%<br>
>> increase in events processed through Logstash.<br>
><br>
> another benefit to using Logstash is the whole ELK stack is maintained by<br>
> one<br>
> community/company. It is well tested and easy to upgrade the whole stack at<br>
> the<br>
> same time. Using other tools may force us on certain elasticsearch release.<br>
><br>
> So, I think we have to alternative tools.<br>
><br>
> * Fluentd<br>
> * Logstash<br>
><br>
> IMO, we need to make the decision and at least prepare the migration<br>
> solution now.<br>
><br>
> [1] <a href="https://blueprints.launchpad.net/kolla/+spec/heka-deprecation" rel="noreferrer" target="_blank">https://blueprints.launchpad.<wbr>net/kolla/+spec/heka-<wbr>deprecation</a><br>
> [2]<br>
> <a href="https://www.elastic.co/guide/en/beats/filebeat/current/migrating-from-logstash-forwarder.html" rel="noreferrer" target="_blank">https://www.elastic.co/guide/<wbr>en/beats/filebeat/current/<wbr>migrating-from-logstash-<wbr>forwarder.html</a><br>
> [3] <a href="http://www.fluentd.org/" rel="noreferrer" target="_blank">http://www.fluentd.org/</a><br>
> [4] <a href="https://www.elastic.co/blog/logstash-5-0-0-released" rel="noreferrer" target="_blank">https://www.elastic.co/blog/<wbr>logstash-5-0-0-released</a><br>
><br>
> --<br>
> Regards,<br>
> Jeffrey Zhang<br>
> Blog: <a href="http://xcodest.me" rel="noreferrer" target="_blank">http://xcodest.me</a><br>
><br>
</div></div>> ______________________________<wbr>______________________________<wbr>______________<br>
> OpenStack Development Mailing List (not for usage questions)<br>
> Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org?subject:<wbr>unsubscribe</a><br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br>
><br>
<br>
______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org?subject:<wbr>unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><span style="font-size:13px;border-collapse:collapse"><font face="monospace, monospace">Regards,</font></span></div><div><span style="font-size:13px;border-collapse:collapse"><font face="monospace, monospace">Jeffrey Zhang</font></span></div><div><span style="font-family:monospace,monospace;font-size:12.8px">Blog: </span><a href="http://xcodest.me/" style="font-family:monospace,monospace;font-size:12.8px" target="_blank">http://xcodest.me</a><font face="monospace, monospace"><br></font></div></div></div></div></div></div></div></div></div>
</div>