[openstack-dev] [kolla] the alternative of log processing tool
zhang.lei.fly at gmail.com
Sun Nov 27 16:40:47 UTC 2016
So filebeat is working with Logstash right? We need split the logs into
pieces by using logstash. IMU, Filebeat do not a variety of processing
plugins, like Logstash.
On Sun, Nov 27, 2016 at 11:30 PM, Ian Cordasco <sigmavirus24 at gmail.com>
> File beat is maintained be elastic and a part of their product line just
> like ELK. It's a fantastic tool and quite flexible given its age and size
> of codebase
> On Nov 26, 2016 11:59 PM, "Jeffrey Zhang" <zhang.lei.fly at gmail.com> wrote:
>> Heka is marked deprecated in Kolla during Newton cycle. And Now we
>> have a
>> blueprint for this. Two alternatives, fluentd and Filebeat.
>> For Filebeat, it is just a replacement of logstash-forward. It is not
>> to replace the Logstash at all.
>> > Filebeat is based on the Logstash Forwarder source code and replaces
>> > Forwarder as the method to use for tailing log files and forwarding
>> them to
>> > Logstash.
>> Fillebeat is a log transport tool rather than log processing too. I do not
>> treat it as an alternative at all.
>> To be honest, I'd like back to Logstash, and Logstash 5.x is released
>> with high
>> performance improvement.
>> > In our performance testing, we've seen consistent throughput increases
>> > across multiple configurations. In some cases, we observed up to 75%
>> > increase in events processed through Logstash.
>> another benefit to using Logstash is the whole ELK stack is maintained by
>> community/company. It is well tested and easy to upgrade the whole stack
>> at the
>> same time. Using other tools may force us on certain elasticsearch
>> So, I think we have to alternative tools.
>> * Fluentd
>> * Logstash
>> IMO, we need to make the decision and at least prepare the migration
>> solution now.
>>  https://blueprints.launchpad.net/kolla/+spec/heka-deprecation
>>  https://www.elastic.co/guide/en/beats/filebeat/current/migra
>>  http://www.fluentd.org/
>>  https://www.elastic.co/blog/logstash-5-0-0-released
>> Jeffrey Zhang
>> Blog: http://xcodest.me
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscrib
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the OpenStack-dev