airavata-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suresh Marru <sma...@apache.org>
Subject Re: KafkaAppender for Airavata
Date Tue, 04 Oct 2016 17:13:38 GMT
Hi Lahiru,

Can you please elaborate on the role of the messaging system (Kafka in your example) vs directly
using log stash plugins [1] as an example?

Suresh
[1] - https://www.elastic.co/guide/en/logstash/current/plugins-inputs-log4j.html <https://www.elastic.co/guide/en/logstash/current/plugins-inputs-log4j.html>

> On Oct 4, 2016, at 12:29 PM, Lahiru Ginnaliya Gamathige <glahiru@gmail.com> wrote:
> 
> Hi Devs,
> 
> I've been working on a feature in Airavata to send its logs to a Kafka topic and finally
move them to elastic search using logstash. Please find all the work[1] and the code[2] and
I've added a documentation in to wiki [3](since we do not have a development location for
wiki). 
> 
> After finishing the issue, Me and Ajinkya did a setup with Airavata and elastic search
and Kafka cluster and we were able to visualize the logs in kibana.
> 
> Please provide your valuable feedback on this feature. 
> 
> [1]https://issues.apache.org/jira/browse/AIRAVATA-2065 <https://issues.apache.org/jira/browse/AIRAVATA-2065>
> [2]https://github.com/apache/airavata/commit/8eea17fb9c8c073784795dfc56618ec556a12ad1
<https://github.com/apache/airavata/commit/8eea17fb9c8c073784795dfc56618ec556a12ad1>
> [3]https://cwiki.apache.org/confluence/display/AIRAVATA/Tutorial+09+-+How+to+setup+centralized+logging+for+Airavata
<https://cwiki.apache.org/confluence/display/AIRAVATA/Tutorial+09+-+How+to+setup+centralized+logging+for+Airavata>
> 
> 
> Regards
> Lahiru


Mime
View raw message