ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ananda Verma (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (AMBARI-7811) Integrate ElasticSearch, LogStash and Kibana with Ambari
Date Tue, 18 Oct 2016 05:36:58 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584518#comment-15584518
] 

Ananda Verma edited comment on AMBARI-7811 at 10/18/16 5:36 AM:
----------------------------------------------------------------

All 3 integration as independent services would be better idea I guess. With HDP 2.4 log search
preview is already made with ambari infra and it uses solr so definitely ELK is not coming
for default log analysis server.

But elastic search integration definitely make sense. My team is already working on it since
we are integrating predictionio which needs elastic search for meta store so it make sense
for us to integrate. 


was (Author: rahul.vit09@gmail.com):
All 3 integration as independent services would be better idea I guess. With HDP 2.4 log search
preview is already made with ambari infra and it uses solr so definitely ELK is not coming
for default log analysis server.

But ElasticSearch integration definitely make sense. 

> Integrate ElasticSearch, LogStash and Kibana with Ambari
> --------------------------------------------------------
>
>                 Key: AMBARI-7811
>                 URL: https://issues.apache.org/jira/browse/AMBARI-7811
>             Project: Ambari
>          Issue Type: New Feature
>          Components: ambari-server
>            Reporter: Mingjiang Shi
>
> A hadoop cluster has many nodes, many services and many components, which generates many
logs on different machines.  It would be a good idea to search and view those logs at a central
place.  
> The ELK stack (elastic search, logstash and kibana) is the one of the best open source
log collection, storage and search solution.  By integrating ELK with Ambari, user could optionally
install ELK when deploying a cluster.  This will enable user to search and view all the logs
at free.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message