hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanping Wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-7265) Hadoop Server Log Correlation
Date Thu, 28 Sep 2017 15:55:00 GMT
Tanping Wang created YARN-7265:

             Summary: Hadoop Server Log Correlation  
                 Key: YARN-7265
                 URL: https://issues.apache.org/jira/browse/YARN-7265
             Project: Hadoop YARN
          Issue Type: Wish
          Components: log-aggregation
            Reporter: Tanping Wang

Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs..   There are also
a lot of different ways can be used to expose the logs, build relationship horizontally to
correlate the logs or search the logs by keyword. There is a need for a default and yet convenient
 logging analytics mechanism in Hadoop itself that at least covers all the server logs of
Hadoop.  This log analytics system can correlate the Hadoop server logs by grouping them by
various dimensions including task number, job number or node number etc.   The raw logs with
correlation can be easily accessed by the application developer or cluster administrator.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message