hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanping Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7265) Hadoop Server Log Correlation
Date Thu, 28 Sep 2017 16:01:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tanping Wang updated YARN-7265:
-------------------------------
    Description: Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs..
  There are also a lot of different ways can be used to expose the logs, build relationship
horizontally to correlate the logs or search the logs by keyword. There is a need for a default
and yet convenient  logging analytics mechanism in Hadoop itself that at least covers all
the server logs of Hadoop.  This log analytics system can correlate the Hadoop server logs
by grouping them by various dimensions including task number, job number or node number etc.
  The raw logs with correlation can be easily accessed by the application developer or cluster
administrator via web page for managing and debugging.  (was: Hadoop has many server logs,
yarn tasks logs, node manager logs, HDFS logs..   There are also a lot of different ways can
be used to expose the logs, build relationship horizontally to correlate the logs or search
the logs by keyword. There is a need for a default and yet convenient  logging analytics mechanism
in Hadoop itself that at least covers all the server logs of Hadoop.  This log analytics system
can correlate the Hadoop server logs by grouping them by various dimensions including task
number, job number or node number etc.   The raw logs with correlation can be easily accessed
by the application developer or cluster administrator.)

> Hadoop Server Log Correlation  
> -------------------------------
>
>                 Key: YARN-7265
>                 URL: https://issues.apache.org/jira/browse/YARN-7265
>             Project: Hadoop YARN
>          Issue Type: Wish
>          Components: log-aggregation
>            Reporter: Tanping Wang
>
> Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs..   There
are also a lot of different ways can be used to expose the logs, build relationship horizontally
to correlate the logs or search the logs by keyword. There is a need for a default and yet
convenient  logging analytics mechanism in Hadoop itself that at least covers all the server
logs of Hadoop.  This log analytics system can correlate the Hadoop server logs by grouping
them by various dimensions including task number, job number or node number etc.   The raw
logs with correlation can be easily accessed by the application developer or cluster administrator
via web page for managing and debugging.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message