Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 28 Sep 2017 16:01:00 +0000 (UTC)
From: "Tanping Wang (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13105790.1506614093000.226900.1506614460244@Atlassian.JIRA>
In-Reply-To: <JIRA.13105790.1506614093000@Atlassian.JIRA>
References: <JIRA.13105790.1506614093000@Atlassian.JIRA> <JIRA.13105790.1506614093920@jira-lw-us.apache.org>
Subject: [jira] [Updated] (YARN-7265) Hadoop Server Log Correlation
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Thu, 28 Sep 2017 16:01:04 -0000


     [ https://issues.apache.org/jira/browse/YARN-7265?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tanping Wang updated YARN-7265:
-------------------------------
    Description: Hadoop has many server logs, yarn tasks logs, node manager=
 logs, HDFS logs..   There are also a lot of different ways can be used to =
expose the logs, build relationship horizontally to correlate the logs or s=
earch the logs by keyword. There is a need for a default and yet convenient=
  logging analytics mechanism in Hadoop itself that at least covers all the=
 server logs of Hadoop.  This log analytics system can correlate the Hadoop=
 server logs by grouping them by various dimensions including task number, =
job number or node number etc.   The raw logs with correlation can be easil=
y accessed by the application developer or cluster administrator via web pa=
ge for managing and debugging.  (was: Hadoop has many server logs, yarn tas=
ks logs, node manager logs, HDFS logs..   There are also a lot of different=
 ways can be used to expose the logs, build relationship horizontally to co=
rrelate the logs or search the logs by keyword. There is a need for a defau=
lt and yet convenient  logging analytics mechanism in Hadoop itself that at=
 least covers all the server logs of Hadoop.  This log analytics system can=
 correlate the Hadoop server logs by grouping them by various dimensions in=
cluding task number, job number or node number etc.   The raw logs with cor=
relation can be easily accessed by the application developer or cluster adm=
inistrator.)

> Hadoop Server Log Correlation =20
> -------------------------------
>
>                 Key: YARN-7265
>                 URL: https://issues.apache.org/jira/browse/YARN-7265
>             Project: Hadoop YARN
>          Issue Type: Wish
>          Components: log-aggregation
>            Reporter: Tanping Wang
>
> Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS log=
s..   There are also a lot of different ways can be used to expose the logs=
, build relationship horizontally to correlate the logs or search the logs =
by keyword. There is a need for a default and yet convenient  logging analy=
tics mechanism in Hadoop itself that at least covers all the server logs of=
 Hadoop.  This log analytics system can correlate the Hadoop server logs by=
 grouping them by various dimensions including task number, job number or n=
ode number etc.   The raw logs with correlation can be easily accessed by t=
he application developer or cluster administrator via web page for managing=
 and debugging.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org