hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display
Date Tue, 04 Nov 2014 15:14:40 GMT

    [ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14196203#comment-14196203
] 

Hudson commented on YARN-2703:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1947 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1947/])
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused
when adding log-upload-time via YARN-2703. Contributed by Xuan Gong. (vinodkv: rev 58e9f24e0f06efede21085b7ffe36af042fa7b38)
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestLogsCLI.java
* hadoop-yarn-project/CHANGES.txt
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/log/AggregatedLogsBlock.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/logaggregation/TestAggregatedLogFormat.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/LogCLIHelpers.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/logaggregation/TestLogAggregationService.java


> Add logUploadedTime into LogValue for better display
> ----------------------------------------------------
>
>                 Key: YARN-2703
>                 URL: https://issues.apache.org/jira/browse/YARN-2703
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>             Fix For: 2.6.0
>
>         Attachments: YARN-2703.1.patch, YARN-2703.2.patch, YARN-2703.3.patch, YARN-2703.4.patch
>
>
> Right now, the container can upload its logs multiple times. Sometimes, containers write
different logs into the same log file.  After the log aggregation, when we query those logs,
it will show:
> LogType: stderr
> LogContext:
> LogType: stdout
> LogContext:
> LogType: stderr
> LogContext:
> LogType: stdout
> LogContext:
> The same files could be displayed multiple times. But we can not figure out which logs
come first. We could add extra loguploadedTime to let users have better understanding on the
logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message