hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file
Date Mon, 27 Oct 2014 11:50:35 GMT

    [ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185077#comment-14185077
] 

Hudson commented on YARN-2734:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #725 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/725/])
YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by
Xuan Gong. (zjshen: rev caecd9fffe7c6216be31f3ab65349182045451fa)
* hadoop-yarn-project/CHANGES.txt
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/logaggregation/TestAggregatedLogFormat.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/logaggregation/AggregatedLogFormat.java


> If a sub-folder is encountered by log aggregator it results in invalid aggregated file
> --------------------------------------------------------------------------------------
>
>                 Key: YARN-2734
>                 URL: https://issues.apache.org/jira/browse/YARN-2734
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: log-aggregation
>    Affects Versions: 2.5.1
>            Reporter: Sumit Mohanty
>            Assignee: Xuan Gong
>             Fix For: 2.6.0
>
>         Attachments: YARN-2734.1.patch, YARN-2734.2.patch
>
>
> See YARN-2724 for some more context on how the error surfaces during "yarn logs" call.
> If aggregator sees a sub-folder today it results in the following error when reading
the logs:
> {noformat}
> Container: container_1413512973198_0019_01_000002 on c6401.ambari.apache.org_45454
> ====================================================================================
> LogType: cmd_data
> LogLength: 4096
> Log Contents:
> Error aggregating log file. Log file : /hadoop/yarn/log/application_1413512973198_0019/container_1413512973198_0019_01_000002/cmd_data/hadoop/yarn/log/application_1413512973198_0019/container_1413512973198_0019_01_000002/cmd_data
(Is a directory)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message