hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ram Venkatesh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory
Date Wed, 27 Apr 2016 23:12:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261164#comment-15261164
] 

Ram Venkatesh commented on YARN-4913:
-------------------------------------

[~xgong] Here are two reasons for the -out option, both are more relevant for large multi-GB
app instances. 
1. yarn logs > $targetFile produces a single file that appends all the individual container
logs. This requires (clumsy | complex) parsing to split the files apart if you are looking
for specific task or app-specific logs. Writing to a directory will preserve the distinct
files easily and also lend itself to archiving.
2. redirecting through the console instead of writing directly to the local filesystem apis
adds additional overhead on some platforms like Windows.

>From a supportability standpoint I think this option will be useful.

> Yarn logs should take a -out option to write to a directory
> -----------------------------------------------------------
>
>                 Key: YARN-4913
>                 URL: https://issues.apache.org/jira/browse/YARN-4913
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>         Attachments: YARN-4913.1.patch, YARN-4913.2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message