tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-2073) SimpleHistoryLoggingService cannot be read by log aggregation (umask)
Date Wed, 11 Feb 2015 00:45:11 GMT

    [ https://issues.apache.org/jira/browse/TEZ-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315298#comment-14315298
] 

Hitesh Shah commented on TEZ-2073:
----------------------------------

Is the fs.permissions.umask-mode applicable to all FileSystem schemes? Should it be restricted
only to DFS? I guess the simpler change might be to use java.io.* instead of Filesystem APIs
for all local file ops. 

> SimpleHistoryLoggingService cannot be read by log aggregation (umask)
> ---------------------------------------------------------------------
>
>                 Key: TEZ-2073
>                 URL: https://issues.apache.org/jira/browse/TEZ-2073
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jonathan Eagles
>
> Nodemanager logs have the following log aggregation error.
> In a system where default fs.permissions.umask-mode=077. All file can be aggregated except
the Simple History file since it writes files using the system's default FileSystem umask.
> {quote}
> [LogAggregationService #278] ERROR logaggregation.AggregatedLogFormat: Error aggregating
log file. Log file : /tmp/yarn-logs/application_1423009000687_15308/container_e04_1423009000687_15308_01_000001/history.txt.appattempt_1423009000687_15308_000001.
/tmp/yarn-logs/application_1423009000687_15308/container_e04_1423009000687_15308_01_000001/history.txt.appattempt_1423009000687_15308_000001
(Permission denied)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message