hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user
Date Wed, 24 Oct 2018 03:32:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661678#comment-16661678
] 

Vinod Kumar Vavilapalli commented on YARN-8920:
-----------------------------------------------

Couple of comments
  - This should not be a configuration at all? We should change behavior in code after inspecting
what the underlying storage system supports?
  - Instead of changing code in so many places, you should simply replace the existing occurrences
of userUgi with a "logAggregatorUGI" and then simply swap the logAggregatorUGI upfront in
once place depending on the underlying storage system support.

> LogAggregation should be configurable to allow writing to underlying storage as appOwner
or yarn user
> -----------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8920
>                 URL: https://issues.apache.org/jira/browse/YARN-8920
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: log-aggregation, yarn
>            Reporter: Suma Shivaprasad
>            Assignee: Suma Shivaprasad
>            Priority: Major
>         Attachments: YARN-8920.1.patch, YARN-8920.2.patch, YARN-8920.3.patch, YARN-8920.4.patch,
YARN-8920.5.patch, YARN-8920.6.patch
>
>
> Currently NM Log Aggregation does not support writing to underlying storage as "yarn"
user.  This would be needed while writing storages like S3 which do not support POSIX compliant
ACLs and a single access key would be used for writes and app owners will be allowed to read
the logs with their own access keys.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message