hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Omkar Vinit Joshi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-882) Specify per user quota for private/application cache and user log files
Date Mon, 24 Jun 2013 19:36:21 GMT
Omkar Vinit Joshi created YARN-882:
--------------------------------------

             Summary: Specify per user quota for private/application cache and user log files
                 Key: YARN-882
                 URL: https://issues.apache.org/jira/browse/YARN-882
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Omkar Vinit Joshi
            Assignee: Omkar Vinit Joshi


At present there is no limit on the number of files / size of the files localized by single
user. Similarly there is no limit on the size of the log files created by user via running
containers.
We need to restrict the user for this. For LocalizedResources; this has serious concerns in
case of secured environment where malicious user can start one container and localize resources
whose total size >= DEFAULT_NM_LOCALIZER_CACHE_TARGET_SIZE_MB. Thereafter it will either
fail (if no extra space is present on disk) or deletion service will keep removing localized
files for other containers/applications. 
The limit for logs/localized resource should be decided by RM and sent to NM via secured containerToken.
All these configurations should per container instead of per user or per nm.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message