hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Trezzo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5192) Limit the number of resources a container can localize
Date Thu, 02 Jun 2016 02:39:59 GMT
Chris Trezzo created YARN-5192:

             Summary: Limit the number of resources a container can localize
                 Key: YARN-5192
                 URL: https://issues.apache.org/jira/browse/YARN-5192
             Project: Hadoop YARN
          Issue Type: New Feature
            Reporter: Chris Trezzo

Users will sometimes submit YARN applications where containers localize a large number of
resources. This thrashes the YARN local cache on the node managers and can impact other running
applications. It would be nice if there was server-side enforcement of localization limits
that an admin could configure. For example:

# Total size of the resources a container can localize.
# Total number of files a container can localize.
# The maximum size of an individual resource (i.e. a large fat jar) that a container can localize.

MAPREDUCE-6690 is being worked on to provide a set of MapReduce client-side limits.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message