hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-1582) Capacity Scheduler: add a maximum-allocation-mb setting per queue
Date Thu, 09 Jan 2014 22:33:54 GMT
Thomas Graves created YARN-1582:

             Summary: Capacity Scheduler: add a maximum-allocation-mb setting per queue 
                 Key: YARN-1582
                 URL: https://issues.apache.org/jira/browse/YARN-1582
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacityscheduler
    Affects Versions: 2.2.0, 0.23.10, 3.0.0
            Reporter: Thomas Graves
            Assignee: Thomas Graves

We want to allow certain queues to use larger container sizes while limiting other queues
to smaller container sizes.  Setting it per queue will help prevent abuse, help limit the
impact of reservations, and allow changes in the maximum container size to be rolled out more

One reason this is needed is more application types are becoming available on yarn and certain
applications require more memory to run efficiently. While we want to allow for that we don't
want other applications to abuse that and start requesting bigger containers then what they
really need.  

Note that we could have this based on application type, but that might not be totally accurate
either since for example you might want to allow certain users on MapReduce to use larger
containers, while limiting other users of MapReduce to smaller containers.

This message was sent by Atlassian JIRA

View raw message