hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3893) allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis
Date Wed, 04 Apr 2012 16:01:23 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13246398#comment-13246398
] 

Thomas Graves commented on MAPREDUCE-3893:
------------------------------------------

Arun, any input on this?

On the configs - would it be better to remove the global setting and just have this per queue,
that way it would match the other queue configs.  I'm not sure if that is considered breaking
api compatibility though.
                
> allow capacity scheduler configs maximum-applications and maximum-am-resource-percent
configurable on a per queue basis
> -----------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3893
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3893
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Assignee: Eric Payne
>            Priority: Critical
>         Attachments: MAPREDUCE-3893-1.txt
>
>
> The capacity scheduler configs for  maximum-applications and maximum-am-resource-percent
are currently configured globally and then made proportional to each queue based on its capacity.
There are times when this may not work well.  some exampless -  if you have a queue that is
running on uberAM jobs, the jobs a queue is running always has a small number of containers,
and then you have the opposite where in a queue with very small capacity, you may want to
limit the am resources even more so you don't end up deadlocked with all your capacity being
used for app masters.
> I think we should make those configurable on a per queue basis.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message