hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2441) regression: maximum limit of -1 + user-lmit math appears to be off
Date Thu, 12 May 2011 16:53:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13032504#comment-13032504
] 

Allen Wittenauer commented on MAPREDUCE-2441:
---------------------------------------------

Nope, not about user-limit-factor.  But doesn't this mean that the first jobs in an expanding
queue can starve out jobs in another queue?  In other words, if I have:

job1 = max-lim -1 queue
job2 = max-lim -1 queue
job3 = max-lim % queue

job1 and job2 could take all slots before job3 gets executed, especially if they are submitted
by the same user and that is the only user in the job submission queue.

> regression: maximum limit of -1 + user-lmit math appears to be off
> ------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2441
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2441
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>    Affects Versions: 0.20.203.0
>            Reporter: Allen Wittenauer
>            Priority: Critical
>         Attachments: capsched.xml
>
>
> The math around the slot usage when maximum-capacity=-1 appears to be faulty.  See comments.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message