hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajiv Chittajallu (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5966) Option to limit max tasks started per job/queue
Date Thu, 04 Jun 2009 02:34:07 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716134#action_12716134
] 

Rajiv Chittajallu commented on HADOOP-5966:
-------------------------------------------


For job limits, Yes. Can we add similar limits per queue?

mapred.max.maps.per.queue and mapred.max.reduces.per.queue



> Option to limit max tasks started per job/queue 
> ------------------------------------------------
>
>                 Key: HADOOP-5966
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5966
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: contrib/capacity-sched
>            Reporter: Rajiv Chittajallu
>
> For jobs which call external services, (eg: distcp, crawlers) user/admin should be able
to control max parallel tasks spawned. There should be a mechanism to cap the capacity available
for a queue/job. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message