hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Peterson (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-698) Per-pool task limits for the fair scheduler
Date Mon, 19 Oct 2009 23:52:59 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Kevin Peterson updated MAPREDUCE-698:

    Attachment: MAPREDUCE-698-prelim.patch

Attached patch works for me, but I think I need to make some changes for interaction with
the multiple-assign before it's ready to commit. Patch is relative to 0.20 branch.

It allows two new fields in the pools definition, "maxMaps" and "maxReduces".

My need for this is interacting with outside services (in this case, an HBase cluster that's
significantly smaller than my Hadoop cluster).

> Per-pool task limits for the fair scheduler
> -------------------------------------------
>                 Key: MAPREDUCE-698
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-698
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/fair-share
>            Reporter: Matei Zaharia
>             Fix For: 0.21.0
>         Attachments: MAPREDUCE-698-prelim.patch
> The fair scheduler could use a way to cap the share of a given pool similar to MAPREDUCE-532.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message