hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-5090) The capacity-scheduler should assign multiple tasks per heartbeat
Date Mon, 04 May 2009 10:55:30 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vinod K V updated HADOOP-5090:

    Attachment: HADOOP-5090-20090504.txt

Attaching patch. With this patch, CapacityTaskScheduler assigns multiple tasks in a single
heartbeat. It assigns multiple maps just like the default scheduler - multiple local tasks
and at-most one off-switch tasks; and multiple reduces. It also keeps track of the tasks decided
to be assigned in a particular scheduling iteration so as that high memory jobs are blocked
for scheduling and user-limits are respected while giving away multiple tasks.

The patch also has test-cases. Benchmarking is in progress.

> The capacity-scheduler should assign multiple tasks per heartbeat
> -----------------------------------------------------------------
>                 Key: HADOOP-5090
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5090
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/capacity-sched
>            Reporter: Arun C Murthy
>            Priority: Critical
>         Attachments: HADOOP-5090-20090504.txt
> HADOOP-3136 changed the default o.a.h.mapred.JobQueueTaskScheduler to assign multiple
tasks per TaskTracker heartbeat, the capacity-scheduler should do the same.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message