hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3601) Add Delay Scheduling to MR2 Fair Scheduler
Date Wed, 04 Jan 2012 00:50:39 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Patrick Wendell updated MAPREDUCE-3601:

    Attachment: MAPREDUCE-3601.v1.patch

Attached is a patch to implement delay scheduling in MR2, similar to how delay scheduling
works in the MR1 Fair Scheduler. 

This patch allows schedulers to triage locality levels from node-local, to rack-local, to
off-switch requests over time. In the Fair schedulers, users can configure a threshold to
dictate when this relaxation happens.

The Capacity Scheduler is left untouched (it currently uses a separate heuristic to failover
to off-switch scheduling).

This patch assumes the patch attached to MAPREDUCE-3600 has already been applied.

> Add Delay Scheduling to MR2 Fair Scheduler
> ------------------------------------------
>                 Key: MAPREDUCE-3601
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3601
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: scheduler
>            Reporter: Patrick Wendell
>            Assignee: Patrick Wendell
>         Attachments: MAPREDUCE-3601.v1.patch
> JIRA for delay scheduling component.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message