hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1198) Alternatively schedule different types of tasks in fair share scheduler
Date Fri, 20 Nov 2009 07:49:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780477#action_12780477

Matei Zaharia commented on MAPREDUCE-1198:

This looks good, the two hashsets are a good idea. I'll take another quick look at it tomorrow
and commit it.

> Alternatively schedule different types of tasks in fair share scheduler
> -----------------------------------------------------------------------
>                 Key: MAPREDUCE-1198
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1198
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/fair-share
>    Affects Versions: 0.22.0
>            Reporter: Scott Chen
>            Assignee: Scott Chen
>             Fix For: 0.22.0
>         Attachments: MAPREDUCE-1198-v1.patch, MAPREDUCE-1198-v2.patch, MAPREDUCE-1198-v3.patch,
MAPREDUCE-1198-v4.patch, MAPREDUCE-1198-v5.patch
> Matei has mentioned in MAPREDUCE-961 that the current scheduler will first try to launch
map tasks until canLaunthTask() returns false then look for reduce tasks. This might starve
reduce task. He also mention that alternatively schedule different types of tasks can solve
this problem.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message