hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-4788) Set mapred.fairscheduler.assignmultiple to true by default
Date Fri, 20 Mar 2009 00:39:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matei Zaharia updated HADOOP-4788:
----------------------------------

    Attachment: hadoop-4788-v0.patch

Here's a patch that fixes this. It leaves assignmultiple off in the unit tests for ease of
testing however.

> Set mapred.fairscheduler.assignmultiple to true by default
> ----------------------------------------------------------
>
>                 Key: HADOOP-4788
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4788
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: contrib/fair-share
>            Reporter: Matei Zaharia
>            Priority: Trivial
>         Attachments: hadoop-4788-v0.patch
>
>
> Pretty much all users of the fair scheduler are using the "assignmultiple" feature which
lets it launch reduce tasks at the same time as map tasks (on the same heartbeats), leading
to reduces starting faster. This is also going to happen in Hadoop by default in HADOOP-3136.
So we should set it to true by default and perhaps even remove the config parameter.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message