hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-343) In case of dead task tracker, the copy mapouts try copying all mapoutputs from this tasktracker
Date Wed, 05 Jul 2006 22:25:30 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-343?page=comments#action_12419349 ] 

Owen O'Malley commented on HADOOP-343:
--------------------------------------

I have concerns about this patch. It might have unintended consequences. In particular, if
a node is slow you'll drop what you know about that node and put more load on the job tracker.
This patch is certainly addressing a real problem, though.

> In case of dead task tracker, the copy mapouts try copying all mapoutputs from this tasktracker
> -----------------------------------------------------------------------------------------------
>
>          Key: HADOOP-343
>          URL: http://issues.apache.org/jira/browse/HADOOP-343
>      Project: Hadoop
>         Type: Bug

>   Components: mapred
>     Versions: 0.5.0
>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>  Attachments: bugfix.patch
>
> In case of a dead task tracker, the reduces which do not have the updated map out locations
try copygin files from this node and since there are failures on copying, this leads to backoff
and slowing down of the copy pahse.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


Mime
View raw message