hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3478) The algorithm to decide map re-execution on fetch failures can be improved
Date Mon, 02 Jun 2008 14:43:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12601640#action_12601640
] 

Arun C Murthy commented on HADOOP-3478:
---------------------------------------

Jothi, the reason you don't want to sort by MapId is HADOOP-1270. Given that it is quite hard
to sort by MapId for a given location.

The one option is to schedule *some* failed fetches before the normal ones in {{ReduceCopier.fetchOutputs}},
however it is very real that Jetty on the task-tracker is stuck for a few seconds and then
untangles itself, please keep that in mind too.

> The algorithm to decide map re-execution on fetch failures can be improved
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-3478
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3478
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Jothi Padmanabhan
>
> The algorithm to decide map re-execution on fetch failures can be improved.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message