hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yiping Han (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2162) Provide last failure point when retry a mapper task
Date Tue, 06 Nov 2007 20:04:51 GMT
Provide last failure point when retry a mapper task
---------------------------------------------------

                 Key: HADOOP-2162
                 URL: https://issues.apache.org/jira/browse/HADOOP-2162
             Project: Hadoop
          Issue Type: New Feature
            Reporter: Yiping Han


Currently when a mapper failed and get restarted, the restarted mapper can find out if itself
is a retry or the first try from the task name. We want to also know where in the input the
last try failed. 

With the last failure point, our mapper can then do something different for the particular
input. The failure point does not necessary to be very accurate. The reason we ask for this
instead of let hadoop to deal with the failure record is, in such a way we can do something
special for the failure record instead of simply skip it.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message