hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amir Youssefi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3973) Breaking out of a task
Date Wed, 20 Aug 2008 11:12:47 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623957#action_12623957

Amir Youssefi commented on HADOOP-3973:

Changing Signature of Reporter methods may not have any backward compatibility issues. Adding
extra attribute, setter... or using current setStatus() with a pre-defined String will do.

I think exception method is cleaner because flag (a Config Setting) is not necessary to remedy
performance issue. 

We are still discussing Map . Regarding Map and HADOOP-3700 , user can simply skip calling
collect and there doesn't seem to be a need for an exception.

> Breaking out of a task
> ----------------------
>                 Key: HADOOP-3973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3973
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Amir Youssefi
> Occasionally a mapper/reducer is done without need to see more input data. If we provide
a way to break out and skip reading the rest of input then job finishs earlier and resources
are spared.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message