hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amir Youssefi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3973) Breaking out of a task
Date Wed, 20 Aug 2008 11:12:47 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623957#action_12623957
] 

Amir Youssefi commented on HADOOP-3973:
---------------------------------------

Changing Signature of Reporter methods may not have any backward compatibility issues. Adding
extra attribute, setter... or using current setStatus() with a pre-defined String will do.

I think exception method is cleaner because flag (a Config Setting) is not necessary to remedy
performance issue. 

We are still discussing Map . Regarding Map and HADOOP-3700 , user can simply skip calling
collect and there doesn't seem to be a need for an exception.

> Breaking out of a task
> ----------------------
>
>                 Key: HADOOP-3973
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3973
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Amir Youssefi
>
> Occasionally a mapper/reducer is done without need to see more input data. If we provide
a way to break out and skip reading the rest of input then job finishs earlier and resources
are spared.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message