hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amir Youssefi (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (HADOOP-3700) Define User exception which can be thrown by user code to skip records
Date Wed, 20 Aug 2008 11:34:51 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623959#action_12623959
] 

amirhyoussefi edited comment on HADOOP-3700 at 8/20/08 4:34 AM:
----------------------------------------------------------------

User can simply skip calling collect and exception doesn't seem to be necessary.

      was (Author: amirhyoussefi):
    For mapper, user can simply skip calling collect and exception doesn't seem to be necessary.
  
> Define User exception which can be thrown by user code to skip records
> ----------------------------------------------------------------------
>
>                 Key: HADOOP-3700
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3700
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Sharad Agarwal
>
> Currently there is no way, where user code can throw a specific Exception to notify the
framework about skipping that record and move forward. 
> This can be implemented in map, reduce, combine, and output format (maybe) as well as
input method.
> To get the skip behavior, the user needs to write code that throws these exceptions,
so this would not change the systems default behavior. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message