hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException
Date Mon, 16 Aug 2010 21:24:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899098#action_12899098
] 

He Yongqiang commented on HIVE-1543:
------------------------------------

let's do it in HiveContextAwareRecordReader. And maybe store the var in IOContext?

> set abort in ExecMapper when Hive's record reader got an IOException
> --------------------------------------------------------------------
>
>                 Key: HIVE-1543
>                 URL: https://issues.apache.org/jira/browse/HIVE-1543
>             Project: Hadoop Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1543.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close the operators
as if there is not error. We should catch this exception and avoid writing partial results
to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message