hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1100) Make it possible for users to retry map-reduce jobs in a single Hive query
Date Mon, 22 Feb 2010 20:01:28 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836867#action_12836867
] 

John Sichi commented on HIVE-1100:
----------------------------------

Mentioned to Zheng that we need to watch out for the case where there's a software upgrade
in the middle and the old serialized plan is not compatible with the new software.  We could
require developers to take this into account when changing serialized plan structures (to
make sure the new code can handle old structures or fail with a clean explanation), but it
may be simpler just to stamp the serialized plan with the version of the code that generated
it and then check this when deserializing it, failing with an incompatibility error if it
differs.


> Make it possible for users to retry map-reduce jobs in a single Hive query
> --------------------------------------------------------------------------
>
>                 Key: HIVE-1100
>                 URL: https://issues.apache.org/jira/browse/HIVE-1100
>             Project: Hadoop Hive
>          Issue Type: New Feature
>    Affects Versions: 0.6.0
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>
> Sometimes a single hive query get compiled into several map-reduce jobs, and one of the
jobs failed because of some transient errors.
> Users would need to start from scratch.
> We should allow the user to start from the point of failure to continue the query.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message