hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasad Chakka (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-480) allow option to retry map-reduce tasks
Date Fri, 12 Jun 2009 18:18:07 GMT

    [ https://issues.apache.org/jira/browse/HIVE-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12718928#action_12718928
] 

Prasad Chakka commented on HIVE-480:
------------------------------------

if all queries go through Hive Server, it can figure out when to start queuing queries to
be executed when the cluster comes back either.

can we integrate the code that Pete wrote to figure out whether cluster is up or not into
Hive CLI so that we can display a neat message to user that cluster is not available?

> allow option to retry map-reduce tasks
> --------------------------------------
>
>                 Key: HIVE-480
>                 URL: https://issues.apache.org/jira/browse/HIVE-480
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
>         Attachments: HIVE-480.1.patch
>
>
> for long running queries with multiple map-reduce jobs - this should help in dealing
with any transient cluster failures without having to re-running all the tasks.
> ideally - the entire plan can be serialized out and the actual process of executing the
workflow can be left to a pluggable workflow execution engine (since this is a problem that
has been solved many times already).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message