hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-11685) Restarting Metastore kills Compactions
Date Fri, 28 Aug 2015 20:56:46 GMT
Eugene Koifman created HIVE-11685:
-------------------------------------

             Summary: Restarting Metastore kills Compactions
                 Key: HIVE-11685
                 URL: https://issues.apache.org/jira/browse/HIVE-11685
             Project: Hive
          Issue Type: Improvement
          Components: Metastore, Transactions
    Affects Versions: 1.0.1
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman


CompactorMR submits MR job to do compaction and waits for completion.
If the metastore need to be restarted, it will kill in-flight compactions.

I ideally we'd want to add job ID to the COMPACTION_QUEUE table (and include that in SHOW
COMPACTIONS) and poll for it or register a callback so that the job survives Metastore restart



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message