hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saket Saurabh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-14035) Enable predicate pushdown to delta files created by ACID Transactions
Date Thu, 16 Jun 2016 18:13:05 GMT
Saket Saurabh created HIVE-14035:
------------------------------------

             Summary: Enable predicate pushdown to delta files created by ACID Transactions
                 Key: HIVE-14035
                 URL: https://issues.apache.org/jira/browse/HIVE-14035
             Project: Hive
          Issue Type: New Feature
          Components: Transactions
            Reporter: Saket Saurabh
            Priority: Minor


In current Hive version, delta files created by ACID transactions do not allow predicate pushdown
if they contain any update/delete events. This is done to preserve correctness when following
a multi-version approach during event collapsing, where an update event overwrites an existing
insert event. 
This JIRA proposes to split an update event into a combination of a delete event followed
by a new insert event, that can enable predicate push down to all delta files without breaking
correctness. To support backward compatibility for this feature, this JIRA also proposes to
add some sort of versioning to ACID that can allow different versions of ACID transactions
to co-exist together.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message