hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18750) Exchange partition should be disabled on ACID/Insert-only tables with per table write ID.
Date Wed, 28 Feb 2018 22:16:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381107#comment-16381107
] 

Eugene Koifman commented on HIVE-18750:
---------------------------------------

+1 assuming tests are good

> Exchange partition should be disabled on ACID/Insert-only tables with per table write
ID.
> -----------------------------------------------------------------------------------------
>
>                 Key: HIVE-18750
>                 URL: https://issues.apache.org/jira/browse/HIVE-18750
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, Transactions
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: ACID, DDL, TODOC3.0, pull-request-available
>             Fix For: 3.0.0
>
>         Attachments: HIVE-18750.01.patch, HIVE-18750.02.patch
>
>
> Per table write id implementation (HIVE-18192) have introduced write ID per table and
used write ID to name the delta/base files and also as primary key for each row.
> Now, exchange partition have to move delta/base files across tables without changing
the write ID which causes incorrect results. 
> Also, this exchange partition feature is there to support the use-case of atomic updates.
But with ACID updates, we shall support atomic-updates and hence it makes sense to not support
exchange partition for ACID and MM tables.
> The qtest file mm_exchangepartition.q test results to be updated after this change.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message