hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-19598) Add Acid V1 to V2 upgrade module
Date Thu, 31 May 2018 20:38:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-19598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ashutosh Chauhan updated HIVE-19598:
------------------------------------
       Resolution: Fixed
    Fix Version/s: 4.0.0
           Status: Resolved  (was: Patch Available)

Pushed to master. Thanks, Eugene!
[~vgarg] Can we have this on branch-3 as well since its very useful for users to help them
migrate to Acid V2.

> Add Acid V1 to V2 upgrade module
> --------------------------------
>
>                 Key: HIVE-19598
>                 URL: https://issues.apache.org/jira/browse/HIVE-19598
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Transactions
>    Affects Versions: 3.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Critical
>             Fix For: 4.0.0
>
>         Attachments: HIVE-19598.02.patch, HIVE-19598.05.patch, HIVE-19598.06.patch
>
>
> The on-disk layout for full acid (transactional) tables has changed 3.0.
> Any transactional table that has any update/delete events in any deltas that have not
been Major compacted, must go through a Major compaction before upgrading to 3.0.  No more
update/delete/merge should be run after/during major compaction.
> Not doing so will result in data corruption/loss.
>  
> Need to create a utility tool to help with this process.  HIVE-19233 started this but
it needs more work.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message