hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <>
Subject [jira] [Commented] (HIVE-19598) Acid V1 to V2 upgrade
Date Sat, 26 May 2018 16:52:00 GMT


Ashutosh Chauhan commented on HIVE-19598:

Changes in packaging/pom.xml will bundle this jar with 3.0 distro. But since it declares dependency
on hive-2.3.3 I suspect it will package hive-2.3 jars as well which may be trouble. I think
all dependencies of this module should be excluded from packaging and should only contain
this jar only.

> Acid V1 to V2 upgrade
> ---------------------
>                 Key: HIVE-19598
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 3.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Critical
>         Attachments: HIVE-19598.02.patch, HIVE-19598.05.patch
> The on-disk layout for full acid (transactional) tables has changed 3.0.
> Any transactional table that has any update/delete events in any deltas that have not
been Major compacted, must go through a Major compaction before upgrading to 3.0.  No more
update/delete/merge should be run after/during major compaction.
> Not doing so will result in data corruption/loss.
> Need to create a utility tool to help with this process.  HIVE-19233 started this but
it needs more work.

This message was sent by Atlassian JIRA

View raw message