hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Voros (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17526) Disable conversion to ACID if table has _copy_N files on branch-1
Date Wed, 13 Sep 2017 14:48:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Voros updated HIVE-17526:
--------------------------------
    Attachment: HIVE-17526.1-branch-1.patch

Attaching patch #1. This adds a check to TransactionalValidationListener so it won't allow
the conversion if there are *_copy_N files in the table.

> Disable conversion to ACID if table has _copy_N files on branch-1
> -----------------------------------------------------------------
>
>                 Key: HIVE-17526
>                 URL: https://issues.apache.org/jira/browse/HIVE-17526
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Daniel Voros
>            Assignee: Daniel Voros
>             Fix For: 1.3.0
>
>         Attachments: HIVE-17526.1-branch-1.patch
>
>
> As discussed in HIVE-16177, non-ACID to ACID conversion can lead to data loss if the
table has *_copy_N files.
> The patch for HIVE-16177 is quite massive and would basically need a reimplementation
to apply for branch-1 since the related code paths have diverged a lot. We could disable the
conversion to ACID if there are *_copy_N files instead.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message