hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Johnson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2777) ability to add and drop partitions atomically
Date Wed, 17 May 2017 03:52:04 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013475#comment-16013475
] 

Ben Johnson commented on HIVE-2777:
-----------------------------------

Apologies for digging up an old issue, but was this ever resolved? [~aniket486] did you find
a work around for this? We're also storing data on S3 and need a way to atomically merge data.
Hive's CONCATENATE feature is not sufficient as it introduces a brief period where data just
disappears and the reappears. I'd love to hear solutions to this if anyone has them. Thanks!

> ability to add and drop partitions atomically
> ---------------------------------------------
>
>                 Key: HIVE-2777
>                 URL: https://issues.apache.org/jira/browse/HIVE-2777
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>    Affects Versions: 0.13.0
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>         Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2777.D2271.1.patch, hive-2777-updated.patch
>
>
> Hive should have ability to atomically add and drop partitions. This way admins can change
partitions atomically without breaking the running jobs. It allows admin to merge several
partitions into one.
> Essentially, we would like to have an api- add_drop_partitions(String db, String tbl_name,
List<Partition> addParts, List<List<String>> dropParts, boolean deleteData);
> This jira covers changes required for metastore and thrift.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message