hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-16706) Bootstrap REPL DUMP shouldn't fail when a partition is dropped/renamed when dump in progress.
Date Tue, 23 May 2017 17:04:04 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sankar Hariappan updated HIVE-16706:
------------------------------------
    Attachment: HIVE-16706.01.patch

Added 01.patch with below changes:
- No source code changes as the issue doesn't exist. 
- There are 2 metastore apis getting called by PartitionIterable during bootstrap dump; listPartitionNames
(without part_spec) and getPartitionsByNames. Both these methods never fail if a table or
partition is dropped in between. Just return an empty list.
- Added a test case to verify if bootstrap dump fails when we return empty string from megastore
apis.

Request [~sushanth]/[~thejas] to review the patch!

> Bootstrap REPL DUMP shouldn't fail when a partition is dropped/renamed when dump in progress.
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-16706
>                 URL: https://issues.apache.org/jira/browse/HIVE-16706
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive, repl
>    Affects Versions: 2.1.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DR, replication
>         Attachments: HIVE-16706.01.patch
>
>
> Currently, bootstrap REPL DUMP gets the partitions in a batch and then iterate through
it. If any partition is dropped/renamed during iteration, it may lead to failure/exception.
In this case, the partition should be skipped from dump and also need to ensure no failure
of REPL DUMP and the subsequent incremental dump should ensure the consistent state of the
table.
> This bug is related to HIVE-16684.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message