hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20316) Skip external table file listing for create table event.
Date Thu, 09 Aug 2018 05:02:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574294#comment-16574294
] 

Sankar Hariappan commented on HIVE-20316:
-----------------------------------------

[~anishek],

As per discussion with [~thejas], it is decided that we disable file listing for external
table always as we currently claim that external table replication is not supported. 

Also, since design for external table replication is in progress and when we finalise it,
shall decide if we need to do the listing while repl dump or depend on external module such
as HDFS replication.

> Skip external table file listing for create table event.
> --------------------------------------------------------
>
>                 Key: HIVE-20316
>                 URL: https://issues.apache.org/jira/browse/HIVE-20316
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog, repl
>    Affects Versions: 3.1.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: DR, pull-request-available, replication
>         Attachments: HIVE-20316.01.patch, HIVE-20316.02.patch, HIVE-20316.03.patch
>
>
> We are currently skipping external table replication. We shall also skip listing all
the files in create table event generation for external tables. External tables might have
very large number of files, so it would take long time to list them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message