hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-21471) Replicating conversion of managed to external table leaks HDFS files at target.
Date Mon, 25 Mar 2019 03:34:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21471?focusedWorklogId=217809&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-217809
]

ASF GitHub Bot logged work on HIVE-21471:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 25/Mar/19 03:33
            Start Date: 25/Mar/19 03:33
    Worklog Time Spent: 10m 
      Work Description: sankarh commented on pull request #578: HIVE-21471: Replicating conversion
of managed to external table leaks HDFS files at target.
URL: https://github.com/apache/hive/pull/578#discussion_r268480113
 
 

 ##########
 File path: itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestReplicationScenariosExternalTables.java
 ##########
 @@ -673,6 +674,59 @@ public void retryIncBootstrapExternalTablesFromDifferentDumpWithoutCleanTablesCo
             ErrorMsg.REPL_BOOTSTRAP_LOAD_PATH_NOT_VALID.getErrorCode());
   }
 
+  @Test
+  public void dynamicallyConvertManagedToExternalTable() throws Throwable {
+    List<String> dumpWithClause = Collections.singletonList(
+            "'" + HiveConf.ConfVars.REPL_INCLUDE_EXTERNAL_TABLES.varname + "'='true'"
+    );
+    List<String> loadWithClause = externalTableBasePathWithClause();
+
+    WarehouseInstance.Tuple tupleBootstrapManagedTable = primary.run("use " + primaryDbName)
+            .run("create table t1 (id int)")
+            .run("insert into table t1 values (1)")
+            .run("create table t2 (id int) partitioned by (key int)")
 
 Review comment:
   It is not acid table. It is non-acid managed table.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 217809)
    Time Spent: 5h 40m  (was: 5.5h)

> Replicating conversion of managed to external table leaks HDFS files at target.
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-21471
>                 URL: https://issues.apache.org/jira/browse/HIVE-21471
>             Project: Hive
>          Issue Type: Bug
>          Components: repl
>    Affects Versions: 4.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: DR, pull-request-available, replication
>         Attachments: HIVE-21471.01.patch, HIVE-21471.02.patch, HIVE-21471.03.patch
>
>          Time Spent: 5h 40m
>  Remaining Estimate: 0h
>
> While replicating the ALTER event to convert managed table to external table, the data
location for the table is changed under input base directory for external tables replication.
But, the old location remains there and would be leaked for ever.
> ALTER TABLE T1 SET TBLPROPERTIES('EXTERNAL'='true');



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message