hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-21679) Replicating a CTAS event creating an MM table fails.
Date Tue, 07 May 2019 14:49:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21679?focusedWorklogId=238530&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-238530
]

ASF GitHub Bot logged work on HIVE-21679:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 07/May/19 14:48
            Start Date: 07/May/19 14:48
    Worklog Time Spent: 10m 
      Work Description: sankarh commented on pull request #617: HIVE-21679: Replicating a
CTAS event creating an MM table fails.
URL: https://github.com/apache/hive/pull/617#discussion_r281668888
 
 

 ##########
 File path: itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestReplicationScenariosAcidTables.java
 ##########
 @@ -662,4 +662,40 @@ public void testMultiDBTxn() throws Throwable {
     replica.run("drop database " + dbName1 + " cascade");
     replica.run("drop database " + dbName2 + " cascade");
   }
+
+  @Test
+  public void testCtasMmTable() throws Throwable {
+    String tableName = testName.getMethodName();
+    String[] resultArray = new String[]{ "1", "3" };
+    String tableProperties = "\"transactional\"=\"true\", \"transactional_properties\"=\"insert_only\"";
+
+    // Create a non-acid table and replicate it.
+    WarehouseInstance.Tuple bootStrapDump = primary.run("use " + primaryDbName)
+            .run("create table t1_nonacid (a int, b int)")
 
 Review comment:
   I think, it is better to have new test case here instead of editing incremental acid test
suit which is already heavy.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 238530)
    Time Spent: 1h  (was: 50m)

> Replicating a CTAS event creating an MM table fails.
> ----------------------------------------------------
>
>                 Key: HIVE-21679
>                 URL: https://issues.apache.org/jira/browse/HIVE-21679
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 4.0.0
>            Reporter: Ashutosh Bapat
>            Assignee: Sankar Hariappan
>            Priority: Major
>              Labels: CTAS, pull-request-available
>         Attachments: HIVE-21679.01.patch
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> use dumpdb;
> create table t1 (a int, b int);
> insert into t1 values (1, 2), (3, 4);
> create table t6_mm_part partitioned by (a) stored as orc tblproperties ("transactional"="true",
"transactional_properties"="insert_only") as select * from t1
> create table t6_mm stored as orc tblproperties ("transactional"="true", "transactional_properties"="insert_only")
as select * from t1;
> repl dump dumpdb;
> create table t6_mm_part_2 partitioned by (a) stored as orc tblproperties ("transactional"="true",
"transactional_properties"="insert_only") as select * from t1;
> create table t6_mm_2 partitioned by (a) stored as orc tblproperties ("transactional"="true",
"transactional_properties"="insert_only") as select * from t1;
> repl dump dumpdb from <last repl id>
> repl load loaddb from '/tmp/dump/next';
> {code}
> ERROR : failed replication
> org.apache.hadoop.hive.ql.parse.SemanticException: Invalid table name loaddb.dumpdb.t6_mm_part_2
>  at org.apache.hadoop.hive.ql.exec.Utilities.getDbTableName(Utilities.java:2253) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.Utilities.getDbTableName(Utilities.java:2239) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.plan.AlterTableDesc.setOldName(AlterTableDesc.java:419)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.incremental.IncrementalLoadTasksBuilder.tableUpdateReplStateTask(IncrementalLoadTasksBuilder.java:286)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.incremental.IncrementalLoadTasksBuilder.addUpdateReplStateTasks(IncrementalLoadTasksBuilder.java:371)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.incremental.IncrementalLoadTasksBuilder.analyzeEventLoad(IncrementalLoadTasksBuilder.java:244)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.incremental.IncrementalLoadTasksBuilder.build(IncrementalLoadTasksBuilder.java:139)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.ReplLoadTask.executeIncrementalLoad(ReplLoadTask.java:488)
~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.repl.ReplLoadTask.execute(ReplLoadTask.java:102) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2709) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2361) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2028) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1788) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1782) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:162) ~[hive-exec-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:233)
~[hive-service-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hive.service.cli.operation.SQLOperation.access$600(SQLOperation.java:88)
~[hive-service-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:332)
~[hive-service-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_191]
>  at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_191]
>  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1688)
~[hadoop-common-3.1.0.3.0.0.0-1634.jar:?]
>  at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:350)
~[hive-service-4.0.0-SNAPSHOT.jar:4.0.0-SNAPSHOT]
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_191]
>  at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_191]
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_191]
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_191]
>  at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
> ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.repl.ReplLoadTask.
Invalid table name loaddb.dumpdb.t6_mm_part_2
> Error: Error while processing statement: FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.repl.ReplLoadTask. Invalid table name loaddb.dumpdb.t6_mm_part_2
(state=42000,code=1)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message