hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Commented] (HIVE-15899) check CTAS over acid table
Date Thu, 04 May 2017 22:37:04 GMT


Eugene Koifman commented on HIVE-15899:

CTAS doesn't support bucketed or partitioned tables.  ErrorMsgs.CTAS_PARCOL_COEXISTENCE.
Bucketing is currently required for Acid.

in TestAcidOnTez
  public void testUnion() throws Exception {
    runStatementOnDriver("create temporary table if not exists data1 (x int)");
    runStatementOnDriver("create temporary table if not exists data2 (x int)");

    runStatementOnDriver("insert into data1 values (1),(2),(3)");
    runStatementOnDriver("insert into data2 values (4),(5),(6)");
    HiveConf hc = new HiveConf(hiveConf);
    hc.setVar(HiveConf.ConfVars.DYNAMICPARTITIONINGMODE, "nonstrict");
    hc.setBoolVar(HiveConf.ConfVars.HIVE_EXPLAIN_USER, false);
    d = new Driver(hc);
    r = runStatementOnDriver("create table srcpart3 stored as orc as select x, 1, 2 from data1
union all select x, 3, 4 from data2");

This creates a file system layout with 2 subfolders

ekoifman:apache-hive-3.0.0-SNAPSHOT-bin ekoifman$ ./bin/hive --orcfiledump -j -p -d /Users/ekoifman/dev/hiverwgit/itests/hive-unit/target/tmp/org.apache.hadoop.hive.ql.TestAcidOnTez-1493936793357/warehouse/srcpart3/
Processing data file file:/Users/ekoifman/dev/hiverwgit/itests/hive-unit/target/tmp/org.apache.hadoop.hive.ql.TestAcidOnTez-1493936793357/warehouse/srcpart3/1/000000_0
[length: 291]

Processing data file file:/Users/ekoifman/dev/hiverwgit/itests/hive-unit/target/tmp/org.apache.hadoop.hive.ql.TestAcidOnTez-1493936793357/warehouse/srcpart3/2/000000_0
[length: 295]


> check CTAS over acid table 
> ---------------------------
>                 Key: HIVE-15899
>                 URL:
>             Project: Hive
>          Issue Type: Task
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
> need to add a test to check if create table as works correctly with acid tables

This message was sent by Atlassian JIRA

View raw message