hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13849) Wrong plan for hive.optimize.sort.dynamic.partition=true
Date Mon, 30 May 2016 22:47:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306994#comment-15306994
] 

Jesus Camacho Rodriguez commented on HIVE-13849:
------------------------------------------------

{noformat}
Test Name	Duration	Age
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_optimization	2 min 4
sec	1
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_opt_vectorization	1 min
13 sec	1
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join32	7.2 sec	1
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_select_read_only_encrypted_tbl
1 min 38 sec	1
 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
1 min 37 sec	1
 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization	2
min 11 sec	1
 org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
1 min 11 sec	1
 org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler
1 min 11 sec	1
 org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorWithinDagPriority
5 sec	1
 org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService.testPreemptionQueueComparator
5 sec	4
 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_constprog_partitioner
3.1 sec	33
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_static
1 min 28 sec	49
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
1 min 19 sec	49
 org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForMemoryTokenStore	2.6
sec	49
 org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForDBTokenStore	0.34 sec
49
 org.apache.hive.minikdc.TestMiniHiveKdc.testLogin	1 min 53 sec	49
 org.apache.hadoop.hive.llap.tez.TestConverters.testFragmentSpecToTaskSpec	82 ms	69
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_selectindate	13 sec	101
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avrocountemptytbl	9.9 sec	101
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order_null	33 sec	101
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_join_with_different_encryption_keys
1 min 33 sec	101
 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3	9.6 sec
101
 org.apache.hadoop.hive.cli.TestMinimrCliDriver.org.apache.hadoop.hive.cli.TestMinimrCliDriver
1 min 8 sec	101
{noformat}

> Wrong plan for hive.optimize.sort.dynamic.partition=true
> --------------------------------------------------------
>
>                 Key: HIVE-13849
>                 URL: https://issues.apache.org/jira/browse/HIVE-13849
>             Project: Hive
>          Issue Type: Bug
>          Components: Physical Optimizer
>    Affects Versions: 2.1.0, 2.2.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Critical
>         Attachments: HIVE-13849.patch
>
>
> To reproduce:
> {noformat}
> set hive.support.concurrency=true;
> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.optimize.sort.dynamic.partition=true;
> CREATE TABLE non_acid(key string, value string) PARTITIONED BY(ds string, hr int) CLUSTERED
BY(key) INTO 2 BUCKETS STORED AS ORC;
> explain insert into table non_acid partition(ds,hr) select * from srcpart sort by value;
> {noformat}
> CC'ed [~ashutoshc], [~ekoifman]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message