hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11550) ACID queries pollute HiveConf
Date Thu, 05 May 2016 23:23:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273310#comment-15273310
] 

Eugene Koifman commented on HIVE-11550:
---------------------------------------

Test failures not related
{noformat}
Test Name Duration Age
 org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService.testDelayedLocalityNodeCommErrorImmediateAllocation
10 sec	1
 org.apache.hadoop.hive.llap.daemon.impl.comparator.TestShortestJobFirstComparator.testWaitQueueComparatorWithinDagPriority
5 sec	1
 org.apache.hadoop.hive.llap.tez.TestConverters.testFragmentSpecToTaskSpec	69 ms	2
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
1 min 12 sec	2
 org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveOperationType.checkHiveOperationTypeMatch
59 ms	2
 org.apache.hive.service.cli.session.TestHiveSessionImpl.testLeakOperationHandle	37 sec	2
 org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService.testPreemptionQueueComparator
5 sec	2
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_select_read_only_encrypted_tbl
1 min 24 sec	6
 org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskCommunicator.testFinishableStateUpdateFailure
3.9 sec	15
 org.apache.hadoop.hive.metastore.TestHiveMetaStoreGetMetaConf.testGetMetaConfDefault	10 sec
29
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_static
2 min 16 sec	30
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_selectindate	16 sec	34
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avrocountemptytbl	11 sec	34
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order_null	36 sec	34
 org.apache.hive.hcatalog.api.repl.commands.TestCommands.org.apache.hive.hcatalog.api.repl.commands.TestCommands
21 sec	34
 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_join_with_different_encryption_keys
1 min 51 sec	34
 org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForMemoryTokenStore	1.4
sec	34
 org.apache.hive.minikdc.TestHiveAuthFactory.testStartTokenManagerForDBTokenStore	0.28 sec
34
 org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testGetPartitionSpecs_WithAndWithoutPartitionGrouping
3.1 sec	34
 org.apache.hive.minikdc.TestMiniHiveKdc.testLogin	1 min 30 sec	34
 org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver_index_bitmap3	8.5 sec
34
 org.apache.hadoop.hive.cli.TestMinimrCliDriver.org.apache.hadoop.hive.cli.TestMinimrCliDriver
1 min 10 sec	34
{noformat}

[~alangates], could you review please

> ACID queries pollute HiveConf
> -----------------------------
>
>                 Key: HIVE-11550
>                 URL: https://issues.apache.org/jira/browse/HIVE-11550
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>         Attachments: HIVE-11550.1.patch, HIVE-11550.patch
>
>
> HiveConf is a SessionState level object.  Some ACID related logic makes changes to it
(which are meant to be per query) but become per SessionState.
> See SemanticAnalyzer.checkAcidConstraints()
> Also note       HiveConf.setVar(conf, HiveConf.ConfVars.DYNAMICPARTITIONINGMODE, "nonstrict");
> in UpdateDeleteSemancitAnalzyer
> [~alangates], do you know of other cases or ideas on how to deal with this differently?
> _SortedDynPartitionOptimizer.process()_ is the place to have the logic to do _conf.setBoolVar(ConfVars.HIVEOPTSORTDYNAMICPARTITION,
false);_ on per query basis



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message