hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero
Date Wed, 28 Jun 2017 15:30:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066705#comment-16066705
] 

Hive QA commented on HIVE-16972:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12874871/HIVE-16972.3.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 338 failed/errored test(s), 10202 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[create_merge_compressed] (batchId=238)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin] (batchId=10)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[delete_all_non_partitioned] (batchId=27)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[delete_all_partitioned] (batchId=27)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_binary_binary] (batchId=94)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_binary_external_table_queries]
(batchId=95)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_binary_storage_queries]
(batchId=95)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_custom_key2] (batchId=93)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_custom_key3] (batchId=92)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_custom_key] (batchId=92)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_ddl] (batchId=94)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_handler_snapshot] (batchId=95)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_ppd_join] (batchId=94)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_ppd_key_range] (batchId=93)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_pushdown] (batchId=93)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_queries] (batchId=94)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_scan_params] (batchId=96)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_timestamp] (batchId=95)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[hbase_timestamp_format] (batchId=96)
org.apache.hadoop.hive.cli.TestHBaseCliDriver.testCliDriver[ppd_key_ranges] (batchId=92)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_all_non_partitioned]
(batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[delete_all_partitioned]
(batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[load_dyn_part5] (batchId=153)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[tez_smb_main] (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr] (batchId=146)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver
(batchId=168)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver
(batchId=169)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver
(batchId=170)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=233)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query16] (batchId=233)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query94] (batchId=233)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=100)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=101)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=102)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=103)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=104)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=105)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=106)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=107)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=108)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=109)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=110)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=111)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=112)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=113)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=114)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=115)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=116)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=117)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=118)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=119)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=120)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=121)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=122)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=123)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=124)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=125)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=126)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=127)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=128)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=129)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=130)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=131)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=132)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=133)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=134)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=135)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=136)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=137)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=138)
org.apache.hadoop.hive.cli.TestSparkCliDriver.org.apache.hadoop.hive.cli.TestSparkCliDriver
(batchId=139)
org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver
(batchId=240)
org.apache.hadoop.hive.ql.TestAcidOnTez.testMapJoinOnMR (batchId=214)
org.apache.hadoop.hive.ql.TestTxnCommands2.testBucketizedInputFormat (batchId=269)
org.apache.hadoop.hive.ql.TestTxnCommands2.testSimpleRead (batchId=269)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testBootstrapFunctionReplication
(batchId=217)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testCreateFunctionIncrementalReplication
(batchId=217)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcrossInstances.testCreateFunctionWithFunctionBinaryJarsOnHDFS
(batchId=217)
org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.testStatsAfterCompactionPartTbl (batchId=215)
org.apache.hive.beeline.cli.TestHiveCli.testCmd (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testDatabaseOptions (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testNoErrorDB (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSetHeaderValue (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSetPromptValue (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd2 (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd3 (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSourceCmd4 (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSqlFromCmd (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testSqlFromCmdWithDBName (batchId=176)
org.apache.hive.beeline.cli.TestHiveCli.testVariablesForSource (batchId=176)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionRegistrationWithCustomSchema (batchId=178)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionSpecRegistrationWithCustomSchema
(batchId=178)
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation (batchId=178)
org.apache.hive.hcatalog.api.repl.commands.TestCommands.testBasicReplEximCommands (batchId=178)
org.apache.hive.hcatalog.api.repl.commands.TestCommands.testMetadataReplEximCommands (batchId=178)
org.apache.hive.hcatalog.cli.TestSemanticAnalysis.testAddReplaceCols (batchId=183)
org.apache.hive.hcatalog.cli.TestSemanticAnalysis.testAlterTableSetFF (batchId=183)
org.apache.hive.hcatalog.cli.TestSemanticAnalysis.testDescDB (batchId=183)
org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.testPigPopulation (batchId=231)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[0]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[1]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[2]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[3]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[6]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTable[0]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTable[1]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTable[2]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTable[3]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatDynamicPartitioned.testHCatDynamicPartitionedTable[6]
(batchId=185)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[0]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[1]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[2]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[3]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[6]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable[0]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable[1]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable[2]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable[3]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatDynamicPartitionedTable[6]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatExternalDynamicCustomLocation[0]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatExternalDynamicCustomLocation[1]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatExternalDynamicCustomLocation[2]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatExternalDynamicCustomLocation[3]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalDynamicPartitioned.testHCatExternalDynamicCustomLocation[6]
(batchId=187)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalNonPartitioned.testHCatNonPartitionedTable[0]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalNonPartitioned.testHCatNonPartitionedTable[1]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalNonPartitioned.testHCatNonPartitionedTable[2]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalNonPartitioned.testHCatNonPartitionedTable[3]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalNonPartitioned.testHCatNonPartitionedTable[6]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable[0]
(batchId=184)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable[1]
(batchId=184)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable[2]
(batchId=184)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable[3]
(batchId=184)
org.apache.hive.hcatalog.mapreduce.TestHCatExternalPartitioned.testHCatPartitionedTable[6]
(batchId=184)
org.apache.hive.hcatalog.mapreduce.TestHCatMultiOutputFormat.testOutputFormat (batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[0]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[1]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[2]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[3]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTableMultipleTask[6]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTable[0]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTable[1]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTable[2]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTable[3]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableDynamicPartitioned.testHCatDynamicPartitionedTable[6]
(batchId=182)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableNonPartitioned.testHCatNonPartitionedTable[0]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableNonPartitioned.testHCatNonPartitionedTable[1]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableNonPartitioned.testHCatNonPartitionedTable[2]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableNonPartitioned.testHCatNonPartitionedTable[3]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutableNonPartitioned.testHCatNonPartitionedTable[6]
(batchId=188)
org.apache.hive.hcatalog.mapreduce.TestHCatMutablePartitioned.testHCatPartitionedTable[0]
(batchId=186)
org.apache.hive.hcatalog.mapreduce.TestHCatMutablePartitioned.testHCatPartitionedTable[1]
(batchId=186)
org.apache.hive.hcatalog.mapreduce.TestHCatMutablePartitioned.testHCatPartitionedTable[2]
(batchId=186)
org.apache.hive.hcatalog.mapreduce.TestHCatMutablePartitioned.testHCatPartitionedTable[3]
(batchId=186)
org.apache.hive.hcatalog.mapreduce.TestHCatMutablePartitioned.testHCatPartitionedTable[6]
(batchId=186)
org.apache.hive.hcatalog.mapreduce.TestHCatNonPartitioned.testHCatNonPartitionedTable[0] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatNonPartitioned.testHCatNonPartitionedTable[1] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatNonPartitioned.testHCatNonPartitionedTable[2] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatNonPartitioned.testHCatNonPartitionedTable[3] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatNonPartitioned.testHCatNonPartitionedTable[6] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[0] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[1] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[2] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[3] (batchId=183)
org.apache.hive.hcatalog.mapreduce.TestHCatPartitioned.testHCatPartitionedTable[6] (batchId=183)
org.apache.hive.hcatalog.pig.TestAvroHCatLoader.testReadMissingPartitionBasicNeg (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatLoader.testReadPartitionedBasic (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testBagNStruct (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testDynamicPartitioningMultiPartColsInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testDynamicPartitioningMultiPartColsInDataPartialSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testMultiPartColsInData (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testStoreFuncAllSimpleTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testStoreFuncSimple (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testStoreMultiTables (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testStoreWithNoCtorArgs (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testStoreWithNoSchema (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteChar (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteDate (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteDate2 (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteDate3 (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteDecimal (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteDecimalX (batchId=181)
org.apache.hive.hcatalog.pig.TestAvroHCatStorer.testWriteVarchar (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatLoaderStorer.testReadWrite (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreBasicTable[0] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreBasicTable[1] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreBasicTable[2] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreBasicTable[3] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreBasicTable[5] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStorePartitionedTable[0] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStorePartitionedTable[1] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStorePartitionedTable[2] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStorePartitionedTable[3] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStorePartitionedTable[5] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreTableMulti[0] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreTableMulti[1] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreTableMulti[2] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreTableMulti[3] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerMulti.testStoreTableMulti[5] (batchId=181)
org.apache.hive.hcatalog.pig.TestHCatStorerWrapper.testStoreExternalTableWithExternalDir (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadMissingPartitionBasicNeg (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadPartitionedBasic (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testBagNStruct (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testDateCharTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testDynamicPartitioningMultiPartColsInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testDynamicPartitioningMultiPartColsInDataPartialSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testMultiPartColsInData (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testStoreFuncAllSimpleTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testStoreFuncSimple (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testStoreMultiTables (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testStoreWithNoCtorArgs (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testStoreWithNoSchema (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteChar (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDate (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDate2 (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDate3 (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDecimal (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDecimalX (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteDecimalXY (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteSmallint (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteTimestamp (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteTinyint (batchId=181)
org.apache.hive.hcatalog.pig.TestOrcHCatStorer.testWriteVarchar (batchId=181)
org.apache.hive.hcatalog.pig.TestParquetHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestParquetHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestParquetHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatLoader.testReadMissingPartitionBasicNeg (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatLoader.testReadPartitionedBasic (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testBagNStruct (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testDateCharTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testDynamicPartitioningMultiPartColsInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testDynamicPartitioningMultiPartColsInDataPartialSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testMultiPartColsInData (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testStoreFuncAllSimpleTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testStoreFuncSimple (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testStoreMultiTables (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testStoreWithNoCtorArgs (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testStoreWithNoSchema (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteChar (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDate (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDate2 (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDate3 (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDecimal (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDecimalX (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteDecimalXY (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteSmallint (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteTimestamp (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteTinyint (batchId=181)
org.apache.hive.hcatalog.pig.TestRCFileHCatStorer.testWriteVarchar (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatLoader.testReadMissingPartitionBasicNeg (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatLoader.testReadPartitionedBasic (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testBagNStruct (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testDateCharTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testDynamicPartitioningMultiPartColsInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testDynamicPartitioningMultiPartColsInDataPartialSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testMultiPartColsInData (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testStoreFuncAllSimpleTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testStoreFuncSimple (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testStoreMultiTables (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testStoreWithNoCtorArgs (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testStoreWithNoSchema (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteChar (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDate (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDate2 (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDate3 (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDecimal (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDecimalX (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteDecimalXY (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteSmallint (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteTimestamp (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteTinyint (batchId=181)
org.apache.hive.hcatalog.pig.TestSequenceFileHCatStorer.testWriteVarchar (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatLoader.testReadMissingPartitionBasicNeg (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatLoader.testReadPartitionedBasic (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testBagNStruct (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testDateCharTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testDynamicPartitioningMultiPartColsInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testDynamicPartitioningMultiPartColsInDataPartialSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testDynamicPartitioningMultiPartColsNoDataInDataNoSpec
(batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testEmptyStore (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testMultiPartColsInData (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testPartitionPublish (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testStoreFuncAllSimpleTypes (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testStoreFuncSimple (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testStoreMultiTables (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testStoreWithNoCtorArgs (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testStoreWithNoSchema (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteChar (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDate (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDate2 (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDate3 (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDecimal (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDecimalX (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDecimalXY (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteSmallint (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteTimestamp (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteTinyint (batchId=181)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteVarchar (batchId=181)
org.apache.hive.hcatalog.streaming.TestStreaming.testAddPartition (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testBucketing (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testBucketingWhereBucketColIsNotFirstCol
(batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testConcurrentTransactionBatchCommits (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testErrorHandling (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testFileDump (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testFileDumpCorruptDataFiles (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testFileDumpCorruptSideFiles (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testHeartbeat (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testInterleavedTransactionBatchCommits (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testMultipleTransactionBatchCommits (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testRemainingTransactions (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testStreamBucketingMatchesRegularBucketing
(batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTableValidation (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTimeOutReaper (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbortAndCommit (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Delimited (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_DelimitedUGI (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Json (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Regex (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_RegexUGI (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyAbort (batchId=190)
org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit (batchId=190)
org.apache.hive.service.cli.TestRetryingThriftCLIServiceClient.testSessionLifeAfterTransportClose
(batchId=194)
org.apache.hive.service.cli.operation.TestQueryLifeTimeHooksWithSQLOperation.testQueryInfoInHookContext
(batchId=194)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/5809/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/5809/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-5809/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 338 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12874871 - PreCommit-HIVE-Build

> FetchOperator: filter out inputSplits which length is zero
> ----------------------------------------------------------
>
>                 Key: HIVE-16972
>                 URL: https://issues.apache.org/jira/browse/HIVE-16972
>             Project: Hive
>          Issue Type: Improvement
>          Components: Physical Optimizer
>    Affects Versions: 2.1.0, 2.1.1
>            Reporter: Chaozhong Yang
>            Assignee: Chaozhong Yang
>             Fix For: 2.1.2
>
>         Attachments: HIVE-16972.2.patch, HIVE-16972.3.patch, HIVE-16972.patch
>
>
> * Background
>    We can describe the basic work flow of  common HQL query as follows:
>   1. compile and execute
>   2. fetch results
>   In many cases, we don't need to  worry about the issues fetching results from HDFS(iff
there are mapreduce jobs generated in planning step). However, the number of results files
on HDFS and data distribution will affect the final status of HQL query, especially for HiveServer2.
We have some map-only queries, e.g: 
> {code:sql}
> select * from myTable where date > '20170101' and date <= '20170301' and id = 88;
> {code}
>     This query will generate more than 20,000 files(look at screenshot image uploaded)
on HDFS and most of those files are empty. Of course, they are very sparse. If we send TFetchResultsRequest
from HiveServer2 client with  some parameters(timeout:90s, maxRows:1024) , FetchOperator can
not fetch 1024 rows in 90 seconds and our HiveServer2 client will mark this TFetchResultsRequest
as timed out failure. Why? In fact, It's expensive to fetch results from empty file. In our
HDFS cluster( 5000+ DataNodes) , reading data from an empty file will cost almost 100 ms (100ms
* 1000 ==> 100s > 90s timeout). Obviously, we can filter out those empty files or splits
to speed up the process of FetchResults. 
>   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message