hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15414) Fix batchSize for TestNegativeCliDriver
Date Wed, 04 Jan 2017 06:55:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797363#comment-15797363
] 

Siddharth Seth commented on HIVE-15414:
---------------------------------------

As [~pvary] pointed out, the batch size was increased to the excessive setup / teardown cost
- as compared to the actual time taken to run the tests. If the single batch is taking 717
seconds, I think splitting this up would make sense given we normally have some stragglers
at the end, and a lot of empty nodes.

> Fix batchSize for TestNegativeCliDriver
> ---------------------------------------
>
>                 Key: HIVE-15414
>                 URL: https://issues.apache.org/jira/browse/HIVE-15414
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Minor
>
> While analyzing the console output of pre-commit console logs, I noticed that TestNegativeCliDriver
batchSize ~770 qfiles which doesn't look right.
> 2016-12-09 22:23:58,945 DEBUG [TestExecutor] ExecutionPhase.execute:96 PBatch: QFileTestBatch
[batchId=84, size=774, driver=TestNegativeCliDriver, queryFilesProperty=qfile, name=84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more..
 
> I think {{qFileTest.clientNegative.batchSize = 1000}} in {{test-configuration2.properties}}
is probably the reason. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message