hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vihang Karajgaonkar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15414) Fix batchSize for TestNegativeCliDriver
Date Fri, 16 Dec 2016 23:17:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15755766#comment-15755766
] 

Vihang Karajgaonkar commented on HIVE-15414:
--------------------------------------------

Hi [~spena] I checked the results on couple of the latest pre-commit runs. Each batch of TestNegativeCliDriver
now takes between ~400-470 sec which is about ~250-300 sec faster for this batch when compared
to before.

[pre-commit-2614 | https://builds.apache.org/job/PreCommit-HIVE-Build/2614/]
{noformat}
2016-12-16 19:22:08,193  INFO [HostExecutor 26] LocalCommand.<init>:45 Starting LocalCommandId=273266:
ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key  -l hiveptest 107.178.216.213 'bash /home/hiveptest/107.178.216.213-hiveptest-1/scratch/hiveptest-84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more.sh'
2016-12-16 19:22:08,924  INFO [HostExecutor 39] LocalCommand.<init>:45 Starting LocalCommandId=273268:
ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key  -l hiveptest 104.154.143.187 'bash /home/hiveptest/104.154.143.187-hiveptest-0/scratch/hiveptest-85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-374-more.sh'
2016-12-16 19:29:02,702  INFO [HostExecutor 39] LocalCommand.awaitProcessCompletion:67 Finished
LocalCommandId=273268. ElapsedTime(ms)=413777
2016-12-16 19:30:00,510  INFO [HostExecutor 26] LocalCommand.awaitProcessCompletion:67 Finished
LocalCommandId=273266. ElapsedTime(ms)=472316
{noformat}

[pre-commit-2613 | https://builds.apache.org/job/PreCommit-HIVE-Build/2613/]
{noformat}
2016-12-16 18:36:15,845  INFO [HostExecutor 36] LocalCommand.<init>:45 Starting LocalCommandId=272258:
ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key  -l hiveptest 35.184.12.165 'bash /home/hiveptest/35.184.12.165-hiveptest-1/scratch/hiveptest-84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more.sh'
2016-12-16 18:36:16,066  INFO [HostExecutor 13] LocalCommand.<init>:45 Starting LocalCommandId=272259:
ssh -v -i /home/hiveptest/.ssh/hive-ptest-user-key  -l hiveptest 104.154.143.187 'bash /home/hiveptest/104.154.143.187-hiveptest-0/scratch/hiveptest-85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-370-more.sh'
2016-12-16 18:43:29,647  INFO [HostExecutor 36] HostExecutor.executeTestBatch:261 Completed
executing tests for batch [84-TestNegativeCliDriver-nopart_insert.q-insert_into_with_schema.q-input41.q-and-397-more]
on host 35.184.12.165. ElapsedTime(ms)=433802
2016-12-16 18:42:53,365  INFO [HostExecutor 13] HostExecutor.executeTestBatch:261 Completed
executing tests for batch [85-TestNegativeCliDriver-udf_array_contains_wrong2.q-udf_invalid.q-authorization_rolehierarchy_privs.q-and-370-more]
on host 104.154.143.187. ElapsedTime(ms)=397299
{noformat}


> Fix batchSize for TestNegativeCliDriver
> ---------------------------------------
>
>                 Key: HIVE-15414
>                 URL: https://issues.apache.org/jira/browse/HIVE-15414
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Minor
>
> While analyzing the console output of pre-commit console logs, I noticed that TestNegativeCliDriver
batchSize ~770 qfiles which doesn't look right.
> 2016-12-09 22:23:58,945 DEBUG [TestExecutor] ExecutionPhase.execute:96 PBatch: QFileTestBatch
[batchId=84, size=774, driver=TestNegativeCliDriver, queryFilesProperty=qfile, name=84-TestNegativeCliDriver-nopart_insert.q-input41.q-having1.q-and-771-more..
 
> I think {{qFileTest.clientNegative.batchSize = 1000}} in {{test-configuration2.properties}}
is probably the reason. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message