hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Commented] (HIVE-7271) Speed up unit tests
Date Mon, 23 Jun 2014 03:59:24 GMT


Brock Noland commented on HIVE-7271:

We specify the number of q files to include in a "test batch" and that number is much less
than the number of q file tests. Thus we probably aren't seeing as much benefit. After this
change we can probably increase the batch size.

> Speed up unit tests
> -------------------
>                 Key: HIVE-7271
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gunther Hagleitner
>            Assignee: Gunther Hagleitner
>         Attachments: HIVE-7271.1.patch, HIVE-7271.2.patch, HIVE-7271.3.patch
> Did some experiments to see if there's a way to speed up unit tests. TestCliDriver seemed
to take a lot of time just spinning up/tearing down JVMs. I was also curious to see if running
everything on a ram disk would help.
> Results (I ran tests up to authorization_2):
> - Current setup: 40 minutes
> - Single JVM (not using child JVM to run all queries): 8 minutes
> - Single JVM + ram disk: 7 minutes
> So the ram disk didn't help that much. But running tests in single JVM seems worthwhile

This message was sent by Atlassian JIRA

View raw message