hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <>
Subject [jira] [Updated] (HIVE-7271) Speed up unit tests
Date Tue, 24 Jun 2014 18:58:28 GMT


Gunther Hagleitner updated HIVE-7271:

    Attachment: HIVE-7271.7.patch

Smaller size causes MTQueries to fail. In the latest patch I've made a small change to run
the multithreaded query test starting child VM (makes sense that multiple join/group by queries
in process would eventually run out of memory).

> Speed up unit tests
> -------------------
>                 Key: HIVE-7271
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gunther Hagleitner
>            Assignee: Gunther Hagleitner
>         Attachments: HIVE-7271.1.patch, HIVE-7271.2.patch, HIVE-7271.3.patch, HIVE-7271.4.patch,
HIVE-7271.5.patch, HIVE-7271.6.patch, HIVE-7271.7.patch
> Did some experiments to see if there's a way to speed up unit tests. TestCliDriver seemed
to take a lot of time just spinning up/tearing down JVMs. I was also curious to see if running
everything on a ram disk would help.
> Results (I ran tests up to authorization_2):
> - Current setup: 40 minutes
> - Single JVM (not using child JVM to run all queries): 8 minutes
> - Single JVM + ram disk: 7 minutes
> So the ram disk didn't help that much. But running tests in single JVM seems worthwhile

This message was sent by Atlassian JIRA

View raw message