hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <>
Subject [jira] [Commented] (HIVE-7271) Speed up unit tests
Date Sun, 22 Jun 2014 23:20:24 GMT


Gunther Hagleitner commented on HIVE-7271:

[~szehon] I think this is already fixed. I remember having to clean that up for tez container
reuse. I think the IOContext is properly reinitialized for each file now. Also, the unit tests
should show if that was still an issue.

> Speed up unit tests
> -------------------
>                 Key: HIVE-7271
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gunther Hagleitner
>            Assignee: Gunther Hagleitner
>         Attachments: HIVE-7271.1.patch, HIVE-7271.2.patch
> Did some experiments to see if there's a way to speed up unit tests. TestCliDriver seemed
to take a lot of time just spinning up/tearing down JVMs. I was also curious to see if running
everything on a ram disk would help.
> Results (I ran tests up to authorization_2):
> - Current setup: 40 minutes
> - Single JVM (not using child JVM to run all queries): 8 minutes
> - Single JVM + ram disk: 7 minutes
> So the ram disk didn't help that much. But running tests in single JVM seems worthwhile

This message was sent by Atlassian JIRA

View raw message