hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carl Steinbach (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3085) make parallel tests work
Date Mon, 11 Jun 2012 23:14:43 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293176#comment-13293176
] 

Carl Steinbach commented on HIVE-3085:
--------------------------------------

@Namit

bq. Won't it be better to not populate hive*jar in ivy in our local builds?

I don't think we can do that and also continue to list inter-subproject dependencies in the
ivy.xml files. The basic reason why this doesn't work correctly for Hive is that the build
is still not using Ivy correctly. More specifically, we're manually specifying the order in
which subprojects are built instead of letting Ivy determine the order through dependency
analysis.

bq. Or, what is the downside of removing 'hive.jar' from .ivy2 and then running ant clean
package.

The main downside is that the user may have configured ivy.cache.dir to be something other
than ~/.ivy2, so to be sure that you're deleting the right files you have to get the value
of ${ivy.cache.dir} (which didn't seem that straightforward the last time I looked at it:
http://ant.apache.org/ivy/history/2.0.0/use/cleancache.html).

                
> make parallel tests work
> ------------------------
>
>                 Key: HIVE-3085
>                 URL: https://issues.apache.org/jira/browse/HIVE-3085
>             Project: Hive
>          Issue Type: Bug
>          Components: Testing Infrastructure
>            Reporter: Namit Jain
>            Assignee: Shuai Ding
>         Attachments: hive.3085.1.patch, hive.3085.2.patch
>
>
> https://cwiki.apache.org/Hive/unit-test-parallel-execution.html
> I was trying to run the tests using the instructions above.
> I was able to run them using a single machine (parallelism of 4 in ~2 hours).
> The conf. file is as follows: .hive_ptest.conf
> {
>   "qfile_hosts": [
>     ["root@<MC>", 4]
>   ],
>   "other_hosts": [
>   ["root@<MC>", 1]
>   ],
>   "master_base_path": "/data/users/tmp",
>   "host_base_path": "/data/users/hivetests",
>   "java_home": "/usr/local/jdk-6u24-64"
> }

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message