hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <>
Subject [jira] [Commented] (HIVE-3156) Support MiniMR tests for Hadoop-0.23
Date Wed, 09 Jan 2013 10:25:50 GMT


Hudson commented on HIVE-3156:

Integrated in Hive-trunk-hadoop2 #54 (See [])
    HIVE-3341 [jira] Making hive tests run against different MR versions
(Sushanth Sowmyan via Ashutosh Chauhan)

HIVE-3341 Making hive tests run against different MR versions

After we build hive, we want to have the ability to run unit tests against specific hadoop
versions. Currently, the classpath constructed has multiple hadoop jars, which makes compiling
okay, but running non-deterministic.

An example is HIVE-3156, where running against 0.23 shows issues with a couple of tests (which
should either be shimmed out, or separated into directories the way it's done in the shims/
directory) - It would also be nice to find these issues out at test-compile time itself, rather
than having them fail at test runtime.

With this patch, we can set ant variable to 20, 20S or 23 to test against a
particular version.

Test Plan: current tests continue to work - this is a build system change

Reviewers: JIRA, ashutoshc, cwsteinbach

Reviewed By: ashutoshc

Differential Revision: (Revision 1372745)

     Result = ABORTED
hashutosh :
Files : 
* /hive/trunk/build-common.xml
* /hive/trunk/
* /hive/trunk/ivy/common-configurations.xml
* /hive/trunk/shims/build.xml
* /hive/trunk/shims/src/common-secure/test
* /hive/trunk/shims/src/common-secure/test/org
* /hive/trunk/shims/src/common-secure/test/org/apache
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/
* /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/
* /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/

> Support MiniMR tests for Hadoop-0.23
> ------------------------------------
>                 Key: HIVE-3156
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests
>    Affects Versions: 0.9.1
>         Environment: Hive-0.9.1 + Hadoop-0.23.0
>            Reporter: rohithsharma
> When MiniMR tests are ran with hadoop-0.23.0, tests fails throwing following exception.
> java.lang.UnsupportedOperationException
> 	at org.apache.hadoop.mapred.MiniMRCluster.getJobTrackerPort(
> 	at org.apache.hadoop.hive.ql.QTestUtil.initConf(
> In hadoop-0.23 ,few mapreduce API's are not supported like getJobTrackerPort(). 
> Here, we need to use API's based on hadoop versions.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message