hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhenxiao Luo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3435) Get pdk pluginTest passed when triggered from both builtin tests and pdk tests on hadoop23
Date Wed, 05 Sep 2012 21:51:07 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449174#comment-13449174
] 

Zhenxiao Luo commented on HIVE-3435:
------------------------------------

The problems are similar to HIVE-3413:

1. missing dependency
   hadoop-minicluster needs to be added to pdk/ivy.xml as well.
   In pdk/build.xml, the test target needs to depend on "init, setup, ivy-retrieve, ivy-retrieve-test",
so that when running pdk tests directly, the pdk/ivy.xml dependency will be resolved firstly.

2. configuration files need to be added
   log4j.properties and hive-site.xml need to be added to get rid of the following warning
nessage:

    [junit] 2012-08-28 18:13:01,668 WARN [main] conf.HiveConf (HiveConf.java:<clinit>(73))
- hive-site.xml not found on CLASSPATH
    [junit] 2012-08-28 19:05:20,679 WARN [main] conf.Configuration (Configuration.java:loadProperty(1621))
- file:/tmp/cloudera/hive_2012-08-28_19-05-17_531_4347419252405007581/-local-10002/jobconf.xml:an
attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
[junit] 2012-08-28 19:05:20,680 WARN [main] conf.Configuration (Configuration.java:loadProperty(1621))
- file:/tmp/cloudera/hive_2012-08-28_19-05-17_531_4347419252405007581/-local-10002/jobconf.xml:an
attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
   
    These configuration files also needs to be put in a place where both builtin tests and
pdk tests could load(due to property overload, pdk/test-plugin/test/conf could not be loaded
by pdk, my plan is to update the place to pdk/scripts/conf).

3. HADOOP_ROOT_LOGGER needs to be set in pdk/scripts/build-plugin.xml
   If not set, testutils/hadoop would initialize it to be "INFO,console", which would print
log4j warning message on the console, and is not expected.
                
> Get pdk pluginTest passed when triggered from both builtin tests and pdk tests on hadoop23

> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-3435
>                 URL: https://issues.apache.org/jira/browse/HIVE-3435
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.10.0
>            Reporter: Zhenxiao Luo
>            Assignee: Zhenxiao Luo
>             Fix For: 0.10.0
>
>
> Hive pdk pluginTest is running twice in unit testing, one is triggered from running builtin
tests, another is triggered from running pdk tests.
> HIVE-3413 fixed pdk pluginTest on hadoop23 when triggered from running builtin tests.
While, when triggered from running pdk tests directly on hadoop23, it is failing:
> Testcase: SELECT tp_rot13('Mixed Up!') FROM onerow; took 6.426 sec
> FAILED
> expected:<[]Zvkrq Hc!> but was:<[2012-09-04 18:13:01,668 WARN [main] conf.HiveConf
(HiveConf.java:<clinit>(73)) - hive-site.xml not found on CLASSPATH
> ]Zvkrq Hc!>
> junit.framework.ComparisonFailure: expected:<[]Zvkrq Hc!> but was:<[2012-09-04
18:13:01,668 WARN [main] conf.HiveConf (HiveConf.java:<clinit>(73)) - hive-site.xml
not found on CLASSPATH
> ]Zvkrq Hc!>

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message