hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8528) [hadoop2] TestMultiTableInputFormat always fails on hadoop with YARN-129 applied
Date Tue, 14 May 2013 15:55:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657147#comment-13657147
] 

Jonathan Hsieh commented on HBASE-8528:
---------------------------------------

Tracked it down -- in  MiniMRClientClusterFactory, we get a conf from the job and feed it
to the  MiniMRYarnCluster [1].  The job doesn't get the same conf we build in hbase -- it
instantiates its own. [2]  This is why we need to manually copy over settings into the hbase
mr client for mr2/yarn hbase jobs.  I'm going to add some comments to gary's patch to this
effect.


[1] https://github.com/apache/hadoop-common/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java#L73
[2] https://github.com/apache/hadoop-common/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java#L147
                
> [hadoop2] TestMultiTableInputFormat always fails on hadoop with YARN-129 applied
> --------------------------------------------------------------------------------
>
>                 Key: HBASE-8528
>                 URL: https://issues.apache.org/jira/browse/HBASE-8528
>             Project: HBase
>          Issue Type: Sub-task
>          Components: hadoop2, mapreduce, test
>    Affects Versions: 0.95.0
>            Reporter: Jonathan Hsieh
>            Assignee: Jonathan Hsieh
>             Fix For: 0.98.0, 0.95.1
>
>         Attachments: hbase-8528_alt.patch, hbase-8528.patch
>
>
> TestMulitTableInputFormat always fails if YARN-129 is applied.  Its error message isn't
useful (assertion failed) -- but if you look at the stderr/stdout/syslog files of the jobs
in hbase-server/target/org.apache.hadoop.mapred.MiniMRCluster* (minicluster data dirs) you'll
find this class not found exception:
> {code}
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster.  Program
will exit.
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message