hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8342) TestTableInputFormatScan#testScanFromConfiguration fails on hadoop2 profile
Date Mon, 15 Apr 2013 17:12:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631882#comment-13631882
] 

Jonathan Hsieh commented on HBASE-8342:
---------------------------------------

Dumping the Jobs that are submitted to the MR2 framework, in passing jobs we have the "tmpjars"
value set (which is read by the JobSumitter#copyAndConifigureFiles method that copies jars
required to jobs)

{code}
<property><name>tmpjars</name><value>file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-4641972520833942860.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-9043094595585370808.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-4595210641677463558.jar,file:/home/jon/.m2/repository/com/google/protobuf/protobuf-java/2.4.1/protobuf-java-2.4.1.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-8534779815631263049.jar,file:/home/jon/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-5815093030924489079.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-8922627291995251720.jar,file:/home/jon/.m2/repository/org/cloudera/htrace/htrace/1.50/htrace-1.50.jar,file:/home/jon/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar,file:/home/jon/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.0.2-alpha/hadoop-mapreduce-client-core-2.0.2-alpha.jar,file:/home/jon/proj/hbase/hbase-server/target/test-dir/hadoop-3503261906366143899.jar,file:/home/jon/.m2/repository/org/apache/hadoop/hadoop-common/2.0.2-alpha/hadoop-common-2.0.2-alpha.jar</value><source>programatically</source></property>
{code}

The hadoop-[0-9]*.jar files correspond to hbase jars.

In the failing case, the job  does not set this value at and has significantly fewer configuration
values included into the job's configraution.

                
> TestTableInputFormatScan#testScanFromConfiguration fails on hadoop2 profile
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-8342
>                 URL: https://issues.apache.org/jira/browse/HBASE-8342
>             Project: HBase
>          Issue Type: Sub-task
>          Components: hadoop2, test
>    Affects Versions: 0.98.0, 0.95.0
>            Reporter: Jonathan Hsieh
>            Assignee: Jonathan Hsieh
>             Fix For: 0.98.0, 0.95.1
>
>
> When scan information is sent via configuration (instead of jobconf), the unit test fails
with this in the yarn/mr2 MRAppMaster.
> {code}
> 2013-04-13 03:42:57,168 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
Error starting MRAppMaster
> java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/mapreduce/TableMapper
>         at java.lang.ClassLoader.defineClass1(Native Method)
>         at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>         at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>         at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>         at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:169)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.isChainJob(JobImpl.java:937)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.makeUberDecision(JobImpl.java:878)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.access$2600(JobImpl.java:120)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:1042)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:985)
>         at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:380)
>         at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:298)
>         at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
>         at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:443)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:694)
>         at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:119)
>         at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:904)
>         at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.start(MRAppMaster.java:854)
>         at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1070)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1367)
>         at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1066)
>         at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1025)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.mapreduce.TableMapper
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         ... 33 more
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message