hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Liang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18791) HBASE_HOME/lib does not contain hbase-mapreduce-${project.version}-tests.jar
Date Tue, 12 Sep 2017 00:32:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162288#comment-16162288
] 

Yi Liang commented on HBASE-18791:
----------------------------------

I found this issue when I try to test HBASE-16894 on real cluster.

{quote}How did you test it sir?{quote}
1.  Do you mean how I test this patch?  After I changed the code, I build a tarball to see
if this test jar is included in it.

2. I guess you may mean something else, I usually use docker to test something on real cluster.
I have a docker image that can 'Run Distributed HBase Cluster within Docker Containers'; See
https://github.com/YiSoEasy/docker-hbase
I put the new tarball into my repo and modify a little bit code in DockerFile(in above branch)
to download the new hbase tarball. 
So I can build a real distributed hbase cluster with the latest hbase version, and then testing
;)
Hope I answer your question correctly.  


{quote}We might be missing other libs given we added a few modules recently.{quote}
Maybe, I saw some errors below, when I try to run hbase pe.
{quote}
2017-09-12 00:10:52,877 INFO  [main] mapreduce.Job: Task Id : attempt_1505170797673_0009_m_000000_0,
Status : FAILED
Error: java.io.IOException: java.lang.reflect.InvocationTargetException
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:221)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:114)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:311)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:264)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:219)
	... 11 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/lang3/ArrayUtils
	at org.apache.hadoop.hbase.HConstants.<clinit>(HConstants.java:1144)
	at org.apache.hadoop.hbase.client.ConnectionUtils.getPauseTime(ConnectionUtils.java:84)
	at org.apache.hadoop.hbase.client.AsyncProcess.<init>(AsyncProcess.java:209)
	at org.apache.hadoop.hbase.client.ConnectionImplementation.<init>(ConnectionImplementation.java:266)
	... 16 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang3.ArrayUtils
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
{quote}






 
 

> HBASE_HOME/lib does not contain hbase-mapreduce-${project.version}-tests.jar
> ----------------------------------------------------------------------------
>
>                 Key: HBASE-18791
>                 URL: https://issues.apache.org/jira/browse/HBASE-18791
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Yi Liang
>            Assignee: Yi Liang
>         Attachments: hbase-18791-master-v1.patch
>
>
> hbase pe
> Error: Could not find or load main class org.apache.hadoop.hbase.PerformanceEvaluation
> hbase ltt
> Error: Could not find or load main class org.apache.hadoop.hbase.util.LoadTestTool
> Those class are in hbase-mapreduce-test.jar



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message