hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12916) HDFS commands throws error, when only shaded clients in classpath
Date Thu, 14 Dec 2017 06:18:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290391#comment-16290391

Bharat Viswanadham commented on HDFS-12916:


bq. a) What is the goal here?
The goal is to run hdfs commands with shaded client jars.

bq. b) What exact surgery was performed to make that happen, since that's not how Hadoop ships
out of the box.
Changed the hadoop-layout.sh mapred_home hadoop_hdfs_home etc. to point to only hdfs client
jar location and copied all tools and shaded client jars .

So, for this to work, we need to copy below jars in to clients location to make hdfs commands
work then. Is this the solution.

Actually this is done as part of work to use shaded client jars for running hdfs commands
and also not to expose other run time jars to clients. And also use same jars for running
hdfs commands.

> HDFS commands throws error, when only shaded clients in classpath
> -----------------------------------------------------------------
>                 Key: HDFS-12916
>                 URL: https://issues.apache.org/jira/browse/HDFS-12916
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Bharat Viswanadham
>            Assignee: Bharat Viswanadham
> [root@n001 hadoop]# bin/hdfs dfs -rm /
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/htrace/core/Tracer$Builder
> 	at org.apache.hadoop.fs.FsShell.run(FsShell.java:303)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
> 	at org.apache.hadoop.fs.FsShell.main(FsShell.java:389)
> Caused by: java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> 	... 4 more
> cc [~busbey]

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message