hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6132) Rumen unable to accept hdfs as scheme
Date Wed, 22 Oct 2014 23:46:35 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180746#comment-14180746
] 

Akira AJISAKA commented on MAPREDUCE-6132:
------------------------------------------

I think this is not a bug. Looks like hadoop-hdfs jar is missing. It's better to specify all
the hadoop classpath by {{java -cp `hadoop classpath`}}.


> Rumen unable to accept hdfs as scheme
> -------------------------------------
>
>                 Key: MAPREDUCE-6132
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6132
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tools/rumen
>    Affects Versions: 2.4.1
>            Reporter: Mayank Mishra
>            Priority: Minor
>
> while running,
> java -cp hadoop-2.4.1/share/hadoop/common/hadoop-common-2.4.1.jar:hadoop-2.4.1/share/hadoop/tools/lib/hadoop-rumen-2.4.1.jar:hadoop-2.4.1/share/hadoop/common/lib/commons-logging-1.1.3.jar:hadoop-2.4.1/share/hadoop/common/lib/commons-cli-1.2.jar:hadoop-2.4.1/share/hadoop/common/lib/commons-configuration-1.6.jar:hadoop-2.4.1/share/hadoop/common/lib/commons-lang-2.6.jar:hadoop-2.4.1/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:hadoop-2.4.1/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:hadoop-2.4.1/share/hadoop/tools/lib/guava-11.0.2.jar:hadoop-2.4.1/share/hadoop/tools/lib/guava-11.0.2.jar:hadoop-2.4.1/share/hadoop/tools/lib/commons-collections-3.2.1.jar:hadoop-2.4.1/share/hadoop/common/lib/hadoop-auth-2.4.1.jar:hadoop-2.4.1/share/hadoop/common/lib/slf4j-api-1.7.5.jar:hadoop-2.4.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.4.1.jar:hadoop-2.4.1/share/hadoop/common/lib/log4j-1.2.17.jar:hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:hadoop-2.4.1/share/hadoop/common/lib/log4j-1.2.17.jar
org.apache.hadoop.tools.rumen.TraceBuilder file:///pathto/rumen/jobjars/job-trace.json file:///pathto/rumen/jobjars/topology
hdfs://path to jhist file
> We are getting,
> java.io.IOException: No FileSystem for scheme: hdfs
> 	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2385)
> 	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
> 	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
> 	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
> 	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
> 	at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.processInputArgument(TraceBuilder.java:134)
> 	at org.apache.hadoop.tools.rumen.TraceBuilder$MyOptions.<init>(TraceBuilder.java:91)
> 	at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:206)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> 	at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:186)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message