hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohamed Riadh Trad <Mohamed.T...@inria.fr>
Subject Local and Distributed FileSystem
Date Sun, 11 Apr 2010 14:26:43 GMT
Hi,

Am running hadoop with both local and dfs:

local file system for input data

and

dfs for hadoop pipe binary to be shared by all slaves in addition to additional lib

but i get 	this trace :

10/04/11 16:21:08 INFO mapred.JobClient: Task Id : attempt_201003311822_0081_m_000005_0, Status
: FAILED
java.io.IOException: pipe child exception
	at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
	at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file:/local/trad/pic_test/264913_64dd48bb10.jpg,
expected: hdfs://casso***********
	at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
	at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:178)
	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:356)
	at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:301)
	at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:257)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:192)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:176)
	at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:88)
	... 3 more

How to set up such configuration?

Regards
Mime
View raw message