hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hanna <jeremy.hanna1...@gmail.com>
Subject IllegalArgumentException when doing fs.open with an s3n prefix path
Date Wed, 09 Feb 2011 23:23:52 GMT
Anyone know why I would be getting an error doing a filesystem.open on a file with a s3n prefix?

for the input path "s3n://backlog.dev/1296648900000/" - I get the following stacktrace:

java.lang.IllegalArgumentException: This file system object (hdfs://ip-10-114-89-36.ec2.internal:9000)
does not support access to the request path 's3n://backlog.dev/1296648900000/32763897924550656'
You possibly called FileSystem.get(conf) when you should of called FileSystem.get(uri, conf)
to obtain a file system supporting your path.
	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:351)
	at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
	at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:178)
	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:396)
	at analytics.hadoop.socialdata.RawSignalFileInputFormat$MultiFileLineRecordReader.<init>(RawSignalFileInputFormat.java:53)
	at analytics.hadoop.socialdata.RawSignalFileInputFormat.getRecordReader(RawSignalFileInputFormat.java:22)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:343)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:312)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)

Incidentally, I'm using on elastic mapreduce with hadoop version 0.20 (which I assume is the
latest 0.20 version).
Mime
View raw message