hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koji Noguchi <knogu...@yahoo-inc.com>
Subject Re: Configuration and Hadoop cluster setup
Date Fri, 25 May 2007 23:04:07 GMT

I may be wrong, but last time I tried (on 0.12.3), MapRed didn't work 
for non-default filesystem as an input.
(output worked fine.)


Mine failed with "org.apache.hadoop.mapred.InvalidInputException: Input 
path does not exist". 
It basically checked the default file system instead of the one passed in.


Doug Cutting wrote:
> But inputs don't have to be in the default filesystem nor must they be 
> in HDFS.  They need to be in a filesystem that's available to all 
> nodes.  They could be in NFS, S3, or Ceph instead of HDFS.  They could 
> even be in a non-default HDFS system.

View raw message