hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sriramadasu <amar...@yahoo-inc.com>
Subject Re: Using different file systems for Map Reduce job input and output
Date Mon, 06 Oct 2008 08:27:15 GMT
Hi Naama,

Yes. It is possible to specify using the apis

FileInputFormat#setInputPaths(), FileOutputFormat#setOutputPath(). 

You can specify the FileSystem uri for the path.

Naama Kraus wrote:
> Hi,
> I wanted to know if it is possible to use different file systems for Map
> Reduce job input and output.
> I.e. have a M/R job input reside on one file system and the M/R output be
> written to another file system (e.g. input on HDFS, output on KFS. Input on
> HDFS output on local file system, or anything else ...).
> Is it possible to somehow specify that through
> FileInputFormat#setInputPaths(), FileOutputFormat#setOutputPath() ?
> Or by any other mechanism ?
> Thanks, Naama

View raw message