hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: Can mappers take local file as input?
Date Thu, 04 Nov 2010 14:04:25 GMT

On Thu, Nov 4, 2010 at 3:12 AM, Zhenhua Guo <jenvor@gmail.com> wrote:
> I know mappers can take files in HDFS as input. I wonder whether they
> can take local files as input.
> Thanks.
> Gerald

It can :)

Try with fs.default.name set to "file:///" to use the local filesystem
(and not HDFS). Or in your MR job, give the path as file://<path>
(assuming that this is available across all working nodes).

Harsh J

View raw message