hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Can we write output directly to HDFS from Mapper
Date Fri, 28 Sep 2012 04:41:47 GMT
Anand,

You may read this in the FAQ:
http://wiki.apache.org/hadoop/FAQ#Can_I_write_create.2BAC8-write-to_hdfs_files_directly_from_map.2BAC8-reduce_tasks.3F

On Fri, Sep 28, 2012 at 9:45 AM, Balaraman, Anand
<Anand_Balaraman@syntelinc.com> wrote:
> Hi
>
>
>
> In Map-Reduce, is it appropriate to write the output directly to HDFS from
> Mapper (without using a reducer) ?
>
> Are there any adverse effects in doing so or are there any best practices to
> be followed in this aspect ?
>
>
>
> Comments are much appreciable at the moment J
>
>
>
> Thanks and Regards
>
> Anand B
>
> Confidential: This electronic message and all contents contain information
> from Syntel, Inc. which may be privileged, confidential or otherwise
> protected from disclosure. The information is intended to be for the
> addressee only. If you are not the addressee, any disclosure, copy,
> distribution or use of the contents of this message is prohibited. If you
> have received this electronic message in error, please notify the sender
> immediately and destroy the original message and all copies.



-- 
Harsh J

Mime
View raw message