hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohammad Tariq <donta...@gmail.com>
Subject Re: intermediate results files
Date Mon, 01 Jul 2013 23:02:48 GMT
Hello John,

      IMHO, it doesn't matter. Your job will write the result just once.
Replica creation is handled at the HDFS layer so it has nothing to with
your job. Your job will still be writing at the same speed.

Warm Regards,
Tariq
cloudfront.blogspot.com


On Tue, Jul 2, 2013 at 4:16 AM, John Lilley <john.lilley@redpoint.net>wrote:

>  If my reducers are going to create results that are temporary in nature
> (consumed by the next processing stage) is it recommended to use a
> replication factor <3 to improve performance?  ****
>
> Thanks****
>
> john****
>
> ** **
>

Mime
View raw message