hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sudip Sinha <sudipsinha.ba...@gmail.com>
Subject Does the combiner always work if specified?
Date Wed, 04 Apr 2012 16:51:22 GMT
Hi,

I've read that the combiner only works if it is specified AND the sort
memory buffer overflows in the mapper.
http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-user/201107.mbox/%3C374D8F3F-B8B1-499F-BEDB-BFEE3219010C@hortonworks.com%3E

But when I run a Hadoop streaming job in R using RHadoop, the combiner
always runs when specified. This is on a very small dataset.

Is this the desired behaviour?

Thanks,
Sudip Sinha

Mime
View raw message