hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prashant Kommireddi <prash1...@gmail.com>
Subject Re: Using a combiner
Date Wed, 14 Mar 2012 22:32:01 GMT
It is a function of the "number of spills" on map side and I believe
the default is 3. So for every 3 times data is spilled the combiner is
run. This number is configurable.

Sent from my iPhone

On Mar 14, 2012, at 3:26 PM, Gayatri Rao <rgayatri1@gmail.com> wrote:

> Hi all,
> I have a quick query on using a combiner in a MR job. Is it true the
> framework decides whether or not the combiner gets called?
> Can any one please give more information on how t his is done.
> Thanks,
> Gayatri

View raw message