hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <ja...@attributor.com>
Subject Re: Copy-rate of reducers decreases over time
Date Tue, 23 Dec 2008 22:39:28 GMT
The copy rate for the reduces is throttled by the availability of the 
data from the maps.

If the map data is not available yet, the effective copy rate goes toward 0.

patek tek wrote:
> Hello,
> I have been running experiments with Hadoop and noticed that
> the copy-rate of reducers descreases over time (even though there is the
> same
> number of mappers generating intermediate data).
> Is there any obvious answer to this?
> Looking forward to your reply!
> patektek

View raw message