hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Niels Basjes <Ni...@basjes.nl>
Subject Re: Predicting how many values will I see in a call to reduce?
Date Mon, 08 Nov 2010 11:32:11 GMT

2010/11/7 Anthony Urso <anthony.urso@gmail.com>

> Is there any way to know how many values I will see in a call to
> reduce without first counting through them all with the iterator?
> Under 0.21? 0.20? 0.19?

I've looked for an answer to the same question a while ago and came to the
conclusion that you can't.
The main limit is that the Iterator does not have a "size" or "length"

Met vriendelijke groeten,

Niels Basjes

View raw message