hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anthony Urso <antho...@cs.ucla.edu>
Subject Re: Map output records/reducer input records mismatch
Date Tue, 16 Aug 2011 19:25:41 GMT
Are you looking at "reduce input groups" or "reduce input records"?
Are you running a combiner?

On Tue, Aug 16, 2011 at 11:37 AM, Vyacheslav Zholudev
<vyacheslav.zholudev@gmail.com> wrote:
> Hi,
>
> I'm having multiple hadoop jobs that use the avro mapred API.
> Only in one of the jobs I have a visible mismatch between a number of map output records
and reducer input records.
>
> Does anybody encountered such a behavior? Can anybody think of possible explanations
of this phenomenon?
>
> Any pointers/thoughts are highly appreciated!
>
> Best,
> Vyacheslav

Mime
View raw message