hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur" <tuc...@gmail.com>
Subject Re: Multithreaded reduce
Date Tue, 09 Sep 2008 03:45:03 GMT
Collectors are already properly synchronized. Maybe there is a race
condition in the way the multithreaded reducer runner creates them.

A

On Tue, Sep 9, 2008 at 8:56 AM, Owen O'Malley <omalley@apache.org> wrote:
>
> On Sep 8, 2008, at 4:12 AM, Goel, Ankur wrote:
>
>> They seem to not work fine when used in Reduce phase.
>> I can post the stack trace if required.
>
> I believe it. I don't think I've ever seen anyone do a multi-threaded
> reduce. Of course the answer is easy, just add synchronization around the
> output collector before calling collect.
>
> -- Owen
>

Mime
View raw message