hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Owen O'Malley <o...@yahoo-inc.com>
Subject Re: why to force a single reduce task for Local Runner?
Date Tue, 07 Nov 2006 18:14:55 GMT

On Nov 7, 2006, at 5:48 AM, Feng Jiang wrote:

> look at the code:
>
> job.setNumReduceTasks(1);                 // force a single reduce  
> task
>
> why? Is there any difficulty there to allow multiple reduce tasks?

There is not a good reason and a long standing bug to fix it:

http://issues.apache.org/jira/browse/HADOOP-206

Fixing it would allow a lot more of the framework code to be  
exercised in local runner mode.

-- Owen

Mime
View raw message