hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: Is there any reliable way for a reducer to determine the number of mappers used in a job
Date Thu, 04 Nov 2010 20:53:06 GMT

On Fri, Nov 5, 2010 at 1:58 AM, Steve Lewis <lordjoe2000@gmail.com> wrote:
> Short of having every mapper increment a counter

Sure, since "mapred.map.tasks" is computed and set before jobs are
'submitted' for running (before setup itself), it can be read via the
Configuration object in the Reducer's context.

Harsh J

View raw message