hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: disable pipelining in Hadoop
Date Sat, 12 Mar 2011 16:32:18 GMT

(Removing common-dev, because this isn't a dev question.)

On Mar 1, 2011, at 6:13 AM, bikash sharma wrote:

> Hi,
> Is there a way to disable the use of pipelining , i.e., the reduce phase is
> started only after the map phase is completed?

Set mapred.reduce.slowstart.completed.maps to 1.

Be aware that you will introduce latency into the job.  Depending upon your use case, that
may be acceptable.  See also https://issues.apache.org/jira/browse/MAPREDUCE-1184 .

View raw message