hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Force single map task execution per node for a job
Date Fri, 15 Apr 2011 16:59:31 GMT
Hello Massimo,

This is sort-of possible with a custom InputFormat (getSplits contents
has the real scheduling information in it if you notice). But the
host-to-task mapping is not strongly guaranteed (if slots are full on
a node while launching, it could get scheduled elsewhere).

On Fri, Apr 15, 2011 at 8:33 PM, Massimo Schiavon <mschiavon@volunia.com> wrote:
> I need that during the execution of a particular job, a maximum of one map
> task execute on each cluster node.
> I've tried setting mapred.tasktracker.map.tasks.maximum=1 on job
> configuration but seems not to work.

Harsh J

View raw message