hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Luiz Carlos Muniz <lcmu...@gmail.com>
Subject Send a map to all nodes
Date Thu, 29 Mar 2012 00:25:05 GMT
Hi,

Is there any way to ensure the execution of a map on all nodes of a
clusterin a way that each node run the map once and only once. That is, I
would use Hadoop to execute a method on all nodes in the cluster. Without
the possibility that the method execute twice in the same node even if
another node fails.

I already set mapred.tasktracker.map.tasks.maximum  to 1 and
mapred.max.jobs.per.node to 1 but still, if a node fails, another node that
has
carried out a map before run the map again to meet the absence of which
failed.

Luiz Carlos Melo Muniz

Luiz Carlos Melo Muniz

Mime
View raw message