hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John <johnnyenglish...@gmail.com>
Subject only one map or reduce job per time on one node
Date Tue, 05 Nov 2013 17:17:29 GMT

I have a cluster of 7 nodes. Every node has 2 maps-lots and 1 reduce slot.
Is it possible to force the jobtracker executing only 2 map jobs or 1
reduce job per time? I have found this configuration option:
"mapred.reduce.slowstart.completed.maps". I think this will do exactly what
I want If I set it to 1.0 if there is only one mapreduce job per time. But
whenn there are 2 jobs I think it doesn't work because if the second job is
finished with the map part it will maybe execute a reduce job on node where
still the first job is running. Or am I wrong? Is there a way to allow
executing reduce jobs only if there is no map reduce job on this node?

kind regards

View raw message