hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: specify different number of mapper tasks for different machines
Date Wed, 14 Jul 2010 19:06:22 GMT
hadoop-daemon.sh also needs to be modified - it would wipe your custom
config files:
    if [ "$HADOOP_MASTER" != "" ]; then
      echo rsync from $HADOOP_MASTER
      rsync -a -e ssh --delete --exclude=.svn --exclude='logs/*'
--exclude='contrib/hod/logs/*' $HADOOP_MASTER/ "$HADOOP_HOME"
    fi

On Wed, Jul 14, 2010 at 11:53 AM, Allen Wittenauer <awittenauer@linkedin.com
> wrote:

>
> On Jul 14, 2010, at 11:50 AM, Shaojun Zhao wrote:
> > Is there any way to specify that some machines run, say, 8 mapper
> > tasks, while some machines run only 2 tasks?
>
> A custom mapred-site.xml per machine.
>
>
>

Mime
View raw message