hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Serge Blazhiyevskyy <Serge.Blazhiyevs...@nice.com>
Subject Re: mapred.tasktracker.map.tasks.maximum
Date Tue, 13 Nov 2012 15:18:57 GMT
What hadoop version are we talking about?

From: Mark Kerzner <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
Reply-To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Date: Tuesday, November 13, 2012 5:16 PM
To: Hadoop User <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Subject: mapred.tasktracker.map.tasks.maximum


I have a cluster with 4 nodes and 32 many cores on each. My default value for the maximum
number of mappers per slot is 1:

    <!-- see other kb entry about this one. -->
(which I think is wrong).

Howeve, when sizable jobs run, I see 65 mappers working, so it seems that it does create more
than 1 mapper per node.

Questions: what maximum number of mappers would be appropriate in this situation? Is that
the right way to set them?

Thank you. Sincerely,

View raw message