hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Kerzner <mark.kerz...@shmsoft.com>
Subject mapred.tasktracker.map.tasks.maximum
Date Tue, 13 Nov 2012 15:16:13 GMT

I have a cluster with 4 nodes and 32 many cores on each. My default value
for the maximum number of mappers per slot is 1:

    <!-- see other kb entry about this one. -->
(which I think is wrong).

Howeve, when sizable jobs run, I see 65 mappers working, so it seems that
it does create more than 1 mapper per node.

Questions: what maximum number of mappers would be appropriate in this
situation? Is that the right way to set them?

Thank you. Sincerely,

View raw message