hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Embree <cemb...@gmail.com>
Subject Re: number of mapred slots
Date Tue, 18 Dec 2012 06:12:10 GMT
I think the rule of thumb (hortonworks at least) is 2x cores for maps
threads and 1x cores for reducers.  Don't have my notes here so I'm not
100%.  It's just a guideline in any event. :)


On Tue, Dec 18, 2012 at 1:08 AM, <alxsss@aim.com> wrote:

> Hello,
> I was unable to find any information regarding relationship between
> mapred slots and number of cpus on the net. All I found was that it is
> advisable to schedule two processes for one cpu.  If this is true, then for
> a slave  node with dual core( two cpus) that runs datanode, tasktracker,
> hbase regionserver and zookeeper, theoretically there is no space to run
> an additional mapred task. Any comment on this is welcome.
> In general what is the mapred slot and how is it related to number of cpu
> cores?
> Thanks in advance.
> Alex.

View raw message