hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stanley Shi <s...@gopivotal.com>
Subject Re: number of map tasks on yarn
Date Wed, 02 Apr 2014 02:23:01 GMT
map task number is not decided by the resources you need.
It's decided by something else.

Regards,
*Stanley Shi,*



On Wed, Apr 2, 2014 at 9:08 AM, Libo Yu <yu_libo@hotmail.com> wrote:

> Hi all,
>
> I pretty much use the default yarn setting to run a word count example on
> a 3 node cluster. Here are my settings:
> yarn.nodemanager.resource.memory-mb 8192
> yarn.scheduler.minimum-allocation-mb 1024
> yarn.scheduler.maximum-allocation-vcores 32
>
> I would expect to see 8192/1024 * 3 = 24 map tasks.
> However, I see 32 map tasks. Anybody knows why? Thanks.
>
> Libo
>
>

Mime
View raw message