hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: Container size configuration
Date Thu, 13 Jun 2013 16:47:22 GMT
Hi Yuzhang,

Moving this question to the Hadoop user list.

Are you using MapReduce or writing your own YARN application?  In
MapReduce, all maps must request the same amount of memory and all reduces
must request the same amount of memory.  It would be trivial to do this in
your own YARN application.


On Thu, Jun 13, 2013 at 8:41 AM, Yuzhang Han <yuzhanghan1982@gmail.com>wrote:

> Hi,
> I am wondering if I can allocate different size of containers to the tasks
> in a job. For example: Job = <Task1, Task2, Task3>, Task1 = Task2 = 1024MB,
> Task3 = 2048MB. How can I achieve this? Many thanks.
> Yuzhang

View raw message