hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Serge Blazhievsky <Serge.Blazhiyevs...@nice.com>
Subject Re: 1gb allocated per thread for input read
Date Fri, 13 Apr 2012 21:19:40 GMT
Per thread or per task?

On 4/13/12 2:17 PM, "Barry, Sean F" <sean.f.barry@intel.com> wrote:

>*FYI this is a proof of concept cluster*
>In my two node cluster that consists of
>Master - Jobtracker, Datanode, Namenode, tasktracker, Secondarynamenode
>Slave - Datenode , tasktraker
>I have no more than 8g of ram on my slave and even less on the master and
>I am currently running 4 tasks on the slave and 2 on the master. My issue
>is that: is there a way where I can make sure that no more than 1g per
>thread  is allocated to read a large input file for my job?

View raw message