Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: yarn-dev@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of lohit.vijayarenu@gmail.com
 designates 209.85.210.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <CCEF8FF5.2B876%tgraves@yahoo-inc.com>
References: 
 <CA+01ahh02RfByEEb7wRE7SkC8s01TEGuUKVYsgySmELpy0AkSQ@mail.gmail.com>
	<CCEF8FF5.2B876%tgraves@yahoo-inc.com>
Date: Thu, 13 Dec 2012 12:07:05 -0800
Message-ID: 
 <CA+01ahgsKemxWBOrj5uojWQTbS5_f9rxUx-HqeiY7DiaUTt+NQ@mail.gmail.com>
Subject: Re: Uneven distribution of container allocations
From: lohit <lohit.vijayarenu@gmail.com>
To: yarn-dev@hadoop.apache.org
Content-Type: multipart/alternative; boundary=90e6ba21243387f0d204d0c175fe

--90e6ba21243387f0d204d0c175fe
Content-Type: text/plain; charset=UTF-8

I am running hadoop-2.0.3 alpha branch.
Right now I am trying TestDFSIO, where I would like to have even
distribution of tasks.
As soon as I submit job RM tends to allocate as many containers as possible
from subset of nodes.

2012/12/13 Thomas Graves <tgraves@yahoo-inc.com>

> What kind of job are you running?  What version of YARN?
>
> Tom
>
> On 12/13/12 12:24 AM, "lohit" <lohit.vijayarenu@gmail.com> wrote:
>
> >Hi Devs,
> >
> >I am running few experiments on YARN. On a 50 node cluster I run only one
> >job.
> >If I kick off job with 150 tasks, I would expect on an average 3 tasks in
> >containers per node.
> >But I see many nodes end up having 29-30 containers spawned and many
> >without any tasks at all.
> >Do I have to use some kind of parameter (delayed scheduling) to achieve
> >even distribution?
> >
> >--
> >Have a Nice Day!
> >Lohit
>
>


-- 
Have a Nice Day!
Lohit

--90e6ba21243387f0d204d0c175fe--