hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michel Segel <michael_se...@hotmail.com>
Subject Re: Control Resources / Cores assigned for a job
Date Sat, 17 Mar 2012 01:03:41 GMT
Fair scheduler?

Sent from a remote device. Please excuse any typos...

Mike Segel

On Mar 16, 2012, at 5:54 PM, Deepak Nettem <deepaknettem@gmail.com> wrote:

> Hi,
> I want to be able to control the number of nodes assigned to a MR job on
> the cluster. For example, I want the job to not execute more than 10
> Mappers at a time, irrespective of whether there are more nodes available
> or not.
> I don't wish to control the number of mappers that are created by the job.
> The number of mappers is tied to the problem size / input data and on my
> input splits. I want it to remain that way.
> Is this possible? If so, what's the best way to do this?
> Deepak

View raw message