hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (Naga)" <garlanaganarasi...@huawei.com>
Subject RE: Is there any way to limit the concurrent running mappers per job?
Date Fri, 24 Apr 2015 04:07:15 GMT
Thanks for the info Harsh,
MAPREDUCE-5583 also states the scenario where this configuration would be useful !

+Naga
________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Thursday, April 23, 2015 11:24
To: <user@hadoop.apache.org>
Subject: Re: Is there any way to limit the concurrent running mappers per job?

This has been introduced as a 2.7.0 feature, see MAPREDUCE-5583.

On Tue, Apr 21, 2015 at 4:32 AM, Zhe Li <allenlee.lz@gmail.com> wrote:
> Hi, after upgraded to Hadoop 2 (yarn), I found that
> 'mapred.jobtracker.taskScheduler.maxRunningTasksPerJob' no longer worked,
> right?
>
> One workaround is to use queue to limit it, but it's not easy to control it
> from job submitter.
> Is there any way to limit the concurrent running mappers per job?
> Any documents or discussions before?
>
> BTW, any way to search this mailing list before I post a new question?
>
> Thanks very much.



--
Harsh J

Mime
View raw message