hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhe Li <allenlee...@gmail.com>
Subject Re: Is there any way to limit the concurrent running mappers per job?
Date Sun, 26 Apr 2015 08:02:19 GMT
Great, thanks you guys.

On Fri, Apr 24, 2015 at 12:07 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:

> Thanks for the info Harsh,
> MAPREDUCE-5583 also states the scenario where this configuration would be
> useful !
>
> +Naga
> ________________________________________
> From: Harsh J [harsh@cloudera.com]
> Sent: Thursday, April 23, 2015 11:24
> To: <user@hadoop.apache.org>
> Subject: Re: Is there any way to limit the concurrent running mappers per
> job?
>
> This has been introduced as a 2.7.0 feature, see MAPREDUCE-5583.
>
> On Tue, Apr 21, 2015 at 4:32 AM, Zhe Li <allenlee.lz@gmail.com> wrote:
> > Hi, after upgraded to Hadoop 2 (yarn), I found that
> > 'mapred.jobtracker.taskScheduler.maxRunningTasksPerJob' no longer worked,
> > right?
> >
> > One workaround is to use queue to limit it, but it's not easy to control
> it
> > from job submitter.
> > Is there any way to limit the concurrent running mappers per job?
> > Any documents or discussions before?
> >
> > BTW, any way to search this mailing list before I post a new question?
> >
> > Thanks very much.
>
>
>
> --
> Harsh J
>

Mime
View raw message