Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E9BDF18C5C for ; Sun, 3 Jan 2016 12:19:33 +0000 (UTC) Received: (qmail 90407 invoked by uid 500); 3 Jan 2016 12:19:30 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 90298 invoked by uid 500); 3 Jan 2016 12:19:30 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 90287 invoked by uid 99); 3 Jan 2016 12:19:29 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Jan 2016 12:19:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 40E091A0723 for ; Sun, 3 Jan 2016 12:19:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.9 X-Spam-Level: *** X-Spam-Status: No, score=3.9 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 3v75FmiKsVQG for ; Sun, 3 Jan 2016 12:19:21 +0000 (UTC) Received: from mail-qk0-f171.google.com (mail-qk0-f171.google.com [209.85.220.171]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 8059520533 for ; Sun, 3 Jan 2016 12:19:21 +0000 (UTC) Received: by mail-qk0-f171.google.com with SMTP id n135so120760301qka.2 for ; Sun, 03 Jan 2016 04:19:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=yCll8iHbegbDta+7SODk/Gjd0pmX1Le/7fyqxAKuoNM=; b=qOCadlSqacDLKum8X6nWZbNDxBXQxeCsMXgwhKtC0IhrdlkTpsSHgQj7av8mCBE0W2 TA0drVzgNGlA3l62mu3kUWxrLASkQon8KNYEZUBcHwrH/4m6YLtJnQGrkHyDO0RBO7Sb OkNWJ/mvjVmzPX8Pi7y9utGHx6ayuSoCae1pl64xtyDaixS1516pPS4VW+3+IB+vDwXw xqnPC7o+OUWmvTEycFjsbqbFJn5F+o+ligMRRMPz1E2cDHXLT5KFNPftH/6k0N8E5LGJ 4y+x0ydZnEH9OQ7xmW3aYLk6vOSYDjK4G9KJvsiDud+jwdhY7gyiXQrukf8LA8DtUzzN ih2w== X-Received: by 10.55.75.131 with SMTP id y125mr45409735qka.61.1451823555800; Sun, 03 Jan 2016 04:19:15 -0800 (PST) Received: from [10.10.0.11] (cpe-67-253-83-72.maine.res.rr.com. [67.253.83.72]) by smtp.gmail.com with ESMTPSA id v65sm9596227qhc.46.2016.01.03.04.19.14 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 03 Jan 2016 04:19:15 -0800 (PST) Content-Type: multipart/alternative; boundary="Apple-Mail=_448E9CF3-827E-4D21-A0A0-FE51CD281C71" Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) Subject: Re: mapreduce.job.running.map.limit has no effect From: Brian Jeltema In-Reply-To: Date: Sun, 3 Jan 2016 07:19:13 -0500 Cc: Namikaze Minato , "user@hadoop.apache.org" Message-Id: References: <666FA6E7-12F0-4011-895F-344E622715B2@gmail.com> To: Tianyin Xu X-Mailer: Apple Mail (2.3096.5) --Apple-Mail=_448E9CF3-827E-4D21-A0A0-FE51CD281C71 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 It was one job (otherwise, the question makes no sense).=20 But at this point, it=E2=80=99s ancient history. > On Jan 2, 2016, at 11:57 PM, Tianyin Xu wrote: >=20 > Are these 35 map tasks from one job or different jobs? >=20 > ~t >=20 >=20 > On Wed, Dec 2, 2015 at 11:32 AM, Namikaze Minato = > wrote: > Looks like a bug to me :/ >=20 > On 2 December 2015 at 17:49, Brian Jeltema > wrote: > I=E2=80=99m running Hadoop 2.7.1. I tried to limit the number of = concurrent map tasks using > mapreduce.job.running.map.limit=3D5, but that property had no effect = on the number > of tasks (35 concurrently running in my case). I checked the value of = that property > in the job history, and it was set correctly. Is this a bug or have I = overlooked something? >=20 > Thanks > Brian > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org = > For additional commands, e-mail: user-help@hadoop.apache.org = >=20 >=20 >=20 >=20 >=20 > --=20 > Tianyin XU, > http://cseweb.ucsd.edu/~tixu/ --Apple-Mail=_448E9CF3-827E-4D21-A0A0-FE51CD281C71 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 It was one job (otherwise, the question makes no = sense). 
But at this point, it=E2=80=99s ancient = history.

On Jan 2, 2016, at 11:57 PM, = Tianyin Xu <tixu@cs.ucsd.edu> wrote:

Are these 35 map tasks from one job or = different jobs?

~t


On Wed, = Dec 2, 2015 at 11:32 AM, Namikaze Minato <lloydsensei@gmail.com> wrote:
Looks like a bug to me :/

On 2 December 2015 at 17:49, Brian Jeltema <bdjeltema@gmail.com> = wrote:
I=E2=80=99m = running Hadoop 2.7.1. I tried to limit the number of concurrent map = tasks using
mapreduce.job.running.map.limit=3D5, but that property had no effect on = the number
of tasks (35 concurrently running in my case). I checked the value of = that property
in the job history, and it was set correctly. Is this a bug or have I = overlooked something?

Thanks
Brian
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org





--
Tianyin XU,
http://cseweb.ucsd.edu/~tixu/

= --Apple-Mail=_448E9CF3-827E-4D21-A0A0-FE51CD281C71--