Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 57ACA103E6 for ; Thu, 8 Aug 2013 04:04:58 +0000 (UTC) Received: (qmail 4830 invoked by uid 500); 8 Aug 2013 04:04:53 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 4730 invoked by uid 500); 8 Aug 2013 04:04:53 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 4722 invoked by uid 99); 8 Aug 2013 04:04:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Aug 2013 04:04:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of azuryyyu@gmail.com designates 209.85.212.50 as permitted sender) Received: from [209.85.212.50] (HELO mail-vb0-f50.google.com) (209.85.212.50) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Aug 2013 04:04:49 +0000 Received: by mail-vb0-f50.google.com with SMTP id x14so2736729vbb.23 for ; Wed, 07 Aug 2013 21:04:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=N2g9pG88NGWq6ykTeQ1UvNuPdiWkNAw/AbfwSM/sFNw=; b=RjYKtZiR8Vf/RFpzduZIHaKvxLsdx2OVj3XAqgVUledm/JGdnb6jFmXMOnci3e/KJl qZEA5Z6wvQbvjG7Ozf753mNuYfzJ74EdcoHa9wYH12eq4lxzmZbEUsFy9Bkz13Cg0mR2 sl9B2qiB800d2MPDEcuNqA1HCmlzXeYNF1EBFuTTRiOszxwcqSySku8gScj55LwrajIA VNC54EvSJhQa1J8RCl+xtP+ZE7gnHIdpLtA0XuzpwVpNryhQ669SebdmyWAonveCnL7C P29ZCbQ1npcyufzTAZgoq10HDqBS1p3BMrkibiwZ6vHZB/nd5JP0TCkcRMNdGIhYcLQy k7SA== MIME-Version: 1.0 X-Received: by 10.52.75.162 with SMTP id d2mr1766228vdw.86.1375934668344; Wed, 07 Aug 2013 21:04:28 -0700 (PDT) Received: by 10.221.1.146 with HTTP; Wed, 7 Aug 2013 21:04:28 -0700 (PDT) In-Reply-To: References: <06006DDA5A27D541991944AC4117E7A96E1F18FE@szxeml560-mbx.china.huawei.com> Date: Thu, 8 Aug 2013 12:04:28 +0800 Message-ID: Subject: Re: specify Mapred tasks and slots From: Azuryy Yu To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec501617d244d9504e367c17a X-Virus-Checked: Checked by ClamAV on apache.org --bcaec501617d244d9504e367c17a Content-Type: text/plain; charset=ISO-8859-1 Thanks Harsh and all friends response. That's helpful. On Thu, Aug 8, 2013 at 11:55 AM, Harsh J wrote: > What Devaraj said. Except that if you use CapacityScheduler, then you > can bind together memory requests and slot concepts, and be able to have a > task > grab more than one slot for itself when needed. We've discussed this > aspect previously at http://search-hadoop.com/m/gnFs91yIg1e > > On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k wrote: > > One task can use only one slot, It cannot use more than one slot. If the > > task is Map task then it will use one map slot and if the task is reduce > > task the it will use one reduce slot from the configured ones. > > > > > > > > Thanks > > > > Devaraj k > > > > > > > > From: Azuryy Yu [mailto:azuryyyu@gmail.com] > > Sent: 08 August 2013 08:27 > > To: user@hadoop.apache.org > > Subject: Re: specify Mapred tasks and slots > > > > > > > > My question is can I specify how many slots to be used for each M/R task? > > > > > > > > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma > > wrote: > > > > Slots are decided upon the configuration of machines, RAM etc... > > > > > > Regards, > > > > Som Shekhar Sharma > > > > +91-8197243810 > > > > > > > > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu wrote: > > > > Hi Dears, > > > > > > > > Can I specify how many slots to use for reduce? > > > > > > > > I know we can specify reduces tasks, but is there one task occupy one > slot? > > > > > > > > it it possible that one tak occupy more than one slot in Hadoop-1.1.2. > > > > > > > > Thanks. > > > > > > > > > > > > -- > Harsh J > --bcaec501617d244d9504e367c17a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks Harsh and all friends response. That's hel= pful.
=A0


On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <harsh@clouder= a.com> wrote:
What Devaraj said. Except that if you use Ca= pacityScheduler, then you
can bind together memory requests and slot concepts, and be able to have a = task
grab more than one slot for itself when needed. We've discussed this aspect previously at http://search-hadoop.com/m/gnFs91yIg1e

On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <devaraj.k@huawei.com> wrote:
> One task can use only one slot, It cannot use more than one slot. If t= he
> task is Map task then it will use one map slot and if the task is redu= ce
> task the it will use one reduce slot from the configured ones.
>
>
>
> Thanks
>
> Devaraj k
>
>
>
> From: Azuryy Yu [mailto:azuryyyu= @gmail.com]
> Sent: 08 August 2013 08:27
> To: user@hadoop.apache.org
> Subject: Re: specify Mapred tasks and slots
>
>
>
> My question is can I specify how many slots to be used for each M/R ta= sk?
>
>
>
> On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <shekhar2581@gmail.com>
> wrote:
>
> Slots are decided upon the configuration of machines, RAM etc...
>
>
> Regards,
>
> Som Shekhar Sharma
>
> +91-8197243810
>
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <azuryyyu@gmail.com> wrote:
>
> Hi Dears,
>
>
>
> Can I specify how many slots to use for reduce?
>
>
>
> I know we can specify reduces tasks, but is there one task occupy one = slot?
>
>
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.=
>
>
>
> Thanks.
>
>
>
>



--
Harsh J

--bcaec501617d244d9504e367c17a--