Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2003E797A for ; Tue, 23 Aug 2011 23:08:21 +0000 (UTC) Received: (qmail 28840 invoked by uid 500); 23 Aug 2011 23:08:20 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 28761 invoked by uid 500); 23 Aug 2011 23:08:20 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 28753 invoked by uid 99); 23 Aug 2011 23:08:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2011 23:08:20 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com) (209.85.160.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2011 23:08:12 +0000 Received: by gyg13 with SMTP id 13so673133gyg.35 for ; Tue, 23 Aug 2011 16:07:51 -0700 (PDT) Received: by 10.236.184.129 with SMTP id s1mr27336350yhm.33.1314140871223; Tue, 23 Aug 2011 16:07:51 -0700 (PDT) Received: from [10.10.10.112] (host1.hortonworks.com [70.35.59.2]) by mx.google.com with ESMTPS id a62sm609871yhe.53.2011.08.23.16.07.50 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 23 Aug 2011 16:07:50 -0700 (PDT) From: Arun C Murthy Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: multipart/alternative; boundary=Apple-Mail-84-826219757 Subject: Re: Capacity scheduler uses all slots from the same tasktracker Date: Tue, 23 Aug 2011 16:07:48 -0700 In-Reply-To: To: mapreduce-user@hadoop.apache.org References: Message-Id: X-Mailer: Apple Mail (2.1084) --Apple-Mail-84-826219757 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Were they all 'data-local' or 'rack-local' tasks? If so, it's expected. Arun On Aug 23, 2011, at 3:51 PM, Sulabh Choudhury wrote: > Hi, >=20 > So I just started using capacity scheduler for M/R jobs. I have 4 task = trackers each with 4 map/reduce slots. > Configured a queue so that it uses 25% (4 slots) of the available = slots. I was expecting that it would distribute the job and use slots = from each of the 4 tasktrackers but it actually uses all 4 slots from a = single TT. > Is there a configuration I am missing or this is the expected behavior = ? >=20 >=20 --Apple-Mail-84-826219757 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Were = they all 'data-local' or 'rack-local' tasks? If so, it's = expected.

Arun

On Aug 23, = 2011, at 3:51 PM, Sulabh Choudhury wrote: