Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0279640D1 for ; Tue, 21 Jun 2011 17:09:09 +0000 (UTC) Received: (qmail 92865 invoked by uid 500); 21 Jun 2011 17:09:08 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 92825 invoked by uid 500); 21 Jun 2011 17:09:08 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 92817 invoked by uid 99); 21 Jun 2011 17:09:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Jun 2011 17:09:08 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of joey@cloudera.com designates 209.85.215.176 as permitted sender) Received: from [209.85.215.176] (HELO mail-ey0-f176.google.com) (209.85.215.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Jun 2011 17:09:01 +0000 Received: by eya28 with SMTP id 28so1182378eya.35 for ; Tue, 21 Jun 2011 10:08:40 -0700 (PDT) MIME-Version: 1.0 Received: by 10.14.101.144 with SMTP id b16mr2819171eeg.244.1308676120370; Tue, 21 Jun 2011 10:08:40 -0700 (PDT) Received: by 10.14.185.130 with HTTP; Tue, 21 Jun 2011 10:08:40 -0700 (PDT) In-Reply-To: References: Date: Tue, 21 Jun 2011 13:08:40 -0400 Message-ID: Subject: Re: tasktracker maximum map tasks for a certain job From: Joey Echeverria To: mapreduce-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable The only way to do that is to drop the setting down to one and bounce the TaskTrackers. -Joey On Tue, Jun 21, 2011 at 12:52 PM, Jonathan Zukerman wrote: > Hi, > Is there a way to set the maximum map tasks for all tasktrackers in my > cluster for a certain job? > Most of my tasktrackers are configured to handle 4 maps=A0concurrently, a= nd > most of my jobs don't care where does the map function run. But small par= t > of my jobs requires that no two map functions will run from the same IP a= t > the same time, i.e., the maximum number of map tasks for each tasktracker > should be 1 for these jobs. > Thanks! > Jonathan. --=20 Joseph Echeverria Cloudera, Inc. 443.305.9434