Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8D100D59C for ; Thu, 11 Oct 2012 20:24:28 +0000 (UTC) Received: (qmail 24506 invoked by uid 500); 11 Oct 2012 20:24:26 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 24464 invoked by uid 500); 11 Oct 2012 20:24:26 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 24453 invoked by uid 99); 11 Oct 2012 20:24:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Oct 2012 20:24:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of kevin.odell@cloudera.com designates 209.85.212.41 as permitted sender) Received: from [209.85.212.41] (HELO mail-vb0-f41.google.com) (209.85.212.41) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Oct 2012 20:24:19 +0000 Received: by mail-vb0-f41.google.com with SMTP id v13so2667973vbk.14 for ; Thu, 11 Oct 2012 13:23:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=6t8d6ZPJd+7KbmpVx4mWzeEqOcRgyuHRN9wHoDpIDe0=; b=dQpGYLtbKv2ezvxF4fSf/2piy6A8XkERhPVB7B5rzcGqzeJlP419KheqsPIEaWtoMj gO8XFEzw2O0u6CbLBlK1p13I/O+f8F+cVEM09ow5//UlXJQpuQgA31BGIqax04Kb0DPR lYt05Gn1F84zO1o0yL1PgZiGmOiNT6D2+kITi0/+6xxgcNFyrxgG2j2m6jra2J0pOavk 2ojAuIQCRQTFcPXJsyiN8PZPtgugVJUM+8W39vKRySMhA0oH1+RCQpiU+51o7+7V4XPU mUjfuU+5lczvFTa9xIcj1bzWgmvfByYj8dczmGeQKU6HEPQ0sIIh03ieLROPmKYaYwAi WK4A== MIME-Version: 1.0 Received: by 10.52.21.81 with SMTP id t17mr950150vde.97.1349987038424; Thu, 11 Oct 2012 13:23:58 -0700 (PDT) Received: by 10.58.243.71 with HTTP; Thu, 11 Oct 2012 13:23:58 -0700 (PDT) In-Reply-To: References: Date: Thu, 11 Oct 2012 16:23:58 -0400 Message-ID: Subject: Re: Force the number of map tasks in MR? From: "Kevin O'dell" To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=20cf307cfd4ae06e9204cbce59b8 X-Gm-Message-State: ALoCoQlTodyYEWqDVmSliIEfA3xRhEBP8zkoGGUG6KD2ZqdPq6aoElHZKGK/MSV1L1xs6H03q35X --20cf307cfd4ae06e9204cbce59b8 Content-Type: text/plain; charset=ISO-8859-1 What are you max tasks set to? On Thu, Oct 11, 2012 at 3:59 PM, Jean-Marc Spaggiari < jean-marc@spaggiari.org> wrote: > Hi, > > Is there a way to force the number of map tasks in a MR? > > I have a 25 regions table splitted over 6 nodes. But the MR is running > the tasks only 2 by 2. > > Is there a way to force it to run one task on each regionserver > serving at least one region? Why is the MR waiting for 2 taskes to > complete before sending to the other tasks? > > I'm starting the MR with a caching of 100. > > I tried mapred.map.tasks and speculative=false with no success. > > Any idea how I can increase it this number of tasks? > > Thanks, > > JM > -- Kevin O'Dell Customer Operations Engineer, Cloudera --20cf307cfd4ae06e9204cbce59b8--