Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 93D4F970B for ; Fri, 30 Mar 2012 22:12:46 +0000 (UTC) Received: (qmail 20385 invoked by uid 500); 30 Mar 2012 22:12:44 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 20338 invoked by uid 500); 30 Mar 2012 22:12:44 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 20319 invoked by uid 99); 30 Mar 2012 22:12:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 22:12:44 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jdcryans@gmail.com designates 209.85.210.169 as permitted sender) Received: from [209.85.210.169] (HELO mail-iy0-f169.google.com) (209.85.210.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 22:12:39 +0000 Received: by iajr24 with SMTP id r24so2065050iaj.14 for ; Fri, 30 Mar 2012 15:12:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=KeLLtnTNCSH8cAY/Ij5PYxHax/HIrInY32MWpskHXLQ=; b=iUVXPlqlHKDG2S9+m8znF03wGl0L7ugJ2gkJtfJl59hULr9J+XBHE5Q5QZ/Blv5jQ1 B8/KwRwQB55LJuVBu+hJv0eo4TO9iFof2vXB7xntFTTXyWM715nNYCSXynix1mk2dx9G PFDDCnkA+hqiXAKADnfYWOiJnqYMg8JjtsM67cy8od9O4XKoZymrPvfzymoT6O1CbeIv Wyly7z7ORqCY4IUaaOcOCpefpOX/VZOjQG1uFyJPP7r6jEtban0qyIXMiI/bP8o6jL5Y yjZVVqPH5VeQpxWfyEXdsss4VkD8LFhjEgCXDJWNqgS83YrRHeJnC0TA+EXHgRYEqgxl fenQ== MIME-Version: 1.0 Received: by 10.50.161.228 with SMTP id xv4mr229230igb.19.1333145539056; Fri, 30 Mar 2012 15:12:19 -0700 (PDT) Sender: jdcryans@gmail.com Received: by 10.231.3.148 with HTTP; Fri, 30 Mar 2012 15:12:19 -0700 (PDT) In-Reply-To: References: Date: Fri, 30 Mar 2012 15:12:19 -0700 X-Google-Sender-Auth: Ie8p8FjB82qwF9Xv1zQMsO6gFDs Message-ID: Subject: Re: HBase bulk loader doing speculative execution when it set to false in mapred-site.xml From: Jean-Daniel Cryans To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Well that's not an HBase configuration, that's Hadoop. I'm not sure if this is listed anywhere, maybe in the book. BTW usually HBase has a "client" somewhere in the same to indicate it's client side. J-D On Fri, Mar 30, 2012 at 3:08 PM, anil gupta wrote: > Thanks for the quick reply, Jean. Is there any link where i can find the > name of all client-side configuration for HBase? > > ~Anil > > On Fri, Mar 30, 2012 at 3:01 PM, Jean-Daniel Cryans wrote: > >> This is a client-side configuration so if your mapred-site.xml is >> _not_ on your classpath when you start the bulk load, it's not going >> to pick it up. So either have that file on your classpath, or put it >> in whatever other configuration file you have. >> >> J-D >> >> On Fri, Mar 30, 2012 at 2:52 PM, anil gupta wrote: >> > Hi All, >> > >> > I am using cdh3u2. I ran HBase bulk loading with property >> > "mapred.reduce.tasks.speculative.execution" set to "false" in >> > mapred-site.xml. Still, i can see 6 killed task in Bulk Loading job and >> > after short analysis i realized that these jobs are killed because >> another >> > worker node completed the task, hence it means that speculative execution >> > is still on. Why the HBase Bulk loader is doing speculative execution >> when >> > i have set it to false in mapred-site.xml? Please let me know if i am >> > missing something over here. >> > >> > -- >> > Thanks & Regards, >> > Anil Gupta >> > > > > -- > Thanks & Regards, > Anil Gupta