Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DD2E19DEF for ; Fri, 30 Mar 2012 21:53:20 +0000 (UTC) Received: (qmail 65897 invoked by uid 500); 30 Mar 2012 21:53:19 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 65856 invoked by uid 500); 30 Mar 2012 21:53:19 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 65847 invoked by uid 99); 30 Mar 2012 21:53:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 21:53:19 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of anilgupta84@gmail.com designates 74.125.82.169 as permitted sender) Received: from [74.125.82.169] (HELO mail-we0-f169.google.com) (74.125.82.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 21:53:12 +0000 Received: by werj55 with SMTP id j55so858613wer.14 for ; Fri, 30 Mar 2012 14:52:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=IYwGsbD8VKXxZwdvIoWogDeeKXYUwuN3J4IeV2j+CFs=; b=lxjwVZQrbn/oDm7D2DmRILloPF/plelG4NpMiRHc9xtUDSzRl4riWrHW6NSQB3W/+G 2Xf9SPvVtsqe8a4yH4X5Zx1p2QX2WUDxJLBYKl2aILNTnZwjDASYHqLerAo3vUDIOFfn DgcXHMf2IcmPTLOtPEJX0XFgZEDegG7BfDVSlhmSpUAgil0XitojQEUd4bOIeJ4tR0Z/ 33opH6WCx9o1Q8exJkO5pfE3Z8ahO2ATRPlzfTleIX9OweSpM2skLQo3uRUa01YQ14B6 miEK4pDgObxgYPcDkPm3apW6hjL3KjG8jR60GlrnUXYvjq+P8nSMdL5mOne12Dj4pCHl 07Fg== Received: by 10.180.95.129 with SMTP id dk1mr411667wib.3.1333144371404; Fri, 30 Mar 2012 14:52:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.85.98 with HTTP; Fri, 30 Mar 2012 14:52:31 -0700 (PDT) From: anil gupta Date: Fri, 30 Mar 2012 14:52:31 -0700 Message-ID: Subject: HBase bulk loader doing speculative execution when it set to false in mapred-site.xml To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=f46d0444ee2db11edf04bc7cdcf5 X-Virus-Checked: Checked by ClamAV on apache.org --f46d0444ee2db11edf04bc7cdcf5 Content-Type: text/plain; charset=ISO-8859-1 Hi All, I am using cdh3u2. I ran HBase bulk loading with property "mapred.reduce.tasks.speculative.execution" set to "false" in mapred-site.xml. Still, i can see 6 killed task in Bulk Loading job and after short analysis i realized that these jobs are killed because another worker node completed the task, hence it means that speculative execution is still on. Why the HBase Bulk loader is doing speculative execution when i have set it to false in mapred-site.xml? Please let me know if i am missing something over here. -- Thanks & Regards, Anil Gupta --f46d0444ee2db11edf04bc7cdcf5--