Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@locus.apache.org Received: (qmail 1489 invoked from network); 5 Sep 2008 23:01:16 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 5 Sep 2008 23:01:16 -0000 Received: (qmail 66282 invoked by uid 500); 5 Sep 2008 23:01:13 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 66262 invoked by uid 500); 5 Sep 2008 23:01:13 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 66251 invoked by uid 99); 5 Sep 2008 23:01:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Sep 2008 16:01:13 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [63.203.238.117] (HELO dns.duboce.net) (63.203.238.117) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Sep 2008 23:00:14 +0000 Received: by dns.duboce.net (Postfix, from userid 1008) id A2003C563; Fri, 5 Sep 2008 14:27:34 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-26) on dns.duboce.net X-Spam-Level: Received: from durruti.local (durruti.desk.hq.powerset.com [208.84.6.28]) by dns.duboce.net (Postfix) with ESMTP id 1A1EAC51B for ; Fri, 5 Sep 2008 14:27:24 -0700 (PDT) Message-ID: <48C1B9E7.1010707@duboce.net> Date: Fri, 05 Sep 2008 15:59:51 -0700 From: stack User-Agent: Thunderbird 2.0.0.16 (Macintosh/20080707) MIME-Version: 1.0 To: hbase-user@hadoop.apache.org Subject: Re: missing rows in MR process References: <86199EDF-FF88-4B5C-B1CC-E5160B774944@gmail.com> In-Reply-To: <86199EDF-FF88-4B5C-B1CC-E5160B774944@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Status: No, score=-2.4 required=5.0 tests=AWL,BAYES_00, FORGED_RCVD_HELO autolearn=ham version=3.1.4 This is odd Dru. Do you think you are seeing https://issues.apache.org/jira/browse/HBASE-856? Are you using filters? St.Ack Dru Jensen wrote: > hbase-users, > > I have two MR processes that run one right after the other in a > script. The first reads from a file and populates a table. The > second uses a TableMap over that table that was just populated. > > The first MR process inserted 1950 rows successfully and everything > looked correct. For some reason the second MR process only got 76 > rows as input. I ran the exact same MR process and the second time it > got all 1950 rows. > > Is there some time delay between the MR batch update of the first > process and the scan of the second? How can i make sure this commit > is complete before launching the second MR process? > > This is using the Release Candidate 0.2.1 running on Hadoop 0.17.2.1. > > thanks, > Dru > >