Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 78541 invoked from network); 26 Aug 2009 08:04:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 26 Aug 2009 08:04:21 -0000 Received: (qmail 62132 invoked by uid 500); 26 Aug 2009 08:04:21 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 62077 invoked by uid 500); 26 Aug 2009 08:04:21 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 62066 invoked by uid 99); 26 Aug 2009 08:04:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Aug 2009 08:04:21 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Aug 2009 08:04:19 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 4251B234C04C for ; Wed, 26 Aug 2009 01:03:59 -0700 (PDT) Message-ID: <682783602.1251273839267.JavaMail.jira@brutus> Date: Wed, 26 Aug 2009 01:03:59 -0700 (PDT) From: "Mathias Herberts (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-1784) Missing rows after medium intensity insert In-Reply-To: <1136031346.1250884394795.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747820#action_12747820 ] Mathias Herberts commented on HBASE-1784: ----------------------------------------- A scan of the table shows that rows from the region 0TE181121109t\x90_\x7F\xFF\xFF\xFE,1251257023139 whose compaction failed are indeed gone, so this clearly shows that missing rows are indeed linked to the failed compaction. > Missing rows after medium intensity insert > ------------------------------------------ > > Key: HBASE-1784 > URL: https://issues.apache.org/jira/browse/HBASE-1784 > Project: Hadoop HBase > Issue Type: Bug > Affects Versions: 0.20.0 > Reporter: Jean-Daniel Cryans > Priority: Blocker > Attachments: DataLoad.java, HBASE-1784.log > > > This bug was uncovered by Mathias in his mail "Issue on data load with 0.20.0-rc2". Basically, somehow, after a medium intensity insert a lot of rows goes missing. Easy way to reproduce : PE. Doing a PE scan or randomRead afterwards won't uncover anything since it doesn't bother about null rows. Simply do a count in the shell, easy to test (I changed my scanner caching in the shell to do it faster). > I tested some light insertions with force flush/compact/split in the shell and it doesn't break. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.