Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 50015 invoked from network); 1 Sep 2009 17:10:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 Sep 2009 17:10:55 -0000 Received: (qmail 85898 invoked by uid 500); 1 Sep 2009 17:10:55 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 85821 invoked by uid 500); 1 Sep 2009 17:10:55 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 85628 invoked by uid 99); 1 Sep 2009 17:10:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Sep 2009 17:10:54 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Sep 2009 17:10:52 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id D2208234C04C for ; Tue, 1 Sep 2009 10:10:32 -0700 (PDT) Message-ID: <813387986.1251825032859.JavaMail.jira@brutus> Date: Tue, 1 Sep 2009 10:10:32 -0700 (PDT) From: "Jean-Daniel Cryans (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-1806) Scanners do not respect row locks; scanner view could return a skewed view on row if ongoing update In-Reply-To: <459912136.1251780332737.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749994#action_12749994 ] Jean-Daniel Cryans commented on HBASE-1806: ------------------------------------------- I bet this issue is playing a lot against us on small clusters under high load, at least 1784 can temporarily help fixing that. > Scanners do not respect row locks; scanner view could return a skewed view on row if ongoing update > --------------------------------------------------------------------------------------------------- > > Key: HBASE-1806 > URL: https://issues.apache.org/jira/browse/HBASE-1806 > Project: Hadoop HBase > Issue Type: Bug > Reporter: stack > > What I'm seeing is that BaseScanner misses updates made by an update milliseconds before -- even hundreds of milliseconds before. See hbase-1784 where I'm seeing double-assignment of regions. > Scanners do not respect row locks. They should else could return a row with partial updates committed. What if a .META. region has tens of storefiles and a scan does a get full row which takes a long time. Say an update comes in during this read. First it will go in because no row lock is outstanding. Second, we'll miss the edit given we look at things in order -- memstore, then each storefile down to the oldest. What if the update is followed by an update of server state; e.g. region is moved out of intransition state? And inside in same server, say the master, it makes decisions dependent on what it sees when it does a scanner#next; e.g. BaseScanner checking for assignment? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.