Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 28953 invoked from network); 13 Aug 2009 03:52:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 13 Aug 2009 03:52:31 -0000 Received: (qmail 68161 invoked by uid 500); 13 Aug 2009 03:52:37 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 68052 invoked by uid 500); 13 Aug 2009 03:52:36 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 68030 invoked by uid 99); 13 Aug 2009 03:52:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Aug 2009 03:52:36 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Aug 2009 03:52:34 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id CACE9234C004 for ; Wed, 12 Aug 2009 20:52:14 -0700 (PDT) Message-ID: <178786281.1250135534815.JavaMail.jira@brutus> Date: Wed, 12 Aug 2009 20:52:14 -0700 (PDT) From: "stack (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Updated: (HBASE-1738) Scanner doesnt reset when a snapshot is created, could miss new updates into the 'kvset' (active part) In-Reply-To: <4972833.1249341434827.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-1738: ------------------------- Fix Version/s: (was: 0.20.1) 0.20.0 Moving to 0.20.0. Bad bug and patch is almost there. > Scanner doesnt reset when a snapshot is created, could miss new updates into the 'kvset' (active part) > ------------------------------------------------------------------------------------------------------ > > Key: HBASE-1738 > URL: https://issues.apache.org/jira/browse/HBASE-1738 > Project: Hadoop HBase > Issue Type: Bug > Affects Versions: 0.20.0 > Reporter: ryan rawson > Assignee: stack > Fix For: 0.20.0 > > Attachments: 1738.patch > > > when a Scanner is created, it creates 2 MemStoreScanners on the kvset and the snapshot (internal names of Memstore)... if the snapshot is originally empty, it only creates the 1, for kvset. When the snapshot is created, the outstanding Scanners now have a pointer to the tree that is now the snapshot, but no pointer to the kvset. > When the flush completes, the scanner will reset the memstore scanners and 'see' the new values again. > If there is a large delay between snapshot and finalization of the flush, there can be a large period of time a scanner doesnt see 'new' values that are being inserted. the canonical 'bad' case where this can do things is the META scanner, and we end up with double assignment. > The snapshot is really lightweight, it only takes out a small lock in memstore, so im not sure there is an easy mechanism to hook to without building out a bit more code or restructuring the memstore scanner. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.