Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 46471 invoked from network); 24 Mar 2009 03:44:17 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Mar 2009 03:44:17 -0000 Received: (qmail 89623 invoked by uid 500); 24 Mar 2009 03:44:16 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 89576 invoked by uid 500); 24 Mar 2009 03:44:16 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 89566 invoked by uid 99); 24 Mar 2009 03:44:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Mar 2009 03:44:16 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 24 Mar 2009 03:44:14 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id A0148234C045 for ; Mon, 23 Mar 2009 20:43:53 -0700 (PDT) Message-ID: <1643632454.1237866233654.JavaMail.jira@brutus> Date: Mon, 23 Mar 2009 20:43:53 -0700 (PDT) From: "Nitay Joffe (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-1212) merge tool expects regions all have different sequence ids In-Reply-To: <1552780233.1235428322060.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12688552#action_12688552 ] Nitay Joffe commented on HBASE-1212: ------------------------------------ As I noted on HBASE-1274, we can try using the file names to do the sequencing: bq. What about using something that sorts lexicographically and sorting the dir.listFiles we use when grabbing the store files? Then when we move around two files with the same sequence ids to do a merge we can rename the actual files. > merge tool expects regions all have different sequence ids > ---------------------------------------------------------- > > Key: HBASE-1212 > URL: https://issues.apache.org/jira/browse/HBASE-1212 > Project: Hadoop HBase > Issue Type: Bug > Reporter: stack > > Currently merging two regions, the merge tool will compare their sequence ids. If same, it will decrement one. It needs to do this because on region open, files are keyed by their sequenceid; if two the same, one will erase the other. > Well, with the move to the aggregating hfile format, the sequenceid is written when the file is created and its no longer written into an aside file but as metadata on to the end of the file. Changing the sequenceid is no longer an option. > This issue is about figuring a solution for the rare case where two store files have same sequence id AND we want to merge the two regions. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.