Return-Path: Delivered-To: apmail-hadoop-hbase-issues-archive@minotaur.apache.org Received: (qmail 57261 invoked from network); 22 Mar 2010 21:45:48 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Mar 2010 21:45:48 -0000 Received: (qmail 69100 invoked by uid 500); 22 Mar 2010 21:45:48 -0000 Delivered-To: apmail-hadoop-hbase-issues-archive@hadoop.apache.org Received: (qmail 69080 invoked by uid 500); 22 Mar 2010 21:45:48 -0000 Mailing-List: contact hbase-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-issues@hadoop.apache.org Delivered-To: mailing list hbase-issues@hadoop.apache.org Received: (qmail 69072 invoked by uid 99); 22 Mar 2010 21:45:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Mar 2010 21:45:48 +0000 X-ASF-Spam-Status: No, hits=-1096.5 required=10.0 tests=ALL_TRUSTED,AWL,FS_REPLICA X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Mar 2010 21:45:47 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 28293234C1EE for ; Mon, 22 Mar 2010 21:45:27 +0000 (UTC) Message-ID: <645598499.415841269294327150.JavaMail.jira@brutus.apache.org> Date: Mon, 22 Mar 2010 21:45:27 +0000 (UTC) From: "Jean-Daniel Cryans (JIRA)" To: hbase-issues@hadoop.apache.org Subject: [jira] Updated: (HBASE-2361) WALEdit broke replication scope MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Daniel Cryans updated HBASE-2361: -------------------------------------- Attachment: HBASE-2361.patch This patch implements the third solution. It adds a new list for scopes which by default is set to local. It also optimizes reading the fields so that we only set the size of each list to what's needed. > WALEdit broke replication scope > ------------------------------- > > Key: HBASE-2361 > URL: https://issues.apache.org/jira/browse/HBASE-2361 > Project: Hadoop HBase > Issue Type: Bug > Reporter: Jean-Daniel Cryans > Assignee: Jean-Daniel Cryans > Fix For: 0.21.0 > > Attachments: HBASE-2361.patch > > > Before HBASE-2283, each KV had a HLogKey with a replication scope. Now a key applies to a list of KVs that spans multiple families so a single scope doesn't work anymore. Multiple possible solutions: > - Each KV have their own scope. We already ruled that out in a previous jira since that means the scope would end up in the HFiles. > - Store pairs of scope/KV in WALEdit instead of straight KVs. > - Have 2 parallel lists in WALEdit, one for KVs and the other for scopes. > - Subclass KV and add the scope there, those would be created when inserted in the WAL and would contain the KV stored in the HFiles. > I'm sure there are other solutions, discuss. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.