Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6533511026 for ; Tue, 9 Sep 2014 03:24:29 +0000 (UTC) Received: (qmail 74360 invoked by uid 500); 9 Sep 2014 03:24:29 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 74304 invoked by uid 500); 9 Sep 2014 03:24:29 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 74292 invoked by uid 99); 9 Sep 2014 03:24:29 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Sep 2014 03:24:29 +0000 Date: Tue, 9 Sep 2014 03:24:29 +0000 (UTC) From: "Enis Soztutar (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-10713) A MemStore implementation with in memory flushes to CellBlocks MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126520#comment-14126520 ] Enis Soztutar commented on HBASE-10713: --------------------------------------- This is good stuff, but unscheduling from 0.99.x line for now until we have a trunk patch. We can then consider this for inclusion based on the patch. > A MemStore implementation with in memory flushes to CellBlocks > -------------------------------------------------------------- > > Key: HBASE-10713 > URL: https://issues.apache.org/jira/browse/HBASE-10713 > Project: HBase > Issue Type: New Feature > Reporter: Anoop Sam John > Assignee: Anoop Sam John > Fix For: 2.0.0 > > > After HBASE-10648 we can plugin any implementation for MemStore. This issue aims at coming up with an implementation, in which we will have in between in memory flushes. This will reduce the need to keep lots of KVs in heap as well as in CSLM. CSLM perform poor when no# items in it increases. We can keep create CellBlocks (contigous byte[] like HFile block) out of KVs and keep it as one object rather than many KVs. At some point in time, MemStore might have N CellBlocks and one CSLM. > These in memory CellBlocks can be compacted to one bigger block in between. We can target that in follow on tasks once the basic code is ready. -- This message was sent by Atlassian JIRA (v6.3.4#6332)