hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-10713) A MemStore implementation with in memory flushes to CellBlocks
Date Fri, 21 Oct 2016 06:22:58 GMT

     [ https://issues.apache.org/jira/browse/HBASE-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anoop Sam John resolved HBASE-10713.
------------------------------------
    Resolution: Duplicate
      Assignee:     (was: Anoop Sam John)

Closing as a dup of HBASE-14918.  There we are doing conceptually the same..  Instead of CellBlock
as flat byte[], we have Segments there which can be cell array or cell chunk with index. 
HBASE-14918 is almost getting to its closure. 

> A MemStore implementation with in memory flushes to CellBlocks
> --------------------------------------------------------------
>
>                 Key: HBASE-10713
>                 URL: https://issues.apache.org/jira/browse/HBASE-10713
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Anoop Sam John
>             Fix For: 2.0.0
>
>         Attachments: HBASE-10713_WIP.patch
>
>
> After HBASE-10648 we can plugin any implementation for MemStore. This issue aims at coming
up with an implementation, in which we will have in between in memory flushes. This will reduce
the need to keep lots of KVs in heap as well as in CSLM.  CSLM perform poor when no# items
in it increases.  We can keep create CellBlocks (contigous byte[] like HFile block) out of
KVs and keep it as one object rather than many KVs.  At some point in time, MemStore might
have N CellBlocks and one CSLM.  
> These in memory CellBlocks can be compacted to one bigger block in between. We can target
that in follow on tasks once the basic code is ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message