hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Bortnikov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14921) Memory optimizations
Date Tue, 26 Jul 2016 15:55:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393993#comment-15393993
] 

Edward Bortnikov commented on HBASE-14921:
------------------------------------------

Thanks, all, for the last round ... Seems like we are converging. 

So, we seem to agree on the following:
1. At the end of the day, we want compaction (data de-duplication) where it helps, and don't
want it where it doesn't. That might use a flag or some smart policy. Getting there might
take 1-2 more (smaller) patches. 
2. We want to land the current patch because it's getting big. The mandatory condition for
passing it is bug-freedom (via improved coverage), including the more stressful PE tests.
Hopeful to finish this week or early next week. 
3. We want to release all the dependencies for [~anoop.hbase] and [~ram_krish] on their way
to off-heap memory implementation. We'll switch to that as soon as the current patch is landed.
We have a common goal (smile). 

Deal? 

> Memory optimizations
> --------------------
>
>                 Key: HBASE-14921
>                 URL: https://issues.apache.org/jira/browse/HBASE-14921
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: Eshcar Hillel
>            Assignee: Anastasia Braginsky
>         Attachments: CellBlocksSegmentInMemStore.pdf, CellBlocksSegmentinthecontextofMemStore(1).pdf,
HBASE-14921-V01.patch, HBASE-14921-V02.patch, HBASE-14921-V03.patch, HBASE-14921-V04-CA-V02.patch,
HBASE-14921-V04-CA.patch, HBASE-14921-V05-CAO.patch, HBASE-14921-V06-CAO.patch, InitialCellArrayMapEvaluation.pdf,
IntroductiontoNewFlatandCompactMemStore.pdf
>
>
> Memory optimizations including compressed format representation and offheap allocations



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message