hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14921) Memory optimizations
Date Fri, 01 Apr 2016 06:49:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221270#comment-15221270
] 

Anoop Sam John commented on HBASE-14921:
----------------------------------------

[~anastas]
I read the new classes in this patch.  So in which patch this is being used ?  Or it will
come later?
I see there are 2 sets of MSLAB chunks in place now
In one the actual cell bytes are present (Key + Value)
In second set of chunks (CellBlockSerialized.java) we have 3 ints per Cell serialized.   
One suggestion- We dont need the last int of Cell length.  We have the offset to Cell..  And
there we are serializing as how The KV structure looks like.  So we can read the key len and
value len and sum it to get the cell total length. 
So what other structure we have?  CellBlockObjectArray where used?   
In CellBlockSerialized#getCellFromIndex(int i)    how we get the index to be passed?

> Memory optimizations
> --------------------
>
>                 Key: HBASE-14921
>                 URL: https://issues.apache.org/jira/browse/HBASE-14921
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: Eshcar Hillel
>            Assignee: Anastasia Braginsky
>         Attachments: CellBlocksSegmentInMemStore.pdf, CellBlocksSegmentinthecontextofMemStore(1).pdf,
HBASE-14921-V01.patch, HBASE-14921-V02.patch
>
>
> Memory optimizations including compressed format representation and offheap allocations



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message