hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14921) Memory optimizations
Date Fri, 01 Apr 2016 06:59:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221281#comment-15221281

Anoop Sam John commented on HBASE-14921:

When we have say offheap MSLAB also, an entry added to CSLM (Cell object) will have ~100 bytes
overhead per cell.
The Cell[] way of CellBlock (CellBlockObjectArray) will have per Cell overhead of 48 bytes
CellBlockSerialized  way will have 12 bytes  (or 8 bytes also)
Good going.
BTW HBASE-15179, under this we are doing some PoC and test with off heap Memstore.   But we
have only CSLM added memstore now.. The overhead per Cell is much more here.  That is one
issue we are seeing in our tests as well.   So we very much need ur work in for better results
with offheap MSLAB :-)  Great work guys.

> Memory optimizations
> --------------------
>                 Key: HBASE-14921
>                 URL: https://issues.apache.org/jira/browse/HBASE-14921
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: Eshcar Hillel
>            Assignee: Anastasia Braginsky
>         Attachments: CellBlocksSegmentInMemStore.pdf, CellBlocksSegmentinthecontextofMemStore(1).pdf,
HBASE-14921-V01.patch, HBASE-14921-V02.patch
> Memory optimizations including compressed format representation and offheap allocations

This message was sent by Atlassian JIRA

View raw message