hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16438) Create a cell type so that chunk id is embedded in it
Date Wed, 26 Oct 2016 05:42:59 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15607511#comment-15607511

Anoop Sam John commented on HBASE-16438:

In CellChunkMap, we will get rid of Cell objects and will keep only some index data.  So this
index data has to tell us in which byte[]/BB/Chunk the cell data resides and in which offset
and what is its total length. The latter 2 are ints. The 1st one is a pointer. Again we will
need to keep it on heap. Where what the solution proposes is to keep an id of the chunk where
this cell resides instead of keeping a java ref to this chunk object.  That is why the chunk
id is imp now.  Now normal cells will have only ref to chunks. So when an in memory flush
happens and we make the chunk map, we dont know the index/id of this chunk.  That is why we
were saying that we can keep the chunk id int within the cell object.

> Create a cell type so that chunk id is embedded in it
> -----------------------------------------------------
>                 Key: HBASE-16438
>                 URL: https://issues.apache.org/jira/browse/HBASE-16438
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
> For CellChunkMap we may need a cell such that the chunk out of which it was created,
the id of the chunk be embedded in it so that when doing flattening we can use the chunk id
as a meta data. More details will follow once the initial tasks are completed. 

This message was sent by Atlassian JIRA

View raw message