hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16438) Create a cell type so that chunk id is embedded in it
Date Mon, 13 Mar 2017 07:19:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906946#comment-15906946
] 

ramkrishna.s.vasudevan commented on HBASE-16438:
------------------------------------------------

Hi All
I have updated the patch in RB. There are few things I have added in the RB. To reiterate
what is there in RB
1) The ChunkCell is now an extension of BytebufferKV. The problem is that since BBKV already
has seqId in it even if we serailize the seqId in the buffer then that ref is of no use. So
we may need new Cell impl
2) The chunkId is now added only to the beginning of each chunk and not in every cell.
3) As far as this patch is concerned I feel we can focus on chunkCreation and using this ChunkCell.
But adding the seqId inside the buffer and using that buffer has to be done while changing
1) and also integrate it with CellChunkMap flow.
4) This patch also handles clearing the map inside ChunkCreator when there is no chunkPool
and we have MSLAB only.

> Create a cell type so that chunk id is embedded in it
> -----------------------------------------------------
>
>                 Key: HBASE-16438
>                 URL: https://issues.apache.org/jira/browse/HBASE-16438
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>         Attachments: MemstoreChunkCell_memstoreChunkCreator_oldversion.patch, MemstoreChunkCell_trunk.patch
>
>
> For CellChunkMap we may need a cell such that the chunk out of which it was created,
the id of the chunk be embedded in it so that when doing flattening we can use the chunk id
as a meta data. More details will follow once the initial tasks are completed. 
> Why we need to embed the chunkid in the Cell is described by [~anastas] in this remark
over in parent issue https://issues.apache.org/jira/browse/HBASE-14921?focusedCommentId=15244119&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15244119



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message