hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16594) ROW_INDEX_V2 DBE
Date Fri, 09 Sep 2016 12:47:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15476986#comment-15476986
] 

binlijin commented on HBASE-16594:
----------------------------------

The data is too big so only a few cached in LruCache when decompression, so need to test it
when all data cached in LruCache.

> ROW_INDEX_V2 DBE
> ----------------
>
>                 Key: HBASE-16594
>                 URL: https://issues.apache.org/jira/browse/HBASE-16594
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Performance
>            Reporter: binlijin
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-16594-master_v1.patch
>
>
> See HBASE-16213, ROW_INDEX_V1 DataBlockEncoding.
> ROW_INDEX_V1 is the first version which have no storage optimization, 
> ROW_INDEX_V2 do storage optimization: store every row only once, store column family
only once in a HFileBlock.
> ROW_INDEX_V1 is : 
> /** 
>  * Store cells following every row's start offset, so we can binary search to a row's
cells. 
>  * 
>  * Format: 
>  * flat cells 
>  * integer: number of rows 
>  * integer: row0's offset 
>  * integer: row1's offset 
>  * .... 
>  * integer: dataSize 
>  * 
> */
> ROW_INDEX_V2 is :
>  * row1 qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  * row2 qualifier timestamp type value tag
>  * row3 qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  * .... 
>  * integer: number of rows 
>  * integer: row0's offset 
>  * integer: row1's offset 
>  * .... 
>  * column family
>  * integer: dataSize 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message