hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-16594) ROW_INDEX_V2 DBE
Date Fri, 09 Sep 2016 10:32:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15476744#comment-15476744
] 

binlijin edited comment on HBASE-16594 at 9/9/16 10:31 AM:
-----------------------------------------------------------

The performance on a single regionserver is :
BlockSize=8K  DATA_BLOCK_ENCODING => 'NONE'         (CPU 4/42)  37k
BlockSize=16K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/41)  41k
BlockSize=32K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/45)  43k
BlockSize=64K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/46)  36k
BlockSize=32k DATA_BLOCK_ENCODING => 'Row_Index_V1' (CPU 4/45)  45k
BlockSize=32k DATA_BLOCK_ENCODING => 'Row_Index_V2' (CPU 4/48)  64k

(CPU 4/42) which mean System CPU 4%,User CPU 42%.


was (Author: aoxiang):
The performance on a single regionserver is :
BlockSize=8K  DATA_BLOCK_ENCODING => 'NONE'         (CPU 4/42)  37k
BlockSize=16K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/41)  41k
BlockSize=32K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/45)  43k
BlockSize=64K DATA_BLOCK_ENCODING => 'NONE'         (CPU 3/46)  36k
BlockSize=32k DATA_BLOCK_ENCODING => 'Row_Index_V1' (CPU 4/45)  45k
BlockSize=32k DATA_BLOCK_ENCODING => 'Row_Index_V2' (CPU 4/48)  64k

> ROW_INDEX_V2 DBE
> ----------------
>
>                 Key: HBASE-16594
>                 URL: https://issues.apache.org/jira/browse/HBASE-16594
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Performance
>            Reporter: binlijin
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-16594-master_v1.patch
>
>
> See HBASE-16213, ROW_INDEX_V1 DataBlockEncoding.
> ROW_INDEX_V1 is the first version which have no storage optimization, 
> ROW_INDEX_V2 do storage optimization: store every row only once, store column family
only once in a HFileBlock.
> ROW_INDEX_V1 is : 
> /** 
>  * Store cells following every row's start offset, so we can binary search to a row's
cells. 
>  * 
>  * Format: 
>  * flat cells 
>  * integer: number of rows 
>  * integer: row0's offset 
>  * integer: row1's offset 
>  * .... 
>  * integer: dataSize 
>  * 
> */
> ROW_INDEX_V2 is :
>  * row1 qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  * row2 qualifier timestamp type value tag
>  * row3 qualifier timestamp type value tag
>  *          qualifier timestamp type value tag
>  * .... 
>  * integer: number of rows 
>  * integer: row0's offset 
>  * integer: row1's offset 
>  * .... 
>  * column family
>  * integer: dataSize 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message