Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 14 Mar 2017 01:33:41 +0000 (UTC)
From: "Allan Yang (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13049181.1488957264000.9333.1489455221717@Atlassian.JIRA>
In-Reply-To: <JIRA.13049181.1488957264000@Atlassian.JIRA>
References: <JIRA.13049181.1488957264000@Atlassian.JIRA> <JIRA.13049181.1488957264994@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HBASE-17757) Unify blocksize after encoding to
 decrease memory fragment
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 14 Mar 2017 01:33:47 -0000


    [ https://issues.apache.org/jira/browse/HBASE-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923381#comment-15923381 ] 

Allan Yang commented on HBASE-17757:
------------------------------------

{quote}
blockWriter.encodedBlockSizeWritten() >= encodedBlockSizeLimit || blockWriter.blockSizeWritten() >= hFileContext.getBlocksize() so only the old way of block size determines the block boundary. 
{quote}
So, if users set the blocksize to 64KB, and the default ratio is 1, then they will have blocks whose size is 64KB AFTER encoding. But before this patch, if users set the blocksize to 64KB, they will get blocks with 64KB BEFORE encoding. That is a difference.

> Unify blocksize after encoding to decrease memory fragment 
> -----------------------------------------------------------
>
>                 Key: HBASE-17757
>                 URL: https://issues.apache.org/jira/browse/HBASE-17757
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Allan Yang
>            Assignee: Allan Yang
>         Attachments: HBASE-17757.patch
>
>
> Usually, we store encoded block(uncompressed) in blockcache/bucketCache. Though we have set the blocksize, after encoding, blocksize is varied. Varied blocksize will cause memory fragment problem, which will result in more FGC finally.In order to relief the memory fragment, This issue adjusts the encoded block to a unified size.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)