Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 9 Mar 2017 10:20:38 +0000 (UTC)
From: "Jean-Marc Spaggiari (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13049090.1488931427000.21028.1489054838220@Atlassian.JIRA>
In-Reply-To: <JIRA.13049090.1488931427000@Atlassian.JIRA>
References: <JIRA.13049090.1488931427000@Atlassian.JIRA> <JIRA.13049090.1488931427627@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HBASE-17755)
 CellBasedKeyBlockIndexReader#midkey should exhaust search of the target
 middle key on skewed regions
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 09 Mar 2017 10:20:43 -0000


    [ https://issues.apache.org/jira/browse/HBASE-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902844#comment-15902844 ] 

Jean-Marc Spaggiari commented on HBASE-17755:
---------------------------------------------

Don't we risk to generate very small new daughter regions? 

> CellBasedKeyBlockIndexReader#midkey should exhaust search of the target middle key on skewed regions
> ----------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-17755
>                 URL: https://issues.apache.org/jira/browse/HBASE-17755
>             Project: HBase
>          Issue Type: Bug
>          Components: HFile
>            Reporter: Esteban Gutierrez
>            Assignee: Esteban Gutierrez
>
> We have always been returning the middle key of the the block index regardless the distribution of the data on an HFile. A side effect of that approach is that when millions of rows share the same key its quite easy to run into a situation when the start key is equal to the middle key or when the end key is equal to the middle key making that HFile nearly impossible to split until enough data is written into the region and the middle key shifts to another row or when an operator uses a custom split point in order to split that region. 
> Instead we should exhaust the search of the middle key in the block index in order to be able to split an HFile earlier when possible even if our edge case is to serve a region that could hold a single key with millions of versions of a row or with millions of qualifiers on the same row.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)