kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joel Victor <joelsvic...@gmail.com>
Subject Re: HBase region split policy.
Date Thu, 09 Jun 2016 15:17:51 GMT
Hi ShaoFeng,

Thanks for the info!

-Joel

On Thu, Jun 9, 2016 at 8:15 PM, ShaoFeng Shi <shaofengshi@apache.org> wrote:

> Hi Joel,
>
> Kylin calculates the split keys during cube building; once a segment be
> built, it (and the htable) is immutable (no data be inserted/deleted), so
> there is no need to rebalance;
>
> From 1.5.2, the "kylin.hbase.region.cut" determins the size of a region;
> But as Kylin calculates the split keys by estimation; the real size of a
> region may vary a little;
>
> The link in the code is out of date and mis-leading, will remove that
> soon;
>
> 2016-06-09 14:36 GMT+08:00 Joel Victor <joelsvictor@gmail.com>:
>
>> Hi,
>>
>> Can some one please explain why region splitting for HBase has been
>> disabled? Is it the case that the Kylin cube job determines the region
>> size using the kylin.hbase.region.cut property in kylin.properties?
>> If so, what are the other configuration parameters that determine region
>> split in HBase?
>>
>> The link in the code says ConstantSizeRegionSplitPolicy but the code has
>> DisabledRegionSplitPolicy.[1]
>> Also the ConstantSizeRegionSplitPolicy link in the code does not work.
>>
>>
>> [1]
>> https://github.com/apache/kylin/blob/master/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHTableUtil.java#L61
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
>

Mime
View raw message