hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Meil <doug.m...@explorysmedical.com>
Subject Re: prevent region splits?
Date Sun, 04 Sep 2011 16:12:20 GMT

Along with what Jack said, see this...

http://hbase.apache.org/book.html#required_configuration

.. and just double check that you don't have scheduled major compactions
going off once a day (the default)



On 9/3/11 7:54 PM, "Jack Levin" <magnito@gmail.com> wrote:

>Make hbase.hregion.max.filesize to be very large. Then your regions
>won't split.  We use this method when copying 'live' hbase to make a
>backup.
>
>-Jack
>
>On Sat, Sep 3, 2011 at 4:32 PM, Geoff Hendrey <ghendrey@decarta.com>
>wrote:
>> Is there a way to prevent regions from splitting while we are running a
>> mapreduce job that does a lot of Puts? It seems that there is a lot of
>> HDFS activity related to the splitting of regions while my M/R job is
>> doing the puts. Is it sensible to disable splitting during the job that
>> does lots of Put? Would there be any danger in this (i.e. disabling
>> splitting during the job, and re-enabling it when the job completes)?
>>
>>
>>
>> I see the hbase.regionserver.thread.splitcompactcheckfrequency could be
>> used to make splits happen less frequently, but what I'd really like is
>> for splitting to be disabled, then re-enabled later.
>>
>>
>>
>> -Geoff
>>
>>


Mime
View raw message