hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Very high read rate in a single RegionServer
Date Mon, 26 Jan 2015 01:05:52 GMT
Suggest you lower the frequency of compacting hbase:meta

Move the second command to another script. 

Cheers



> On Jan 25, 2015, at 4:46 PM, Pun Intended <punintendedyo@gmail.com> wrote:
> 
> Hi Ted,
> 
> I have a small script:  major_compact_hbase.hbsh
> 
> major_compact 'users'
> major_compact 'hbase:meta'
> exit
> 
> 
> and a cron calls it once a day with:
> /usr/bin/hbase shell major_compact_hbase.hbsh
> 
> Thanks again!
> 
> 
>> On Sun, Jan 25, 2015 at 7:38 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>> 
>> How do you trigger major compaction manually ?
>> 
>> Cheers
>> 
>> 
>> 
>>>> On Jan 25, 2015, at 3:40 PM, Pun Intended <punintendedyo@gmail.com>
>>> wrote:
>>> 
>>> Thank you so much for your help!
>>> You are right, the slow region server hosts hbase:meta!!!  I am using
>> Hbase
>>> 0.96.1.1
>>> 
>>> I have major compactions disabled. I run major compaction manually once a
>>> day and when it dpes that besides requesting major compaction on my
>> tables,
>>> it also requests a major_compact 'hbase:meta'. Is that what could be
>>> causing the issue? I did a scan on 'hbase:meta' and I see that it
>> contains
>>> about the same number of regions as it should - I have two tables with
>>> ~3000 regions each.
>>> 
>>> Do you think I have some misconfiguration? Do I need to do some cleanup
>> on
>>> the meta region? Am I hitting some Hbase bug? Or am I being dumb
>> requesting
>>> major compaction for the meta region daily?
>>> 
>>> I believe on the client side I am doing things right - using scanner
>>> caching, etc.
>>> 
>>> Thank you so much for your help!!
>> 

Mime
View raw message