hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Is there a way to increase the compaction queue size?
Date Thu, 07 Jul 2011 06:00:19 GMT
Try setting "hbase.hstore.compaction.max" to a value other than 10, its default.

What do you mean by 'no further minor compaction is queuing'?  There
is no more compaction going on? Are there exceptions in the log?

St.Ack

On Wed, Jul 6, 2011 at 10:55 PM, Sheng Chen <chensheng2010@gmail.com> wrote:
> Hi, all,
> I have a hbase region server of 10 regions and find the compaction queue
> size is always 10 at maximum.
> After I finished inserting 1 billion records, there are still hundreds of
> HFiles in each region and no further minor compaction is queuing.
>
> My settings,
> hbase.hstore.blockingStoreFiles=Integer.MAX_VALUE
> hbase.hstore.compactionThreshold=3
> hbase.hstore.max.filesize=100G
>
> Is it the expected behavior?
> Can I make the compaction queue larger in order to keep doing minor
> compaction in the background?
>
> Thank you.
>
> Sean
>

Mime
View raw message