accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Turner <ke...@deenlo.com>
Subject Re: How to speed up table compaction [SEC=UNOFFICIAL]
Date Wed, 07 May 2014 14:27:10 GMT
On Mon, May 5, 2014 at 6:43 PM, Dickson, Matt MR <
matt.dickson@defence.gov.au> wrote:

>  *UNOFFICIAL*
> I'm trying to compact a table and have had a queue of 60,000 compactions
> with only 800 running at a time.  This has now been running for 4 days and
> only decreased the queue by 8,000.
>
> I've increased tserver.compaction.major.concurrent.max=12 and stopped all
> ingest but not seen a change in progress.  Are there other accumulo
> settings I can alter to improve this?  I also saw
> tserver.compaction.major.thread.files.open.max=10 should this be increased?
>

This may speed things up if you have tablets w/ lots of files.  I think
this default should probably be higher based on anecdotal evidence, but I
have not experimented with to find out what a good default would be.  I'll
open an issue.


>
> Thanks in advance,
> Matt
>

Mime
View raw message