accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keith Turner <>
Subject Re: How to speed up table compaction [SEC=UNOFFICIAL]
Date Wed, 07 May 2014 14:27:10 GMT
On Mon, May 5, 2014 at 6:43 PM, Dickson, Matt MR <> wrote:

> I'm trying to compact a table and have had a queue of 60,000 compactions
> with only 800 running at a time.  This has now been running for 4 days and
> only decreased the queue by 8,000.
> I've increased tserver.compaction.major.concurrent.max=12 and stopped all
> ingest but not seen a change in progress.  Are there other accumulo
> settings I can alter to improve this?  I also saw
> should this be increased?

This may speed things up if you have tablets w/ lots of files.  I think
this default should probably be higher based on anecdotal evidence, but I
have not experimented with to find out what a good default would be.  I'll
open an issue.

> Thanks in advance,
> Matt

View raw message