Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Received-SPF: pass (athena.apache.org: domain of josh.elser@gmail.com
 designates 209.85.216.180 as permitted sender)
Message-ID: <524A4110.8070203@gmail.com>
Date: Mon, 30 Sep 2013 23:27:12 -0400
From: Josh Elser <josh.elser@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:17.0) Gecko/20130825 Thunderbird/17.0.8
MIME-Version: 1.0
To: user@accumulo.apache.org
Subject: Re: Merge Tablets [SEC=UNOFFICIAL]
References: <24070BEF0A3F684489AA943FD3439EF20586FA060E@CARRXM06.drn.mil.au>
In-Reply-To: <24070BEF0A3F684489AA943FD3439EF20586FA060E@CARRXM06.drn.mil.au>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Matt,

You interpreted the prompt correctly. That was added as a failsafe to 
keep you from merging your entire table into one tablet.

The merge command doesn't take into account the split threshold, it 
simply merges all tablets specified by the rows you provide (or entire 
table) and merge them into one tablet. In other words, the configured 
table.split.threshold you have defined won't work as you expect.

If you know how many tablets you want this table to have in the end (I 
believe the current recommendation is an upper-bound of ~200 tablets per 
tabletserver), you can use the current splits and some shell magic to 
create a script that you can pass the shell that will merge series of 
tablets together.

e.g.

merge -t table -b 1 -e 3
merge -t table -b 4 -e 6
merge -t table -b 7 -e 9

etc.

- Josh

On 09/30/2013 11:17 PM, Dickson, Matt MR wrote:
>
> *UNOFFICIAL*
>
> I have a table with 125K tablets and would like to merge the smaller 
> tablets together.  The documentation states;
>
> Merging away small tablets works on one section at a time. If your 
> table contains many sections of small split points, or you are 
> attempting to change the split size of the entire table, it will be 
> faster to set the split point and merge the entire table:
>
> Based on this I went to run *'merge -t /tablename/'* on a table with 
> table.split.threshold set to 1G and was prompted to confirm if I 
> wanted to merge the entire table into a single tablet.
>
> I had thought Accumulo would find small tablets and merge these upto a 
> size of 1G, rather than attempt to create a single tablet.  Am Ir 
> using the wrong command for this or misinterpreting the prompt?
>
> Thanks in advance,
>
> Matt
>