Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7943ED18F for ; Mon, 16 Jul 2012 13:35:12 +0000 (UTC) Received: (qmail 77266 invoked by uid 500); 16 Jul 2012 13:35:12 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 77232 invoked by uid 500); 16 Jul 2012 13:35:12 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 77205 invoked by uid 99); 16 Jul 2012 13:35:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jul 2012 13:35:11 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ameetkini@gmail.com designates 209.85.217.169 as permitted sender) Received: from [209.85.217.169] (HELO mail-lb0-f169.google.com) (209.85.217.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Jul 2012 13:35:06 +0000 Received: by lbjn8 with SMTP id n8so8918615lbj.0 for ; Mon, 16 Jul 2012 06:34:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=j3R2xlq+I/eUZ4U/LnUjMccEDpDcLfHonhE68VKJNuI=; b=rr/jIq8U1Eu9P0qtYWvYG5mMahPAbXNByIXDNuQoMEyeCAabb6Zoold/FQJsLLqoEi +142VN+HAyONhMSBEnpFdR6jN7dPLIJRBmAKgyIN9i/sHP0VlXmAoKlEKRFBskpn5DQj OljM7EkARhxLeCEXk7tU0xjrplbSC3l3gk2oq7A4ahyWelFiJUAGAHB3xsdxtEiJRDL2 6huB7r/CWNWNbDnBnmWbamETVxEj2iuSf34hiaVaXNpf6ZhJiJ/yjqni5DrG9vbTRkQn lG4+fMEoPmvg6W1lrslUWbO638NS2nRn2V8enqLf5Q+i8f9V6lPvy69cJviBjfx/6Hso Ggjg== Received: by 10.112.23.42 with SMTP id j10mr5374745lbf.20.1342445684544; Mon, 16 Jul 2012 06:34:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.114.0.226 with HTTP; Mon, 16 Jul 2012 06:34:24 -0700 (PDT) In-Reply-To: <1576752463.60837.1342214509756.JavaMail.root@linzimmb04o.imo.intelink.gov> References: <1576752463.60837.1342214509756.JavaMail.root@linzimmb04o.imo.intelink.gov> From: ameet kini Date: Mon, 16 Jul 2012 09:34:24 -0400 Message-ID: Subject: Re: tablet distribution To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=90e6ba3098262853ce04c4f27e7c X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba3098262853ce04c4f27e7c Content-Type: text/plain; charset=ISO-8859-1 Thanks Billie/John/Eric. TableLoadBalancer does the trick. Ameet On Fri, Jul 13, 2012 at 5:21 PM, Billie J Rinaldi wrote: > On Friday, July 13, 2012 5:14:53 PM, "John Vines" > wrote: > > Sounds like you want to use the TableLoadBalancer which will try to > > even balance all tablets on a table-by-table basis. > > To use this, set "master.tablet.balancer" to > "org.apache.accumulo.server.master.balancer.TableLoadBalancer". This has > been made the default balancer as of 1.4.1. > > Billie > > > > John > > > > > > On Fri, Jul 13, 2012 at 5:09 PM, ameet kini < ameetkini@gmail.com > > > wrote: > > > > > > Thanks, I was looking for something of the equivalent: > > > http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#move(byte[] > , > > byte[]) > > > > > > The use case is common enough that there may be some other way to do > > what I want. I have a table that doesn't have its tablets distributed > > evenly. At the system (instance?) level, they are evenly distributed, > > but not at this particular table level. > > > > > > The docs seem to suggest that pre-splitting a table would > > automatically guarantee that the tablets would be distributed evenly > > across the nodes of the cluster. I see that pre-splitting guarantees > > that you have that many tablets, but not necessarily that they are > > evenly distributed. Maybe if the instance had only one table, then it > > would be forced to distribute its tablets. > > > > > > > > Thanks, > > Ameet > > > > > > PRE-SPLITTING TABLES > > > > > > Accumulo will balance and distribute tables accross servers. Before a > > table gets large, it will be maintained as a single tablet on a single > > server. This limits the speed at which data can be added or queried to > > the speed of a single node. To improve performance when the a table is > > new, or small, you can add split points and generate new tablets. > > > > In the shell: > > root @myinstance > createtable newTable root @myinstance > addsplits - > > t newTable g n t > > > > This will create a new table with 4 tablets. The table will be split > > on the letters g'', n'', and ``t'' which will work nicely if the row > > data start with lower-case alphabetic characters. If your row data > > includes binary information or numeric information, or if the > > distribution of the row information is not flat, then you would pick > > different split points. Now ingest and query can proceed on 4 nodes > > which can improve performance. > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jul 13, 2012 at 3:04 PM, Eric Newton < eric.newton@gmail.com > > > wrote: > > > > > > Yes, you need to write your own tablet balancer. > > > > -Eric > > > > > > > > On Fri, Jul 13, 2012 at 2:48 PM, ameet kini < ameetkini@gmail.com > > > wrote: > > > > > > Hi, > > > > > > Is there a way to force a tablet to move to a particular tablet > > > server? > > > > > > Thanks, > > > Ameet > --90e6ba3098262853ce04c4f27e7c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Billie/John/Eric.=A0

TableLoadBalancer does the t= rick.=A0

Ameet

O= n Fri, Jul 13, 2012 at 5:21 PM, Billie J Rinaldi <billie.j.rinaldi= @ugov.gov> wrote:
On Friday, July 13, 2012 5:14:53 PM, &q= uot;John Vines" <john.w.vines@ugov.gov> wrote:
> Sounds like you want to use the TableLoadBalancer which will try to > even balance all tablets on a table-by-table basis.

To use this, set "master.tablet.balancer" to "org.apac= he.accumulo.server.master.balancer.TableLoadBalancer". =A0This has bee= n made the default balancer as of 1.4.1.

Billie


> John
>
>
> On Fri, Jul 13, 2012 at 5:09 PM, ameet kini < ameetkini@gmail.com >
> wrote:
>
>
> Thanks, I was looking for something of the equivalent:
> http://hbase.apache.org/= apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#move(byte[],
> byte[])
>
>
> The use case is common enough that there may be some other way to do > what I want. I have a table that doesn't have its tablets distribu= ted
> evenly. At the system (instance?) level, they are evenly distributed,<= br> > but not at this particular table level.
>
>
> The docs seem to suggest that pre-splitting a table would
> automatically guarantee that the tablets would be distributed evenly > across the nodes of the cluster. I see that pre-splitting guarantees > that you have that many tablets, but not necessarily that they are
> evenly distributed. Maybe if the instance had only one table, then it<= br> > would be forced to distribute its tablets.
>
>
>
> Thanks,
> Ameet
>
>
> PRE-SPLITTING TABLES
>
>
> Accumulo will balance and distribute tables accross servers. Before a<= br> > table gets large, it will be maintained as a single tablet on a single=
> server. This limits the speed at which data can be added or queried to=
> the speed of a single node. To improve performance when the a table is=
> new, or small, you can add split points and generate new tablets.
>
> In the shell:
> root @myinstance > createtable newTable root @myinstance > addsp= lits -
> t newTable g n t
>
> This will create a new table with 4 tablets. The table will be split
> on the letters g'', n'', and ``t''= which will work nicely if the row
> data start with lower-case alphabetic characters. If your ro= w data
> includes binary information or numeric information, or if the
> distribution of the row information is not flat, then you would pick > different split points. Now ingest and query can proceed on 4 nodes > which can improve performance.
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Fri, Jul 13, 2012 at 3:04 PM, Eric Newton < eric.newton@gmail.com >
> wrote:
>
>
> Yes, you need to write your own tablet balancer.
>
> -Eric
>
>
>
> On Fri, Jul 13, 2012 at 2:48 PM, ameet kini < ameetkini@gmail.com >
> wrote:
> >
> > Hi,
> >
> > Is there a way to force a tablet to move to a particular tablet > > server?
> >
> > Thanks,
> > Ameet

--90e6ba3098262853ce04c4f27e7c--