Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CAFCA6EE9 for ; Wed, 1 Jun 2011 17:25:43 +0000 (UTC) Received: (qmail 34380 invoked by uid 500); 1 Jun 2011 17:25:42 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 34339 invoked by uid 500); 1 Jun 2011 17:25:42 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 34331 invoked by uid 99); 1 Jun 2011 17:25:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 17:25:42 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com designates 209.85.216.41 as permitted sender) Received: from [209.85.216.41] (HELO mail-qw0-f41.google.com) (209.85.216.41) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 17:25:37 +0000 Received: by qwa26 with SMTP id 26so19854qwa.14 for ; Wed, 01 Jun 2011 10:25:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=vSMgmHLCITwwq7FP6gmjjgEJRMkYwqyJ0KEYYPFvX8M=; b=cVIHNY//C9zOBlh5qG8bxT8xYhl85OW2tcAEg/ugqqMzMLJn+/0GiP05mLED7OScMV mM8XoPLIRY2w0PMDXbVe+XJFX08KW3LqdDeIrctJhpzXxa6zvnJcPGF5f45F5haWoeRQ 3sjOMi7Ezyv4WsNJmEv6u2rK9OOZLGe4sFfhM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=e6kPsrLPRMODheUfE1pW/gLL/lMC5BW2aQHIjP3DYF1kriF0DfMNRXEsgSwbyKofVb o/ugBanwBj49l3R/xkEKPCnsmeN9Klo79libOAk4eUkwcZzHSLHDGWyqBZ3p29mOt8Wl pZqxW+YtEB9HeaAt8i3EYVR6y4CMXEqCBv0XU= MIME-Version: 1.0 Received: by 10.224.218.69 with SMTP id hp5mr5647550qab.17.1306949116193; Wed, 01 Jun 2011 10:25:16 -0700 (PDT) Sender: saint.ack@gmail.com Received: by 10.224.6.146 with HTTP; Wed, 1 Jun 2011 10:25:16 -0700 (PDT) In-Reply-To: References: Date: Wed, 1 Jun 2011 10:25:16 -0700 X-Google-Sender-Auth: RcywFSyyhKF8vIe0q953kGt66c8 Message-ID: Subject: Re: HBase balancer policy issue From: Stack To: dev@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Interesting. I suppose if the balancer remembered what it had recently moved and let some time elapse before it moved the recently moved, would that do? St.Ack On Tue, May 31, 2011 at 11:26 PM, Anty wrote: > On Wed, Jun 1, 2011 at 11:02 AM, Stack wrote: > >> If compacting, don't we interrupt it so we can close and move the >> region. =A0You are worried about the compacting work done so far -- you >> don't want to lose it? =A0So you are suggesting that a region should be >> able to say "No, not now! =A0I'm busy?" (We'd need to distingush between >> a balancer 'move' and a move or close for any other region). >> > Yes, that's exactly what i want to =A0convey. > Can this consideration be included in balancer? > >> >> St.Ack >> >> On Tue, May 31, 2011 at 7:44 PM, Anty wrote: >> > When doing balance, Can we take into account the compaction status of >> > regions. >> > Currently, even the region is doing compaction, it can also be >> interrupted >> > to response to reassign. >> > >> > >> > On Sun, May 29, 2011 at 12:57 AM, Schubert Zhang >> wrote: >> > >> >> Thanks, I think it is HBASE-3373 >> >> >> >> On Fri, May 20, 2011 at 11:33 PM, Ted Yu wrote: >> >> >> >> > I think your request is described in >> >> > https://issues.apache.org/jira/browse/HBASE-3373 >> >> > >> >> > Practically speaking, the scenario below can hardly occur (in trunk= , >> at >> >> > least). >> >> > If the tables are created with pre-split regions, the regions would= be >> >> > round-robin distributed. >> >> > If the tables are created with single region, subsequent write >> operations >> >> > would cause the region split. Balancer would offload young regions = to >> >> other >> >> > servers - see HBASE-3609 >> >> > which is not in >> 0.90 >> >> > branch. >> >> > >> >> > Refer to >> >> > >> http://zhihongyu.blogspot.com/2011/04/load-balancer-in-hbase-090.htmlfor >> >> > details. >> >> > >> >> > Cheers >> >> > >> >> > On Fri, May 20, 2011 at 12:25 AM, Schubert Zhang >> >> > wrote: >> >> > >> >> > > I have a question about HBase balancer. >> >> > > >> >> > > In release 0.90.x, it seems the balancer only regards the number = of >> >> > regions >> >> > > and balance these regions into every regionserver. >> >> > > >> >> > > If we have two tables (A and B) now, each have 100 regions. >> >> > > Then, a extreme situation is: >> >> > > >> >> > > RegionsServer1: 100 regions, which all belong to table A >> >> > > RegionsServer2: 100 regions, which all belong to table B >> >> > > >> >> > > If my application access table B heavy, the almost all opetations >> hit >> >> > > RegionsServer2, it is not balance. >> >> > > >> >> > > I have a idea about the balance policy: >> >> > > (1) Firstly balance for each table >> >> > > (2) Then, overall balance. >> >> > > >> >> > > >> >> > > Schubert >> >> > > >> >> > >> >> >> > >> > >> > >> > -- >> > Best Regards >> > Anty Rao >> > >> > > > > -- > Best Regards > Anty Rao >