Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 827556FE6 for ; Wed, 1 Jun 2011 06:26:32 +0000 (UTC) Received: (qmail 79365 invoked by uid 500); 1 Jun 2011 06:26:31 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 79307 invoked by uid 500); 1 Jun 2011 06:26:31 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 79298 invoked by uid 99); 1 Jun 2011 06:26:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 06:26:28 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of anty.rao@gmail.com designates 209.85.220.169 as permitted sender) Received: from [209.85.220.169] (HELO mail-vx0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 06:26:23 +0000 Received: by vxk20 with SMTP id 20so5466115vxk.14 for ; Tue, 31 May 2011 23:26:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=urvaNMT9J1WmkhmVGiBpGTCtu/aMihbqudtUEdF0OfQ=; b=tZEiYbMVd9n5eIEc74DggKBobAy9pxAFjozE5zXdqVF5DwMOjwkm1sLn8T760A42Dp AbEKZzl7CAiZ4i5IFO0MAXoGd+BD0umDYNhp9q1pxwBtO/sZcwYeg6l21VxqOANkpZOR MqRkG5icGEmEhAdk0iNfnLv7dSwCymX2dguLg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=weYB69EUf7rxfB6ThRhulyb0wjY7hN+5gdIIquuCkrHa2xhI5C4FAFfOhhaS9RLHBx DrHTUEutCbJIFTiVkN/BmUzBWbQpPssIR4eCOaV3yNEFu2YlX771tIByacqNprywGJg6 WxMn+/ZZhEU3B7ELnmDlIvjRiDikQO/TWnIXc= MIME-Version: 1.0 Received: by 10.52.110.104 with SMTP id hz8mr1591117vdb.265.1306909561842; Tue, 31 May 2011 23:26:01 -0700 (PDT) Received: by 10.52.186.167 with HTTP; Tue, 31 May 2011 23:26:01 -0700 (PDT) In-Reply-To: References: Date: Wed, 1 Jun 2011 14:26:01 +0800 Message-ID: Subject: Re: HBase balancer policy issue From: Anty To: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=bcaec548aa872feb0204a4a09810 --bcaec548aa872feb0204a4a09810 Content-Type: text/plain; charset=ISO-8859-1 On Wed, Jun 1, 2011 at 11:02 AM, Stack wrote: > If compacting, don't we interrupt it so we can close and move the > region. You are worried about the compacting work done so far -- you > don't want to lose it? So you are suggesting that a region should be > able to say "No, not now! I'm busy?" (We'd need to distingush between > a balancer 'move' and a move or close for any other region). > Yes, that's exactly what i want to convey. Can this consideration be included in balancer? > > St.Ack > > On Tue, May 31, 2011 at 7:44 PM, Anty wrote: > > When doing balance, Can we take into account the compaction status of > > regions. > > Currently, even the region is doing compaction, it can also be > interrupted > > to response to reassign. > > > > > > On Sun, May 29, 2011 at 12:57 AM, Schubert Zhang > wrote: > > > >> Thanks, I think it is HBASE-3373 > >> > >> On Fri, May 20, 2011 at 11:33 PM, Ted Yu wrote: > >> > >> > I think your request is described in > >> > https://issues.apache.org/jira/browse/HBASE-3373 > >> > > >> > Practically speaking, the scenario below can hardly occur (in trunk, > at > >> > least). > >> > If the tables are created with pre-split regions, the regions would be > >> > round-robin distributed. > >> > If the tables are created with single region, subsequent write > operations > >> > would cause the region split. Balancer would offload young regions to > >> other > >> > servers - see HBASE-3609 > >> > which is not in > 0.90 > >> > branch. > >> > > >> > Refer to > >> > > http://zhihongyu.blogspot.com/2011/04/load-balancer-in-hbase-090.htmlfor > >> > details. > >> > > >> > Cheers > >> > > >> > On Fri, May 20, 2011 at 12:25 AM, Schubert Zhang > >> > wrote: > >> > > >> > > I have a question about HBase balancer. > >> > > > >> > > In release 0.90.x, it seems the balancer only regards the number of > >> > regions > >> > > and balance these regions into every regionserver. > >> > > > >> > > If we have two tables (A and B) now, each have 100 regions. > >> > > Then, a extreme situation is: > >> > > > >> > > RegionsServer1: 100 regions, which all belong to table A > >> > > RegionsServer2: 100 regions, which all belong to table B > >> > > > >> > > If my application access table B heavy, the almost all opetations > hit > >> > > RegionsServer2, it is not balance. > >> > > > >> > > I have a idea about the balance policy: > >> > > (1) Firstly balance for each table > >> > > (2) Then, overall balance. > >> > > > >> > > > >> > > Schubert > >> > > > >> > > >> > > > > > > > > -- > > Best Regards > > Anty Rao > > > -- Best Regards Anty Rao --bcaec548aa872feb0204a4a09810--