Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A4706102D2 for ; Thu, 4 Jul 2013 13:17:23 +0000 (UTC) Received: (qmail 76125 invoked by uid 500); 4 Jul 2013 13:17:21 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 75787 invoked by uid 500); 4 Jul 2013 13:17:21 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 75779 invoked by uid 99); 4 Jul 2013 13:17:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Jul 2013 13:17:20 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.128.177] (HELO mail-ve0-f177.google.com) (209.85.128.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Jul 2013 13:17:15 +0000 Received: by mail-ve0-f177.google.com with SMTP id cz10so986225veb.8 for ; Thu, 04 Jul 2013 06:16:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=aRHK9fj0+VB+uRnwCYEYVixr9eNWNlHIZ0Hol3Xy0rs=; b=d7Elv2aARhgHJ91lx8Jxd7QwbsYYtaothD4ghwGiixZAmt+/CatQdR+z6fzyc+d2dA Ft1ba/uDYXxyDROXNLKjxYqemqDWhprNFHXCZfvdwCFmZvnUBzP/tVzgS9u7RQlg8uwR xVzxVmUzfzo7KHmWy3ZEqm8+3OpbO6pUTGQmrN4Hni5oP4QhWYJfgNSlc23ph+JHjqeu 4vjJ9a1HbYFY44Oa6me+96VBNtGfw3sXkk7drg0U249RRTegHCBI0lqsZVpYadq/o2HY rL4A+H+a1RXm9fT0tRJWr/w4FSW3iUaP2zHUVZUDcswK7c6AD8jeLRqEnL05bc22vPY2 x8AA== X-Received: by 10.220.69.71 with SMTP id y7mr2968666vci.40.1372943794583; Thu, 04 Jul 2013 06:16:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.52.68.81 with HTTP; Thu, 4 Jul 2013 06:16:14 -0700 (PDT) In-Reply-To: <17B77116-A83E-449D-84AF-F8FDE88B04E2@gmail.com> References: <167F3C3F-8013-4258-B3D6-59418F8FCFDB@gmail.com> <17B77116-A83E-449D-84AF-F8FDE88B04E2@gmail.com> From: Jean-Marc Spaggiari Date: Thu, 4 Jul 2013 09:16:14 -0400 Message-ID: Subject: Re: unbalance number fo region in cluster To: user@hbase.apache.org Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQnIDpJr6r3+vTNSFlBVuvW6pAooNGzr0K0k1iNv/SL6Xelyo9lqQTDUddwENYqwaChVeZm3 X-Virus-Checked: Checked by ClamAV on apache.org Can you please also checked on the HBase Web UI? Do you have regions in transition? Maybe the balancer already gave te balance plan, and regions are moving, slowly, to their destinations? How big are those regions? I mean, size in MB/GB and number of rows? JM 2013/7/4 Ted Yu : > Can you check load balancer related log lines in master log and put them on pastebin so that root cause can be diagnosed ? > > Which HBase version are you using ? > > Thanks > > On Jul 3, 2013, at 11:44 PM, ch huang wrote: > >> the load balancer process as i see is very slow i have a big table ,it's >> region distrabute is node1: 5 ,node2: 22 ,node3: 5 ,after 4 hours ,it's >> became >> node1: 6 ,node2: 20 ,node1: 6, change is very very slow! >> >> On Thu, Jul 4, 2013 at 1:54 PM, Azuryy Yu wrote: >> >>> I supposed load balancer is enabled and there is no pre-split. >>> >>> LB run periodicly, (5 mininutes by default), so after insert bulk data into >>> HBase, the table is unbalance but there will be balanced eventually after >>> round-robin load balancer running. >>> >>> >>> On Thu, Jul 4, 2013 at 1:25 PM, Ted Yu wrote: >>> >>>> Did you presplit your table ? >>>> >>>> Was load balancer enabled ? >>>> >>>> What HBase version do you use ? >>>> >>>> Thanks >>>> >>>> On Jul 3, 2013, at 10:21 PM, ch huang wrote: >>>> >>>>> i insert 2GB data into my hbase cluster ,but i find the region is not >>>>> balance,is insert operation always cause the region number different on >>>>> region server? >>>>> >>>>> here is my 60010 output >>>>> >>>>> Table Regions Name Region Server Start Key End Key >>>>> demo2,,1372914631698.f42281ec44d113df3e644d5ecdb35366. >>>>> CH36:60030 >>>>> rows23703 >>> demo2,rows23703,1372914684582.c3373791daec95b849ba2908c517e045. >>>>> CH35:60030 rows23703 rows347161 >>>>> demo2,rows347161,1372914714248.dd9a6c39f65ad4a879638e1bfec76016. >>>>> CH34:60030 >>>>> rows347161 rows428378 >>>>> demo2,rows428378,1372914745946.41a4669f36bc99ef1592b2df13c0a948. >>>>> CH36:60030 >>>>> rows428378 rows512589 >>>>> demo2,rows512589,1372914776151.a4363bdd7403633c5775931ab32a7da8. >>>>> CH36:60030 >>>>> rows512589 rows598644 >>>>> demo2,rows598644,1372914806469.729f52018aac909e8080f00b8d698e2d. >>>>> CH36:60030 >>>>> rows598644 rows684871 >>>>> demo2,rows684871,1372914836812.d9cb1760fe3302500034913ff813e0f8. >>>>> CH35:60030 >>>>> rows684871 rows771559 >>>>> demo2,rows771559,1372914836812.ac16ff1404cff5c0db3d2e3b0661ffcd. >>>>> CH36:60030 >>>>> rows771559 Regions by Region Server Region Server Region Count >>>>> http://CH35:60030/ 2 http://CH36:60030/5 >>> http://CH34:60030/ 1 >>>