Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02822C6EC for ; Wed, 9 May 2012 05:46:05 +0000 (UTC) Received: (qmail 47433 invoked by uid 500); 9 May 2012 05:46:04 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 47310 invoked by uid 500); 9 May 2012 05:46:04 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 47278 invoked by uid 99); 9 May 2012 05:46:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 May 2012 05:46:03 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 May 2012 05:46:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 7C48F43B3CB for ; Wed, 9 May 2012 05:45:39 +0000 (UTC) Date: Wed, 9 May 2012 05:45:39 +0000 (UTC) From: "Zhihong Yu (JIRA)" To: issues@hbase.apache.org Message-ID: <158846941.42709.1336542339612.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <633932761.42546.1336538747099.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-5970) Improve the AssignmentManager#updateTimer and speed up handling opened event MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271119#comment-13271119 ] Zhihong Yu commented on HBASE-5970: ----------------------------------- That's right. But I wonder why we need to wait for the next chore() ? > Improve the AssignmentManager#updateTimer and speed up handling opened event > ---------------------------------------------------------------------------- > > Key: HBASE-5970 > URL: https://issues.apache.org/jira/browse/HBASE-5970 > Project: HBase > Issue Type: Improvement > Components: master > Reporter: chunhui shen > Assignee: chunhui shen > Attachments: HBASE-5970.patch > > > We found handing opened event very slow in the environment with lots of regions. > The problem is the slow AssignmentManager#updateTimer. > We do the test for bulk assigning 10w regions, the whole process of bulk assigning took 1 hours. > 2012-05-06 20:31:49,201 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 100000 region(s) round-robin across 5 server(s) > 2012-05-06 21:26:32,103 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done > I think we could do the improvement for the AssignmentManager#updateTimer: Make a thread do this work. > After the improvement, it took only 4.5mins > 2012-05-07 11:03:36,581 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 100000 region(s) across 5 server(s), retainAssignment=true > 2012-05-07 11:07:57,073 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira