Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 03429C7A0 for ; Mon, 14 May 2012 12:14:42 +0000 (UTC) Received: (qmail 23223 invoked by uid 500); 14 May 2012 12:14:41 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 23080 invoked by uid 500); 14 May 2012 12:14:41 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 23044 invoked by uid 99); 14 May 2012 12:14:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 12:14:40 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 May 2012 12:14:37 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 37BA913B1C for ; Mon, 14 May 2012 12:14:14 +0000 (UTC) Date: Mon, 14 May 2012 12:14:13 +0000 (UTC) From: "nkeywal (JIRA)" To: issues@hbase.apache.org Message-ID: <110806397.61033.1336997655266.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1902345162.60872.1336990248705.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-5998) Bulk assignment: regionserver optimization by using a temporary cache for table descriptors when receveing an open regions request MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13274572#comment-13274572 ] nkeywal commented on HBASE-5998: -------------------------------- The failure in TestDrainingServer is not directly related to my change. I will have a look and fix the flakiness in another jira. > Bulk assignment: regionserver optimization by using a temporary cache for table descriptors when receveing an open regions request > ---------------------------------------------------------------------------------------------------------------------------------- > > Key: HBASE-5998 > URL: https://issues.apache.org/jira/browse/HBASE-5998 > Project: HBase > Issue Type: Improvement > Components: regionserver > Affects Versions: 0.96.0 > Reporter: nkeywal > Assignee: nkeywal > Priority: Minor > Fix For: 0.96.0 > > Attachments: 5998.v2.patch, 5998.v3.patch > > > During the assignment, on the regionserver, before creating the handlers we load the table description. Even if there is a cache, we check the timestamps for each region, while it's not necessary. The test below is just with one node, with more nodes the benefit will improve. By limiting the time spent in HRegion#openRegion we increase the parallelization during cluster startup, as the master is using a pool of threads to call the RS. > -- Without the fix > 2012-05-14 11:40:52,501 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1193 region(s) to localhost,11003,1336988444043 > 2012-05-14 11:41:09,947 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done for localhost,11003,1336988444043 > -- With the fix > 2012-05-14 11:34:40,444 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1193 region(s) to localhost,11003,1336988444043 > 2012-05-14 11:34:40,929 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning done for localhost,11003,1336988065948 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira