hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nkeywal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-5998) Bulk assignment: regionserver optimization by using a temporary cache for table descriptors when receveing an open regions request
Date Mon, 14 May 2012 10:10:48 GMT
nkeywal created HBASE-5998:
------------------------------

             Summary: Bulk assignment: regionserver optimization by using a temporary cache
for table descriptors when receveing an open regions request
                 Key: HBASE-5998
                 URL: https://issues.apache.org/jira/browse/HBASE-5998
             Project: HBase
          Issue Type: Improvement
          Components: regionserver
    Affects Versions: 0.96.0
            Reporter: nkeywal
            Assignee: nkeywal
            Priority: Minor


During the assignment, on the regionserver, before creating the handlers we load the table
description. Even if there is a cache, we check the timestamps for each region, while it's
not necessary. The test below is just with one node, with more nodes the benefit will improve.
By limiting the time spent in HRegion#openRegion we increase the parallelization during cluster
startup, as the master is using a pool of threads to call the RS.

-- Without the fix
2012-05-14 11:40:52,501 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning
1193 region(s) to localhost,11003,1336988444043
2012-05-14 11:41:09,947 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning
done for localhost,11003,1336988444043

-- With the fix
2012-05-14 11:34:40,444 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning
1193 region(s) to localhost,11003,1336988444043
2012-05-14 11:34:40,929 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning
done for localhost,11003,1336988065948


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message