hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thiruvel Thirumoolan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-20545) Improve performance of BaseLoadBalancer.retainAssignment
Date Tue, 08 May 2018 21:15:00 GMT
Thiruvel Thirumoolan created HBASE-20545:

             Summary: Improve performance of BaseLoadBalancer.retainAssignment
                 Key: HBASE-20545
                 URL: https://issues.apache.org/jira/browse/HBASE-20545
             Project: HBase
          Issue Type: Improvement
          Components: Balancer
    Affects Versions: 2.0.0, 1.4.4
            Reporter: Thiruvel Thirumoolan
            Assignee: Thiruvel Thirumoolan
             Fix For: 1.5.0, 2.0.1, 1.4.5

I was measuring perf at scale with a 1m region table and noticed some improvements can be
made to BaseLoadBalancer.retainAssignment().

retainAssignment() spends a few mins to enable a 1m regions table and also generates a lot
of objects unnecessarily. This jira is to make the most common case go faster with very minimal
changes. A slightly modified version of this patch takes about 5 seconds for a 1m region table
ignoring the time spent in createCluster(). I think locality can be refreshed during master
startup in different ways without taking time in retainAssignment, but will follow up on that
in subsequent jiras. Leaving it untouched here, but wanted to call out the time taken without
that method.

This message was sent by Atlassian JIRA

View raw message