hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "binlijin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-16570) Compute region locality in parallel at startup
Date Wed, 09 Nov 2016 07:05:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649981#comment-15649981
] 

binlijin edited comment on HBASE-16570 at 11/9/16 7:05 AM:
-----------------------------------------------------------

The new added UT case is to make sure after RegionLocationFinder#refreshAndWait, regions's
HDFSBlocksDistribution have cached in master's memory.
And change lastFullRefresh is to make HMaster start up faster when backup master becomes active
master, we have encounter a longer startup(backup master becomes active master) which last
2.5 hours because namenode in high load, and after the change we only need less than 5 minutes.
-  private long lastFullRefresh = 0;
+  // Do not scheduleFullRefresh at master startup
+  private long lastFullRefresh = EnvironmentEdgeManager.currentTime();



was (Author: aoxiang):
The new added UT case is to make sure after RegionLocationFinder#refreshAndWait, regions's
HDFSBlocksDistribution have cached in master's memory.
And change lastFullRefresh is to make HMaster start up faster when backup master becomes active
master, we have encounter a longer startup(backup master becomes active master) which last
2.5 hours because namenode in high load, and after the change we only less than 5 minutes.
-  private long lastFullRefresh = 0;
+  // Do not scheduleFullRefresh at master startup
+  private long lastFullRefresh = EnvironmentEdgeManager.currentTime();


> Compute region locality in parallel at startup
> ----------------------------------------------
>
>                 Key: HBASE-16570
>                 URL: https://issues.apache.org/jira/browse/HBASE-16570
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: binlijin
>            Assignee: binlijin
>             Fix For: 2.0.0, 1.4.0, 1.3.1
>
>         Attachments: HBASE-16570-master_V1.patch, HBASE-16570-master_V2.patch, HBASE-16570-master_V3.patch,
HBASE-16570-master_V4.patch, HBASE-16570.branch-1.3-addendum.patch, HBASE-16570_addnum.patch,
HBASE-16570_addnum_v2.patch, HBASE-16570_addnum_v3.patch, HBASE-16570_addnum_v4.patch, HBASE-16570_addnum_v5.patch,
HBASE-16570_addnum_v6.patch, HBASE-16570_addnum_v7.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message