Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 19 Dec 2013 02:24:09 +0000 (UTC)
From: "Liu Shaohui (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.12681551.1385554989800.62528.1387419849727@arcas>
In-Reply-To: <JIRA.12681551.1385554989800@arcas>
References: <JIRA.12681551.1385554989800@arcas>
Subject: [jira] [Commented] (HBASE-10049) Small improvments in
 region_mover.rb
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852498#comment-13852498 ] 

Liu Shaohui commented on HBASE-10049:
-------------------------------------

[~jmspaggi]
{quote}
What is the reason behind the 20 seconds delay?
{quote}
There is a time gap between RS's startup report to HMaster and it's starting of service threads.  And we found some exceptions in moving regions for RS have not finished to start it's service threads. So we add 20 seconds delay to make sure the RS have enough time to finish initialization.
But the 20 may be not reasonable, especially for large clusters.

Ps: For large clusters,  we plan to dev a region_mover which can unload/load multi regionservers at the same time

{quote}
Adding a log in the move method make the application VERY verbose, doubling the output. Is that really useful? 
{quote}
Yes. I think it's very useful to measure the maximum unavailable time for each region using region_mover.rb.
And many other factors and configs will affect this time, eg: hbase.hstore.open.and.close.threads.max.
According to this time. we can do more optimizations to reduce the unavailable time in gracefull upgrade.

I don't know if the explanation is clear. More discussions are welcomed. Thanks.


> Small improvments in region_mover.rb
> ------------------------------------
>
>                 Key: HBASE-10049
>                 URL: https://issues.apache.org/jira/browse/HBASE-10049
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Liu Shaohui
>            Assignee: Liu Shaohui
>            Priority: Minor
>             Fix For: 0.98.0, 0.94.15, 0.96.2
>
>         Attachments: HBASE-10049-0.94-v1.diff, HBASE-10049-0.94-v2.diff, HBASE-10049-trunk-v1.diff
>
>
> We use region_mover.rb in the graceful upgrade of hbase cluster.
> Here are small improvements.
> a. remove the table.close(), because  the htable could be reused.
> b. Add more info in the log of moving region.
> c. Add 20s sleep in load command to make sure the rs finished initialization of rpc server. There is a time gap between rs startup report and rpc server initialization.


--
This message was sent by Atlassian JIRA
(v6.1.4#6159)