hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-862) region balancing is clumsy
Date Thu, 04 Sep 2008 09:25:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12628285#action_12628285
] 

Andrew Purtell commented on HBASE-862:
--------------------------------------

Let me take a look at this one if nobody else is working on it. Will incorporate stack and
Billy's thoughts into more sophisticated strategy that balances balancing against regionserver
load and region availability considerations, ready for 0.2.2. We'll be deploying 10 additional
nodes into a running 15 node cluster with 1000s of regions running a continuous cycle of TableMap/TableReduce
tasks so there will be ample opportunity for testing. 

> region balancing is clumsy
> --------------------------
>
>                 Key: HBASE-862
>                 URL: https://issues.apache.org/jira/browse/HBASE-862
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>
> Daniel Leffel has an install of 500 regions on 4 nodes.  He's running 0.2.0.
> On restart, load balancing is running while the 600 regions are being initially opened.
 Makes for churn.  Load balancing should wait before it cuts in.
> Have also seen on occasion that it will not find equilibrium after a restart.
> Adding a node is catastrophic.  >20% of the regions were closed and were taking the
longest time to show up on the new server.  I would think that the region balancing would
work in more sophisticated and gradual manner.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message