hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Francis Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6721) RegionServer Group based Assignment
Date Wed, 05 Sep 2012 22:08:08 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449185#comment-13449185

Francis Liu commented on HBASE-6721:

> Have you considered introducing interface for AssignmentManager so that existing and
new managers can be easily swapped?
Yes, part of the proposal is to make AssignmentManager pluggable. I'll add that as a subtask
for this.

> Have you considered storing group information in zookeeper instead of on hdfs ?
Correct me if I'm wrong, but it seems the approach HBase has taken for it's usage of ZK is
more towards storing temporal data for coordination and the real source of truth is on HDFS
or Tables. And we decided to follow the same approach. 

> Please explain more about RegionServerGroupProtocol.
RegionServerGroupProtocol exposes APIs to manage Grouping (see API in doc). The currently
plan is that these APIs will be used and exposed via the CLI commands. 

> Another aspect is fault tolerance.
> Say the smallest group consists of 6 region servers, the impact of majority of the 6
servers going down at the same time is much higher than 6 
> servers out of whole cluster going down where there is only one group.
This is similar to hbase cluster sizing for fault tolerance. Let's play around with it and
later on document best practices.

> RegionServer Group based Assignment
> -----------------------------------
>                 Key: HBASE-6721
>                 URL: https://issues.apache.org/jira/browse/HBASE-6721
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Francis Liu
>            Assignee: Vandana Ayyalasomayajula
>             Fix For: 0.96.0
>         Attachments: HBASE-6721-DesigDoc.pdf
> In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving
out regions from a number of different tables owned by various client applications. Being
able to group a subset of running RegionServers and assign specific tables to it, provides
a client application a level of isolation and resource allocation.
> The proposal essentially is to have an AssignmentManager which is aware of RegionServer
groups and assigns tables to region servers based on groupings. Load balancing will occur
on a per group basis as well. 
> This is essentially a simplification of the approach taken in HBASE-4120. See attached

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message