hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vishal Kathuria (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-3833) ability to support includes/excludes list in Hbase
Date Mon, 02 May 2011 02:40:03 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027530#comment-13027530
] 

Vishal Kathuria commented on HBASE-3833:
----------------------------------------

Hi,
I have started implementing this and below is a mini-spec. Could you pls look through it and
let me know if you have any comments.

Functionality
1. The semantics of the include and exclude lists would be identical to Hadoop. If the include
list is empty, then universal include set is assumed. exclude list takes precedence over include
list.
2. Adding a node to exclude list + issuing a refresh using the command line utility will trigger
ServerManager::expireServer for an already online server. This is the same code path that
happens when the node goes down.
3. Nodes in excludeList (or the nodes which are not in include list) will not be allowed to
join. 
4. The list will support hostname:port type of entries, where port is optional. Even though
in production we wouldn't have multiple regionservers per node, I am doing this to make testing
easier on dev servers.

Tools
For the command line utility, there will be a new command to refresh server list that will
be implemented in HBaseAdmin.
HBaseAdmin will call into a method that will be added to HMaster and HMasterInterface. As
mentioned above, if a node is added to excludeList or is removed from include list, it will
be expired. If a node is added to the includeList, no action will be taken.

The command to refresh server list will be exposed in the hbase shell as well.


Nicolas: 'bin/hbase-daemon.sh stop regionserver' kills the region server process. I am proposing
that we don't try to do that. In the scenario that Dhruba mentioned to me, the regionserver
node might be sick and we may not be able to kill it.

Dhruba: Other than the command line utility to refresh the server list, are there any other
tools that we need to provide?

Thanks!


> ability to support includes/excludes list in Hbase
> --------------------------------------------------
>
>                 Key: HBASE-3833
>                 URL: https://issues.apache.org/jira/browse/HBASE-3833
>             Project: HBase
>          Issue Type: Improvement
>          Components: client, regionserver
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>
> An HBase cluster currently does not have the ability to specify that the master should
accept regionservers only from a specified list. This helps preventing administrative errors
where the same machine could be included in two clusters. It also allows the administrator
to easily remove un-ssh-able machines from the cluster.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message