hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elliott Clark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5487) Generic framework for Master-coordinated tasks
Date Tue, 08 Oct 2013 19:22:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789576#comment-13789576
] 

Elliott Clark commented on HBASE-5487:
--------------------------------------

bq.Please let's not use coprocessors for mainline functionality
We already do.  I don't see anything wrong with making HBase more modular.  If there are pain
points with using co-processors that cause you to say no, then we should fix those.  Not just
ignore them.


bq.also, if we store state in system table that is hosted by master, then we don't need ZK
at all, we should get rid of it.
We don't have ephemeral node capability at all.  And we need it for the bootstrap problem.
 It allows clients to point at a relatively small number of nodes to discover the whole cluster.

bq.As far as I see, ZK is more reliable than HBase RS or master
Our master is only complex because of our use of zk to hold and mutate state.

bq.has built-in replication with faster recovery
With the meta/system wal I think we can be within an order of magnitude.

> Generic framework for Master-coordinated tasks
> ----------------------------------------------
>
>                 Key: HBASE-5487
>                 URL: https://issues.apache.org/jira/browse/HBASE-5487
>             Project: HBase
>          Issue Type: New Feature
>          Components: master, regionserver, Zookeeper
>    Affects Versions: 0.94.0
>            Reporter: Mubarak Seyed
>            Priority: Critical
>         Attachments: Region management in Master.pdf
>
>
> Need a framework to execute master-coordinated tasks in a fault-tolerant manner. 
> Master-coordinated tasks such as online-scheme change and delete-range (deleting region(s)
based on start/end key) can make use of this framework.
> The advantages of framework are
> 1. Eliminate repeated code in Master, ZooKeeper tracker and Region-server for master-coordinated
tasks
> 2. Ability to abstract the common functions across Master -> ZK and RS -> ZK
> 3. Easy to plugin new master-coordinated tasks without adding code to core components



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message