hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeffrey Zhong (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5487) Generic framework for Master-coordinated tasks
Date Sat, 19 Oct 2013 00:41:45 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jeffrey Zhong updated HBASE-5487:

    Attachment: Is the FATE of Assignment Manager FATE.pdf

There are already two good write ups on the topic. Here is yet the another one.

The motivations I post this small draft are that I think we need a systematic model for things
like table operations, region assignment and others like in future so that we can design them
in a unified way in order for people easy to follow, easy to add test capabilities and easy
to reason about the result.

I think FATE provides us those capabilities. We can view FATE as a design/system model rather
than an cold Accumulo implementation(in the sense we can change the implementation to fit
HBase cases). 
Under this model, we can simplify region assignment and force feature implementer to code
in such a way that a partial failed operation can be resumed/retied and leave executions to
the framework.

The draft is only two pages long(if you know FATE it should only be one page) and hope we
don't drop FATE as an design option too quickly.

> Generic framework for Master-coordinated tasks
> ----------------------------------------------
>                 Key: HBASE-5487
>                 URL: https://issues.apache.org/jira/browse/HBASE-5487
>             Project: HBase
>          Issue Type: New Feature
>          Components: master, regionserver, Zookeeper
>    Affects Versions: 0.94.0
>            Reporter: Mubarak Seyed
>            Assignee: Sergey Shelukhin
>            Priority: Critical
>         Attachments: Entity management in Master - part 1.pdf, hbckMasterV2-long.pdf,
Is the FATE of Assignment Manager FATE.pdf, Region management in Master5.docx, Region management
in Master.pdf
> Need a framework to execute master-coordinated tasks in a fault-tolerant manner. 
> Master-coordinated tasks such as online-scheme change and delete-range (deleting region(s)
based on start/end key) can make use of this framework.
> The advantages of framework are
> 1. Eliminate repeated code in Master, ZooKeeper tracker and Region-server for master-coordinated
> 2. Ability to abstract the common functions across Master -> ZK and RS -> ZK
> 3. Easy to plugin new master-coordinated tasks without adding code to core components

This message was sent by Atlassian JIRA

View raw message