hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Lau (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13991) Hierarchical Layout for Humongous Tables
Date Mon, 06 Jul 2015 22:53:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615813#comment-14615813
] 

Ben Lau commented on HBASE-13991:
---------------------------------

Hi guys, hope you had a happy 4th of July.  

We would like to do something akin to Lars’ last idea.  That is, we will have code to support
both the old layout and the new layout, but it will be on a per HBase cluster basis.  You
will be able to migrate a cluster entirely to the hierarchical layout or leave it on the old
layout.  

This approach has the following pros:
- If HBase users do not need/want the new layout, they will not have to do an offline upgrade
in order to use new HBase code.  The alternative is to make an online upgrade for the hierarchical
layout, but this would require some very messy changes to the codebase and also be tricky
to test fully.
- HBase code will not have to ‘detect’ whether tables/paths/regions are hierarchical or
not.  The master or region server can simply look at the root table at startup and use that
to determine if the cluster has migrated to the hierarchical layout.  This single source of
truth would make code less ugly since you don’t need to do in-context per-region/path checks
in different parts of the codebase. 

What do you guys think about this approach?  

> Hierarchical Layout for Humongous Tables
> ----------------------------------------
>
>                 Key: HBASE-13991
>                 URL: https://issues.apache.org/jira/browse/HBASE-13991
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Ben Lau
>            Assignee: Ben Lau
>         Attachments: HBASE-13991-master.patch, HumongousTableDoc.pdf
>
>
> Add support for humongous tables via a hierarchical layout for regions on filesystem.
 
> Credit for most of this code goes to Huaiyu Zhu.  
> Latest version of the patch is available on the review board: https://reviews.apache.org/r/36029/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message