hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Francis Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11165) Scaling so cluster can host 1M regions and beyond (50M regions?)
Date Tue, 19 Aug 2014 02:06:19 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101717#comment-14101717

Francis Liu commented on HBASE-11165:

Do we need to split this conversation into what to do on master and what to do with 0.98?
We could for example file two separate subtasks that approach the meta scaling problem in
different ways for the respective branches. They are divergent enough so that would be a good
idea IMHO>
It sounds to me like we've at least come to an agreement that splitting META is reasonable.
Off-hand any implementation in trunk should be backportable 0.98. The parallel discussion
was about multi-master and the merits of collocation which can be a separate issue. Correct
me if I'm wrong [~mbertozzi] and [~jxiang].  

> Scaling so cluster can host 1M regions and beyond (50M regions?)
> ----------------------------------------------------------------
>                 Key: HBASE-11165
>                 URL: https://issues.apache.org/jira/browse/HBASE-11165
>             Project: HBase
>          Issue Type: Brainstorming
>            Reporter: stack
>         Attachments: HBASE-11165.zip, Region Scalability test.pdf, zk_less_assignment_comparison_2.pdf
> This discussion issue comes out of "Co-locate Meta And Master HBASE-10569" and comments
on the doc posted there.
> A user -- our Francis Liu -- needs to be able to scale a cluster to do 1M regions maybe
even 50M later.  This issue is about discussing how we will do that (or if not 50M on a cluster,
how otherwise we can attain same end).
> More detail to follow.

This message was sent by Atlassian JIRA

View raw message