hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rishit Shroff (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12476) HydraBase Consensus Protocol
Date Mon, 24 Nov 2014 21:16:14 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223528#comment-14223528

Rishit Shroff commented on HBASE-12476:

[~stack]: Thanks for looking through the code and providing the inputs. Please find my responses

What direction do you think we should take this contrib?Toward the layout described in the
hydrabase doc or are you thinking we'd recast it as an in-cluster quorum-of-regions? If the
latter, would it be on all the time – a different sort of hbase – or would it be something
you could enable? HBase 2.0 or HBase 1.0?
bq. Rishit: The RAFT module by itself is pretty independent of in-cluster vs multi-cluster
setup. It just deals with peers with ranks and replication. I think the question will be about
how we want to take the integration of this protocol into HBase. IMO, we can target for in-cluster
mode first and then make it applicable to cross-cluster. Also, since HBase 1.0 is a soon to
be released version, I would prefer to put into into HBase 2.0. For sure, we will need to
meetup and chat about this. I would prefer to have this as an opt-in option.

What should we do about swift out here in apache hbase? We'd redo it as pb and rpc calls?
bq. Rishit: The swift jars used in current HBase are old, we definitely need to upgrade them
and fix the changed dependencies.

airlift is not for REST services, right? You are just using it for stats? You like it? Better
than the histograms we have going on out herein apache hbase? You have a Counter, Duration,
TimeDistribution, and ExpotentialDecay.. Need airlift for this or could redo doing our current
metrics dependencies?
bq. Rishit: Yes, even in my profiling, I saw airlift as a hot-spot. I will file a JIRA to
move the stats out of airlift and choose the other options (hadoop style, or [~daviddengcn]
work for histogram at the very least.

Should apache hbase make use of jmxutils too? How you folks using it (Not reviewed the patch
bq. Rishit: AFAIK, they are used by airlift package. I will double check.


> HydraBase Consensus Protocol
> ----------------------------
>                 Key: HBASE-12476
>                 URL: https://issues.apache.org/jira/browse/HBASE-12476
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Consensus, wal
>            Reporter: Gaurav Menghani
>            Assignee: Gaurav Menghani
>         Attachments: 0001-HydraBase-consensus-protocol.patch
> This is the first patch for the HydraBase consensus protocol implemented according to
the Raft consensus protocol (https://ramcloud.stanford.edu/raft.pdf), as advertised in (HBASE-12259)

This message was sent by Atlassian JIRA

View raw message