hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.
Date Tue, 10 Mar 2015 06:47:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354413#comment-14354413

Konstantin Shvachko commented on HDFS-7007:

It's been a while, so let me remind what we want to achieve here.
- "Write" RPC calls to ConsensusNode - those that modify the namespace, like mkdir(), need
to be coordinated before the modification is applied to the namespace.
- The goal of coordination is to determine the order of the modification, so that multiple
CNodes were applying all modifications deterministically.
- So when a write call comes we send a proposal to CoordinationEngine with that call. CE produces
an agreement and delivers it to each CNode in the agreed order. Then CNodes execute the call.

This jira is to develop NameNode APIs or plugins, which would allow such workflow. If we can
develop the plugins in trunk or agree what they should be, the rest of the development could
continue on a branch.

> Interfaces to plugin ConsensusNode.
> -----------------------------------
>                 Key: HDFS-7007
>                 URL: https://issues.apache.org/jira/browse/HDFS-7007
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>    Affects Versions: 3.0.0
>            Reporter: Konstantin Shvachko
> This is to introduce interfaces in NameNode and namesystem, which are needed to plugin

This message was sent by Atlassian JIRA

View raw message