hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Kace (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10687) Federation Membership State Store internal APIs
Date Tue, 20 Sep 2016 23:28:20 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jason Kace updated HDFS-10687:
    Attachment: HDFS-10467-HDFS-10687-001.patch

Attaching first patch version for review.

This patch contains some overlap code (common dependencies) with HDFS-10630 (Federation State
Store).  The code compiles as is, but is not functional until HDFS-10630 is committed.

The Federation membership state API functions are defined in org.apache.hadoop.hdfs.server.federation.store.FederationMembershipStateStore.java
and are implemented in org.apache.hadoop.hdfs.server.federation.store.impl.FederationMembershipStateStoreImpl.java.

The primary function of the membership state API is to persist the data required to identify
the most active, or recently active, NN for each nameservice.  This is a key feature for HDFS
federation.  Individual routers monitor 1-N namenodes and heartbeat the namenode status into
the state store.  The NN heartbeat code is available for review in HDFS-10629.  This patch
contains the APIs to query, update and cache the reported state of all NNs in the cluster.

The additional files pertain to request/response API objects and the protobuf backing implementation
of them.

All comments and feedback are welcome!

> Federation Membership State Store internal APIs
> -----------------------------------------------
>                 Key: HDFS-10687
>                 URL: https://issues.apache.org/jira/browse/HDFS-10687
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: fs
>            Reporter: Inigo Goiri
>            Assignee: Jason Kace
>         Attachments: HDFS-10467-HDFS-10687-001.patch
> The Federation Membership State encapsulates the information about the Namenodes of each
sub-cluster that are participating in Federation. The information includes addresses for RPC,
Web. This information is stored in the State Store and later used by the Router to find data
in the federation.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message