hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inigo Goiri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10467) Router-based HDFS federation
Date Tue, 25 Apr 2017 18:42:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983422#comment-15983422
] 

Inigo Goiri commented on HDFS-10467:
------------------------------------

[~fabbri], the tasks in the current JIRA are the basic ones to get the Router-based federation
working.
There are a bunch of them that we can add:
* Web interface
* Metrics system
* Router heartbeating
* Router safe mode
* Rebalancing

All these are already implemented and is running in our clusters.
There is a couple months ago version available at:
https://github.com/goiri/hadoop/tree/branch-2.6.1-hdfs-router
(I can update with the latest if needed.)

At this point is a matter of reviewing the code in the subtasks.
It's hard to give a time frame but having reviews; so any reviews on the subtasks is highly
appreciated.

> Router-based HDFS federation
> ----------------------------
>
>                 Key: HDFS-10467
>                 URL: https://issues.apache.org/jira/browse/HDFS-10467
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 2.8.1
>            Reporter: Inigo Goiri
>            Assignee: Inigo Goiri
>         Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS Router Federation.pdf,
HDFS-Router-Federation-Prototype.patch
>
>
> Add a Router to provide a federated view of multiple HDFS clusters.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message