hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HDFS-13655) RBF: Add missing ClientProtocol APIs to RBF
Date Thu, 02 Aug 2018 17:58:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16567288#comment-16567288

Íñigo Goiri commented on HDFS-13655:

[~xiaochen], I already implemented those three methods.
However, the state is different for each, let me go over:
* safemode: this one is working and I tested it. We use it in production and so far no issues.
* saveNamespace: this one is implemented and I tested it by hand and it seems to trigger the
fsimage saving. We internally don't use it that much so it could have some bugs.
* rollingUpgrade: same as saveNamespace, it is implemented but as we don't use it that much,
I'm not sure if it covers all the cases.

> RBF: Add missing ClientProtocol APIs to RBF
> -------------------------------------------
>                 Key: HDFS-13655
>                 URL: https://issues.apache.org/jira/browse/HDFS-13655
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Xiao Chen
>            Priority: Major
> As [discussed|https://issues.apache.org/jira/browse/HDFS-12858?focusedCommentId=16500975&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16500975|#comment-16500975] with
[~elgoiri], there are some HDFS methods that does not take path as a parameter. We should
support these to work with federation.
> The ones missing are:
>  * Snapshots
>  * Storage policies
>  * Encryption zones
>  * Cache pools
> One way to reasonably have them to work with federation is to 'list' each nameservice
and concat the results. This can be done pretty much the same as {{refreshNodes()}} and
it would be a matter of querying all the subclusters and aggregate the output (e.g., {{getDatanodeReport()}}.)

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message