hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode
Date Tue, 07 Mar 2017 01:34:32 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898546#comment-15898546

Kai Zheng commented on HDFS-11314:

I agree it's much safer to have admin configure and ensure the valid policies. The list should
only affect the choices that users would choose for other files/folders, and incur no impact
for existing erasure coded files/folders. Thanks [~andrew.wang] for the great work!

One question and minor, noticed pretty many changes like follows and wondered why. If we would
allow user defined policies in future, due to whatever considerations like new codec, new
option even for existing codec and etc., I guess the more general {{getPolicyByPolicyID}}
name would be better.
-    return ErasureCodingPolicyManager.getPolicyByPolicyID(
+    return ErasureCodingPolicyManager.getSystemPolicyByID(

> Enforce set of enabled EC policies on the NameNode
> --------------------------------------------------
>                 Key: HDFS-11314
>                 URL: https://issues.apache.org/jira/browse/HDFS-11314
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>            Priority: Blocker
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HDFS-11314.001.patch, HDFS-11314.002.patch, HDFS-11314.003.patch,
> Filing based on discussion in HDFS-8095. A user might specify a policy that is not appropriate
for the cluster, e.g. a RS (10,4) policy when the cluster only has 10 nodes. The NN should
only allow the client to choose from a pre-approved list determined by the cluster administrator.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message