hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11314) Enforce set of enabled EC policies on the NameNode
Date Tue, 07 Mar 2017 01:34:32 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898546#comment-15898546
] 

Kai Zheng commented on HDFS-11314:
----------------------------------

I agree it's much safer to have admin configure and ensure the valid policies. The list should
only affect the choices that users would choose for other files/folders, and incur no impact
for existing erasure coded files/folders. Thanks [~andrew.wang] for the great work!

One question and minor, noticed pretty many changes like follows and wondered why. If we would
allow user defined policies in future, due to whatever considerations like new codec, new
option even for existing codec and etc., I guess the more general {{getPolicyByPolicyID}}
name would be better.
{code}
-    return ErasureCodingPolicyManager.getPolicyByPolicyID(
+    return ErasureCodingPolicyManager.getSystemPolicyByID(
{code}

> Enforce set of enabled EC policies on the NameNode
> --------------------------------------------------
>
>                 Key: HDFS-11314
>                 URL: https://issues.apache.org/jira/browse/HDFS-11314
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>            Priority: Blocker
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HDFS-11314.001.patch, HDFS-11314.002.patch, HDFS-11314.003.patch,
HDFS-11314.004.patch
>
>
> Filing based on discussion in HDFS-8095. A user might specify a policy that is not appropriate
for the cluster, e.g. a RS (10,4) policy when the cluster only has 10 nodes. The NN should
only allow the client to choose from a pre-approved list determined by the cluster administrator.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message