hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "luhuichun (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11975) Provide a system-default EC policy
Date Mon, 03 Jul 2017 03:01:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071874#comment-16071874
] 

luhuichun commented on HDFS-11975:
----------------------------------

[~eddyxu][~Sammi][~drankye] Update the patch, the failed unit test is solved.  For the issue
of system-default EC policy, I set a two configuration in DFSConfigKeys.java. One for user
setting, the other is hard code default value "RS-6-3-64k". The NameNodeRpcServer do the judgement
according to the configuration and user CLI. Thanks for reviewing.

> Provide a system-default EC policy
> ----------------------------------
>
>                 Key: HDFS-11975
>                 URL: https://issues.apache.org/jira/browse/HDFS-11975
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Lei (Eddy) Xu
>            Assignee: luhuichun
>         Attachments: HDFS-11975-001.patch, HDFS-11975-002.patch, HDFS-11975-003.patch
>
>
> From the usability point of view, it'd be nice to be able to specify a system-wide EC
policy, i.e., in {{hdfs-site.xml}}. For most of users / admin / downstream projects, it is
not necessary to know the tradeoffs of the EC policy, considering that it requires the knowledge
of EC, the actual physical topology of the clusters, and many other factors (i.e., network,
cluster size and etc).
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message