hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11623) Move system erasure coding policies into hadoop-hdfs-client
Date Fri, 07 Apr 2017 18:59:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961289#comment-15961289
] 

Andrew Wang commented on HDFS-11623:
------------------------------------

Thanks for reviewing Wei-chiu! New patch to simplify the array as noted, and also to hopefully
get a working precommit. Not sure why the build failed like that, it builds for me locally.

Enabled policies work as you describe. The idea is that admins can restrict the set of policies
used by the cluster. It doesn't affect already written files since they should still be readable.
It doesn't affect already set policies to reduce user surprise, though we chould reconsider
this and instead treat it similarly to min-replication. Thoughts?

Agree that ECPManager looks quite simple now, but it'll be fleshed by the pluggable policy
work at HDFS-7337. Kai sketched out the new responsibilities above.

> Move system erasure coding policies into hadoop-hdfs-client
> -----------------------------------------------------------
>
>                 Key: HDFS-11623
>                 URL: https://issues.apache.org/jira/browse/HDFS-11623
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>         Attachments: HDFS-11623.001.patch, HDFS-11623.002.patch, HDFS-11623.003.patch,
HDFS-11623.004.patch, HDFS-11623.005.patch
>
>
> This is a precursor to HDFS-11565. We need to move the set of system defined EC policies
out of the NameNode's ECPolicyManager into the hdfs-client module so it can be referenced
by the client.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message