hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "SammiChen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy
Date Mon, 28 Nov 2016 11:54:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701787#comment-15701787
] 

SammiChen commented on HDFS-11072:
----------------------------------

Thanks [~andrew.wang] and [~rakeshr] for your discussion which gives me more thoughts on the
task.  Here is the summary of what have done in the initial patch. 
1. define one special "continuous replicate" policy which is used to set a directory from
erasure coding policy back to default replicates, or set a directory from stop inheriting
its parent directory's erasure coding policy. This special "continuous replicate" policy is
only used when setErasureCodingPolicy function is called. It will never be returned when getErasureCodingPolicy
with a path parameter is called, to avoid messing other erasure coding codes.
2  user is allowed to do "replicates <=> ec policy" and "one ec policy <=> another
ec policy" change on a directory. 
3. one thing implemented which is different from what we have discussed before.  Let use an
example, If user create /A/B/C, set ecPolicy1 on "A", then all new created files(direct and
indirect) under "A" will adopt ecPolicy1. And at some point, user set ecPolicy2 on "A". After
that, all new created files(both direct and indirect) under "A" will adopt ecPolicy2. 
4. add test case 

> Add ability to unset and change directory EC policy
> ---------------------------------------------------
>
>                 Key: HDFS-11072
>                 URL: https://issues.apache.org/jira/browse/HDFS-11072
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Andrew Wang
>            Assignee: SammiChen
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HDFS-11072-v1.patch
>
>
> Since the directory-level EC policy simply applies to files at create time, it makes
sense to make it more similar to storage policies and allow changing and unsetting the policy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message