hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhe Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones
Date Thu, 02 Apr 2015 22:05:56 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393558#comment-14393558
] 

Zhe Zhang commented on HDFS-7839:
---------------------------------

Thanks Kai for raising the question regarding naming (zone vs. XStoragePolicy). As part of
the meetup we decided to provide simple zone-like semantics in this phase.

We didn't have enough time to discuss the long term strategy. IMO EC config will eventually
become part of extended storage policies. At least we'll have 2 dimensions of XStoragePolicy
with phase 2 of erasure coding: striping and EC schema. We can revisit this later. The naming
itself is easy to change anyway.

> Erasure coding: implement facilities in NameNode to create and manage EC zones
> ------------------------------------------------------------------------------
>
>                 Key: HDFS-7839
>                 URL: https://issues.apache.org/jira/browse/HDFS-7839
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-7839-000.patch, HDFS-7839-001.patch, HDFS-7839-002.patch, HDFS-7839-003.patch
>
>
> As a quick first step to facilitate initial development and testing, HDFS-7347 added
EC configuration in file header as one storage policy. We have discussed and [concluded |https://issues.apache.org/jira/browse/HDFS-7285?focusedCommentId=14296210&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14296210]
that EC configurations should be part of XAttr. This JIRA aims to add the basic EC XAttr structure.
HDFS-7337 will add configurable and pluggable schema info.
> This JIRA will follow the [plan | https://issues.apache.org/jira/browse/HDFS-7285?focusedCommentId=14370307&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14370307]
we made under HDFS-7285.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message