hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups
Date Tue, 14 Apr 2015 03:21:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493500#comment-14493500

Kai Zheng commented on HDFS-7613:

Just questions, is this policy intended to be used by stripping erasure coding? So when client
writes a new file in stripping, this policy will be used to determine how to place the 6 +
3 blocks for example?

If above is true, how about non-stripping erasure coding? In that case, think about how to
select the 6 data blocks from existing, and then how to determine to place the result 3 parity
blocks? Will this policy help then or will we need a new one?

> Block placement policy for erasure coding groups
> ------------------------------------------------
>                 Key: HDFS-7613
>                 URL: https://issues.apache.org/jira/browse/HDFS-7613
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Walter Su
>         Attachments: HDFS-7613.001.patch
> Blocks in an erasure coding group should be placed in different failure domains -- different
DataNodes at the minimum, and different racks ideally.

This message was sent by Atlassian JIRA

View raw message