hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned
Date Tue, 23 Feb 2016 20:46:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159615#comment-15159615
] 

Jing Zhao commented on HDFS-8786:
---------------------------------

Thanks for working on this, Rakesh. Some quick comments:
# We can create replication task for an EC block only when we can make sure we have all the
internal blocks (the source nodes can be in decommissioned/decommissioning state). Otherwise
even if we have decommissioned/decommissioning datanodes, we should still trigger an EC reconstruction
task.
# For changes in {{BlockInfoStriped}}, instead of directly mixing decommission related logic
inside, it will be better to add a sorting logic in BlockManager just as what we do for contiguous
blocks.

> Erasure coding: DataNode should transfer striped blocks before being decommissioned
> -----------------------------------------------------------------------------------
>
>                 Key: HDFS-8786
>                 URL: https://issues.apache.org/jira/browse/HDFS-8786
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Rakesh R
>         Attachments: HDFS-8786-001.patch, HDFS-8786-draft.patch
>
>
> Per [discussion | https://issues.apache.org/jira/browse/HDFS-8697?focusedCommentId=14609004&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14609004]
under HDFS-8697, it's too expensive to reconstruct block groups for decomm purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message