hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode
Date Thu, 26 Mar 2015 17:48:53 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382314#comment-14382314
] 

Jing Zhao commented on HDFS-7369:
---------------------------------

bq. converting blocks in replica mode into EC stripping form

I think it may be better to do this outside of NameNode (at least as a first step), through
some external tools/services.

> Erasure coding: distribute recovery work for striped blocks to DataNode
> -----------------------------------------------------------------------
>
>                 Key: HDFS-7369
>                 URL: https://issues.apache.org/jira/browse/HDFS-7369
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-7369-000-part1.patch, HDFS-7369-000-part2.patch, HDFS-7369-001.patch,
HDFS-7369-002.patch, HDFS-7369-003.patch, HDFS-7369-004.patch
>
>
> This JIRA updates NameNode to handle background / offline recovery of erasure coded blocks.
It includes 2 parts:
> # Extend {{UnderReplicatedBlocks}} to recognize EC blocks and insert them to appropriate
priority levels. 
> # Update {{ReplicationMonitor}} to distinguish block codec tasks and send a new DataNode
command.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message