hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file
Date Fri, 18 Dec 2015 19:48:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15064630#comment-15064630
] 

Jing Zhao commented on HDFS-9173:
---------------------------------

The main challenge now is that with hflush we can no longer infer what data was used to compute
the parity chunks, unless we "attach" additional information to them. For Nicholas's example,
even if we know we have 3 parity chunks with length 64KB, currently we do not know if they
are computed based on the whole stripe, or based on a partial stripe (which is triggered by
a hflush call). 

> Erasure Coding: Lease recovery for striped file
> -----------------------------------------------
>
>                 Key: HDFS-9173
>                 URL: https://issues.apache.org/jira/browse/HDFS-9173
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Walter Su
>            Assignee: Walter Su
>         Attachments: HDFS-9173.00.wip.patch, HDFS-9173.01.patch, HDFS-9173.02.step125.patch,
HDFS-9173.03.patch, HDFS-9173.04.patch, HDFS-9173.05.patch, HDFS-9173.06.patch, HDFS-9173.07.patch,
HDFS-9173.08.patch, HDFS-9173.09.patch, HDFS-9173.09.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message