hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups
Date Wed, 15 Apr 2015 02:41:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495568#comment-14495568
] 

Li Bo commented on HDFS-8120:
-----------------------------

When completing a block group, NN will check if the replications of this block group reach
the minimum replicas. Currently the minimum number is the number of data blocks. If DFSStripedOutputStream
don't send out an empty package to empty block, the replications of this block group may be
smaller than the number of data blocks, which make {{DFSOutputStream#completeFile}} fail.


> Erasure coding: created util class to analyze striped block groups
> ------------------------------------------------------------------
>
>                 Key: HDFS-8120
>                 URL: https://issues.apache.org/jira/browse/HDFS-8120
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-8120.000.patch, HDFS-8120.001.patch, HDFS-8120.002.patch, HDFS-8120.003.patch,
HDFS-8120.004.patch
>
>
> The patch adds logic of calculating size of individual blocks in a striped block group.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message