hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8120) Erasure coding: created util class to analyze striped block groups
Date Mon, 13 Apr 2015 06:20:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491963#comment-14491963
] 

Li Bo commented on HDFS-8120:
-----------------------------

Thanks Zhe for the bug fixing. 

Does {{cellsInStripe}} mean the number of cells in a block? Otherwise it’s duplicated with
{{dataBlocks}}. I think we can use a more clear name such as {{stripesInFullBlockGroup}}.
{{blockSize = cellSize * cellsInStripe*dataBlocks}} , it seems {{blockSize}} is the size of
block group. I think we don’t need to multiple {{dataBlocks}}.
Originally I set the block size to 8M. If this is too big for an unit test, we can decrease
the size. But 2 * 256 is a little smaller,  it makes {{TestFileMoreThanStripes2()}} testing
a file that is bigger than a block group. I think we can use 4 stripes in a block group.


> Erasure coding: created util class to analyze striped block groups
> ------------------------------------------------------------------
>
>                 Key: HDFS-8120
>                 URL: https://issues.apache.org/jira/browse/HDFS-8120
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Zhe Zhang
>         Attachments: HDFS-8120.000.patch, HDFS-8120.001.patch
>
>
> The patch adds logic of calculating size of individual blocks in a striped block group.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message