hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinayakumar B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding
Date Tue, 12 May 2015 05:56:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539298#comment-14539298
] 

Vinayakumar B commented on HDFS-8347:
-------------------------------------

bq. as cellSize can be set per file opposed to EC zone and would be most flexible.
I didn't mean like that. I meant since {{chunkSize}} is no longer carried as part of ECSchema,
need to add separate cellSize in HdfsFileStatus.
It would be problematic if user allowed to set cellsize for each file after write. So IMO
it would be better to stick with ECZone.

> Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding
> ----------------------------------------------------------------------------------------
>
>                 Key: HDFS-8347
>                 URL: https://issues.apache.org/jira/browse/HDFS-8347
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>
> Currently decode buffersize for Datanode striped block reconstruction is configurable
and can be less or larger than chunksize, it may cause issue for Hitchhiker which may require
encode/decode using same buffersize.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message