hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuanbo Liu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11236) Erasure Coding cann't support appendToFile
Date Mon, 12 Dec 2016 09:49:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15741502#comment-15741502
] 

Yuanbo Liu commented on HDFS-11236:
-----------------------------------

[~gehaijiang] Thanks for filing this JIRA.
To my knowledge, I don't think it's convenient for EC to support append operation,
since the block of EC file is divided into several cells which are distributed to different
nodes. 
I'd prefer marking this JIRA as "Won't fix"(If I'm wrong, please let me know)

> Erasure Coding cann't support appendToFile
> ------------------------------------------
>
>                 Key: HDFS-11236
>                 URL: https://issues.apache.org/jira/browse/HDFS-11236
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: gehaijiang
>
> hadoop 3.0.0-alpha1
> $  hdfs erasurecode -getPolicy /ectest/workers
> ErasureCodingPolicy=[Name=RS-DEFAULT-6-3-64k, Schema=[ECSchema=[Codec=rs-default, numDataUnits=6,
numParityUnits=3]], CellSize=65536 ]
> $  hadoop fs  -appendToFile  hadoop/etc/hadoop/httpfs-env.sh  /ectest/workers
> appendToFile: Cannot append to files with striped block /ectest/workers



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message