hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3689) Add support for variable length block
Date Fri, 22 Aug 2014 17:50:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107176#comment-14107176
] 

Owen O'Malley commented on HDFS-3689:
-------------------------------------

Since this is a discussion of what to put into trunk, incompatible changes aren't a blocker.
Furthermore, most clients would never see the difference. Variable length blocks would dramatically
improve the ability of HDFS to support better file formats like ORC.

On the other hand, I've had very bad experiences with sparse files on Unix. It is all too
easy for a user to copy a sparse file and not understand that the copy is 10x larger than
the original. That would be *bad* and I do not think that HDFS should support it at all.

> Add support for variable length block
> -------------------------------------
>
>                 Key: HDFS-3689
>                 URL: https://issues.apache.org/jira/browse/HDFS-3689
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode, hdfs-client, namenode
>    Affects Versions: 3.0.0
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: HDFS-3689.000.patch, HDFS-3689.001.patch
>
>
> Currently HDFS supports fixed length blocks. Supporting variable length block will allow
new use cases and features to be built on top of HDFS. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message