hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-3689) Add support for variable length block
Date Fri, 08 Aug 2014 22:46:13 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jing Zhao updated HDFS-3689:

    Attachment: HDFS-3689.000.patch

Upload a preliminary patch that addresses the above #3 and #4. Specifically a new append RPC
is added which always appends new data to a new block, and thus the previous last block becomes
a block with variable length. Some unit tests are added to make sure the appended file can
still be read/pread by the current DFSInputStream.

If this is a correct direction towards variable block length support, the remaining work can
# bug fix and code cleanup
# loose the restriction of concat
# add support in DFSOutputStream to let clients specify when to allocate a new block

> Add support for variable length block
> -------------------------------------
>                 Key: HDFS-3689
>                 URL: https://issues.apache.org/jira/browse/HDFS-3689
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode, hdfs-client, namenode
>    Affects Versions: 3.0.0
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: HDFS-3689.000.patch
> Currently HDFS supports fixed length blocks. Supporting variable length block will allow
new use cases and features to be built on top of HDFS. 

This message was sent by Atlassian JIRA

View raw message