hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-609) Create a file with the append flag does not work in HDFS
Date Tue, 22 Jun 2010 18:35:57 GMT

    [ https://issues.apache.org/jira/browse/HDFS-609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881288#action_12881288
] 

Tom White commented on HDFS-609:
--------------------------------

Konstantin, This was one of those situations where the changes for this JIRA had to be applied
at the same time as its parent HADOOP-5438, so wasn't possible to have Hudson check this patch
either before or after HADOOP-5438 was committed, so I did it manually. You're right about
the tests. I should have mentioned that I did run tests at the time I posted the patch - I'm
re-running them now to be sure I didn't miss anything. 

> Create a file with the append flag does not work in HDFS
> --------------------------------------------------------
>
>                 Key: HDFS-609
>                 URL: https://issues.apache.org/jira/browse/HDFS-609
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.21.0, 0.22.0
>            Reporter: Hairong Kuang
>            Assignee: Tom White
>            Priority: Blocker
>             Fix For: 0.21.0
>
>         Attachments: HDFS-609.patch
>
>
> HADOOP-5438 introduced a create API with flags. There are a couple of issues when the
flag is set to be APPEND.
> 1. The APPEND flag does not work in HDFS. Append is not as simple as changing a FileINode
to be a FileINodeUnderConstruction. It also need to reopen the last block for applend if last
block is not full and handle crc when the last crc chunk is not full.
> 2. The API is not well thought. It has parameters like replication factor and blockSize.
Those parameters do not make any sense if APPEND flag is set. But they give an application
user a wrong impression that append could change a file's block size and replication factor.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message