hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-89) files are not visible until they are closed
Date Fri, 10 Aug 2007 00:31:42 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-89?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518884
] 

dhruba borthakur commented on HADOOP-89:
----------------------------------------

This patch does not change APIs and disk formats. The idea is that files that are created
by clients appear immediately in the namespace. Other clients can see the file and get its
attributes. This is a big change in semantics and I would rather do this in the beginning
of a release than towards the end of the release cycle. This is a step in implementing full-fledged
"appends" for HDFS files (HADOOP-1700).

Regarding "removing pending creates" structures, I agree that they should move into a new
kind of inode. I can do it after you introduce the concept of class-hierarchy of inodes (HADOOP-1687).

Please let me know if the above sounds good to you and makes you agree that this patch is
commit-able.




> files are not visible until they are closed
> -------------------------------------------
>
>                 Key: HADOOP-89
>                 URL: https://issues.apache.org/jira/browse/HADOOP-89
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.1.0
>            Reporter: Yoram Arnon
>            Assignee: dhruba borthakur
>            Priority: Critical
>         Attachments: atomicCreation.patch
>
>
> the current behaviour, whereby a file is not visible until it is closed has several flaws,including:
> 1. no practical way to know if a file/job is progressing
> 2. no way to implement files that never close, such as log files
> 3. failure to close a file results in loss of the file
> The part of the file that's written should be visible.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message