hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-931) Make writes to S3FileSystem world visible only on completion
Date Thu, 25 Jan 2007 19:45:49 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12467511
] 

Doug Cutting commented on HADOOP-931:
-------------------------------------

Hmm.  Seeing partial files could be considered a feature.  LocalFileSystem also makes partial
files visitible, no?  Is this breaking something?  If not, I'd leave things as-is.

> Make writes to S3FileSystem world visible only on completion
> ------------------------------------------------------------
>
>                 Key: HADOOP-931
>                 URL: https://issues.apache.org/jira/browse/HADOOP-931
>             Project: Hadoop
>          Issue Type: Bug
>          Components: fs
>            Reporter: Tom White
>
> Currently files written to S3 are visible to other processes as soon as the first block
has been written. This is different to DFS which only makes files world visible after the
stream writing to the file has closed (see FSNamesystem.completeFile).
> We could implement this by having a piece of inode metadata that indicates the visibility
of the file.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message