hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-860) fuse-dfs truncate behavior causes issues with scp
Date Wed, 16 May 2012 23:15:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277249#comment-13277249

Colin Patrick McCabe commented on HDFS-860:

bq. ...the size of the file in the namenode isn't updated until close() is called, right?
[Actually, now that I say that out loud, I now suppose we can take advantage of the single-thread-writer
rule and just track the number of bytes in the client? That seems doable upon 30 seconds of
reflection at 10PM...]

Is there a JIRA for this?  A lot of applications might be calling fstat on the file descriptor
that they have open (and are writing to), and giving them the wrong size is... unfortunate.
> fuse-dfs truncate behavior causes issues with scp
> -------------------------------------------------
>                 Key: HDFS-860
>                 URL: https://issues.apache.org/jira/browse/HDFS-860
>             Project: Hadoop HDFS
>          Issue Type: Wish
>          Components: contrib/fuse-dfs
>            Reporter: Brian Bockelman
>            Assignee: Brian Bockelman
>            Priority: Minor
>             Fix For: 2.0.0
>         Attachments: HDFS-860.patch, hdfs-860.txt
> For whatever reason, scp issues a "truncate" once it's written a file to truncate the
file to the # of bytes it has written (i.e., if a file is X bytes, it calls truncate(X)).
> This fails on the current fuse-dfs.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message