hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3960) Snapshot of Being Written Files
Date Tue, 30 Oct 2012 17:28:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487033#comment-13487033
] 

Konstantin Shvachko commented on HDFS-3960:
-------------------------------------------

The document proposes to add new functionality as far as I understand. I just propose to add
a parameter to fsync(). Because sync can and should adjust file length, just like close. The
client is the only authority that knows the exact file length.
That way snapshots should rely on the length of a file held by the NameNode instead of obtaining
it from DataNodes.
I don't think files that were not hflush-ed should be excluded from snapshots as the document
proposes. Everything should be versioned.
                
> Snapshot of Being Written Files
> -------------------------------
>
>                 Key: HDFS-3960
>                 URL: https://issues.apache.org/jira/browse/HDFS-3960
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>
> Here is a design question: Suppose there is a being written file when a snapshot is being
taken.  What should the length of the file be shown in the snapshot?  In other words, how
to determine the length of being written file when a snapshot is being taken?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message