hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3960) Snapshot of Being Written Files
Date Tue, 30 Oct 2012 06:20:14 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486679#comment-13486679
] 

Konstantin Shvachko commented on HDFS-3960:
-------------------------------------------

Would it be useful to pass file length from the client, when it calls namenode.fsync()?
That way NameNode will record the right length and will not need to obtain it from DNs.
I think fsync() should have exactly the same parameters as completeFile(). 
That is {{fsync(src, client, lastBlock)}}. We have only first two now.
I don't know why we haven't done this before.

It should be sufficient for snapshots to be up to date up to the last hflush(), right?

                
> Snapshot of Being Written Files
> -------------------------------
>
>                 Key: HDFS-3960
>                 URL: https://issues.apache.org/jira/browse/HDFS-3960
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>
> Here is a design question: Suppose there is a being written file when a snapshot is being
taken.  What should the length of the file be shown in the snapshot?  In other words, how
to determine the length of being written file when a snapshot is being taken?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message