hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-879) FileStatus should have the visible length of the file
Date Fri, 08 Jan 2010 00:24:54 GMT

    [ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797845#action_12797845

Hairong Kuang commented on HDFS-879:

I am not sure what's your definition of the latest file length. If you meant the visible length,
I do not think this is a good idea because many of the cases getFileStatus does not care about
the visible length if a file is under construction. If by default we force to fetch the visible
length, it is going to double the overhead of the cost of getFileStatus for a file under construction.
With the append design, we on purpose define the getFileStatus semantics to be there is no
guarantee on the length of an  file under construction.

> FileStatus should have the visible length of the file
> -----------------------------------------------------
>                 Key: HDFS-879
>                 URL: https://issues.apache.org/jira/browse/HDFS-879
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
> Currently, {{FileStatus}} returned by {{DistributedFileSystem.listStatus()}} (which goes
through {{DFSClient.listPath()}} then {{NameNode.getListing()}}) does not have the latest
file length, if the file is still open for write.
> We should make changes in {{DFSClient.listPath()}} to override the length of the file,
if the file is under construction.
> This depends on adding a {{isUnderConstruction}} field in {{FileStatus}}.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message