hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"
Date Fri, 08 Jan 2010 00:30:54 GMT

    [ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797848#action_12797848

Hairong Kuang commented on HDFS-878:

For 1, as I commented on HDFS-879, I do not think HDFS-879 is a good idea.
For 2, it might be better to expose isUnderConstruction information through DFSOutputStream.
Currently listPath is a very memory expensive operation for a large directory. It might be
a good idea avoiding add a field to FileStatus.

> FileStatus should have a field "isUnderConstruction"
> ----------------------------------------------------
>                 Key: HDFS-878
>                 URL: https://issues.apache.org/jira/browse/HDFS-878
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
> Currently DFSClient has no way to know whether a file is under construction or not, unless
we open the file and get locatedBlocks (which is much more costly).
> However, the namenode knows whether each INode is under construction or not.
> We should expose that information from NameNode.getListing(), to DFSClient.listPaths(),
to DistributedFileSystem.listStatus().
> We should also expose that information through DFSInputStream and DFSDataInputStream
if not there yet.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message