hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhanwei Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6633) Support reading new data in a being written file until the file is closed
Date Wed, 09 Jul 2014 01:50:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055746#comment-14055746
] 

Zhanwei Wang commented on HDFS-6633:
------------------------------------

Hi Nicholas

Would you please point out the use case for this feature?

In my opinion, the file which is open for read can read the last appended data is good enough.
But letting the reader wait for the file close seems overkill.

If this feature is needed in some use case, is it better to enable this feature for a specific
file instead of a filesystem level configure parameter?




> Support reading new data in a being written file until the file is closed
> -------------------------------------------------------------------------
>
>                 Key: HDFS-6633
>                 URL: https://issues.apache.org/jira/browse/HDFS-6633
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h6633_20140707.patch, h6633_20140708.patch
>
>
> When a file is being written, the file length keeps increasing.  If the file is opened
for read, the reader first gets the file length and then read only up to that length.  The
reader will not be able to read the new data written afterward.
> We propose adding a new feature so that readers will be able to read all the data until
the writer closes the file.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message