hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6633) Support reading new data in a being written file until the file is closed
Date Wed, 09 Jul 2014 00:15:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055697#comment-14055697

Jonathan Hsieh commented on HDFS-6633:

Hm.. the 2nd patch seems to be missing the part with the new config variables -- in fact I
think it a patch for a different jira. 

Naively as a client, I would think tail mode would be specified by the client on a per file
open basis.  Is this patch's implementation and configuration setting server side (e.g. if
server has enable, all files read with tail mode), per hdfs client (e.g. all files opened
by the same hdfs client instance will open with tail mode enabled or not), or it is per file
(only the specified fileis opened in tail mode)?

> Support reading new data in a being written file until the file is closed
> -------------------------------------------------------------------------
>                 Key: HDFS-6633
>                 URL: https://issues.apache.org/jira/browse/HDFS-6633
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h6633_20140707.patch, h6643_20140708.patch
> When a file is being written, the file length keeps increasing.  If the file is opened
for read, the reader first gets the file length and then read only up to that length.  The
reader will not be able to read the new data written afterward.
> We propose adding a new feature so that readers will be able to read all the data until
the writer closes the file.

This message was sent by Atlassian JIRA

View raw message