hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: [DISCUSS] Allow continue reading from being-written file using same stream
Date Fri, 19 Sep 2014 19:32:44 GMT
On Thu, Sep 18, 2014 at 12:48 AM, Vinayakumar B <vinayakumarb@apache.org>

> Hi all,
> Currently *DFSInputStream *doen't allow reading a write-inprogress file,
> once all written bytes, by the time of opening an input stream, are read.
> To read further update on the same file, needs to be read by opening
> another stream to the same file again.
> Instead how about refreshing length of such open files if the current
> position is at earlier EOF.

Are you talking tailing an HDFS file without having to fake it with a loop
that does open, read till EOF, close, repeat?  If so, sounds great.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message