hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ltomuno <ltom...@163.com>
Subject Re:Re: a file can be used as a queue?
Date Mon, 13 Jun 2011 14:33:24 GMT
Thank you very much
I see




At 2011-06-13 19:23:59,"Joey Echeverria" <joey@cloudera.com> wrote:

>This feature doesn't currently work. I don't remember the JIRA for it, but there's a ticket
which will allow a reader to read from an HDFS file before it's closed. In that case, you
implement a queue by having the producer write to the end of the file and the reader read
from the beginning of the file.
>
>I'm not sure if there will be a way to tell that a file is still being written, so you
may need your own end of stream marker.
>
>-Joey
>
>On Jun 13, 2011, at 2:55, ltomuno <ltomuno@163.com> wrote:
>
>> I heard a HDFS file as a producer - consumer queue, a file can be used as a queue?
I am very confused
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message