hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Dunning" <tdunn...@veoh.com>
Subject RE: Using Map/Reduce without HDFS?
Date Wed, 29 Aug 2007 15:45:03 GMT

You can't append in hadoop, AFAIK.

The appending would be done outside of Hadoop with a periodic copy into HDFS.

I hear that append operations are coming soon.

-----Original Message-----
From: mfc [mailto:mikefconnell@verizon.net]
Sent: Mon 8/27/2007 6:48 PM
To: hadoop-user@lucene.apache.org
Subject: Re: Using Map/Reduce without HDFS?


Can you elaborate how this is done in Hadoop?


Ted Dunning-3 wrote:
> It is often also possible to merge the receiving of the new data with the
> appending to a large file.  The append nature of the writing makes this
> very
> mcuh more efficient than scanning a pile of old files.

View this message in context: http://www.nabble.com/Using-Map-Reduce-without-HDFS--tf4331338.html#a12360816
Sent from the Hadoop Users mailing list archive at Nabble.com.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message