hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alan Miller <Alan.Mil...@synopsys.com>
Subject append operations
Date Wed, 07 Apr 2010 13:24:56 GMT

I'm just getting started with HDFS and I'm using the java API.
What's the best way to synchronize files between my local and hdfs file systems.
I.e. if a 10G file only grows by 1G, I'd rather just append the 1G instead or copying the
full 11G.

>From my understanding append operations haven't been implemented in HDFS yet.
Is there  any news or the status on this?

I was hoping to implement something  myself (using a FileInputStream and
FSDataOutputStream) but  FSDataOutputStream is not seekable.

Any suggestions?


View raw message