hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin Boudnik <...@yahoo-inc.com>
Subject Re: append operations
Date Wed, 07 Apr 2010 16:34:14 GMT
Check HDFS-265. Append has been implemeted in the trunk (i.e. 0.22) so you can
grab it, deploy, and start using it.

Cos

On Wed, Apr 07, 2010 at 06:24AM, Alan Miller wrote:
>    Hi,
> 
>     
> 
>    I'm just getting started with HDFS and I'm using the java API.
> 
>    What's the best way to synchronize files between my local and hdfs file
>    systems.
> 
>    I.e. if a 10G file only grows by 1G, I'd rather just append the 1G instead
>    or copying the full 11G.
> 
>     
> 
>    From my understanding append operations haven't been implemented in HDFS
>    yet.
> 
>    Is there  any news or the status on this?
> 
>     
> 
>    I was hoping to implement something  myself (using a FileInputStream and
> 
>    FSDataOutputStream) but  FSDataOutputStream is not seekable.
> 
>     
> 
>    Any suggestions?
> 
>     
> 
>    Regards,
> 
>    Alan

Mime
View raw message