hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jagat Singh <jagatsi...@gmail.com>
Subject Re: Appending to HDFS file
Date Sat, 23 Aug 2014 05:49:56 GMT
What is value of dfs.support.append in hdfs-site.cml

https://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml




On Sat, Aug 23, 2014 at 1:41 AM, rab ra <rabmdu@gmail.com> wrote:

> Hello,
>
> I am currently using Hadoop 2.4.1.I am running a MR job using hadoop
> streaming utility.
>
> The executable needs to write large amount of information in a file.
> However, this write is not done in single attempt. The file needs to be
> appended with streams of information generated.
>
> In the code, inside a loop, I open a file in hdfs, appends some
> information. This is not working and I see only the last write.
>
> How do I accomplish append operation in hadoop? Can anyone share a pointer
> to me?
>
>
>
>
> regards
> Bala
>

Mime
View raw message