Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of jagatsingh@gmail.com
 designates 209.85.220.171 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CANXCz3RbBHJmiLT3qHAAYSc=nUsf=VmqB4n8mOJi2X-_yrcG_g@mail.gmail.com>
References: 
 <CANXCz3RbBHJmiLT3qHAAYSc=nUsf=VmqB4n8mOJi2X-_yrcG_g@mail.gmail.com>
Date: Sat, 23 Aug 2014 15:49:56 +1000
Message-ID: 
 <CAJ-d8Xc=b-13q33zpJ_+Xe7n1qDVg2P5Ka2R+zWqJapu=h_JUQ@mail.gmail.com>
Subject: Re: Appending to HDFS file
From: Jagat Singh <jagatsingh@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a1133ce6e0bae8305014586fb

--001a1133ce6e0bae8305014586fb
Content-Type: text/plain; charset=UTF-8

What is value of dfs.support.append in hdfs-site.cml

https://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml


On Sat, Aug 23, 2014 at 1:41 AM, rab ra <rabmdu@gmail.com> wrote:

> Hello,
>
> I am currently using Hadoop 2.4.1.I am running a MR job using hadoop
> streaming utility.
>
> The executable needs to write large amount of information in a file.
> However, this write is not done in single attempt. The file needs to be
> appended with streams of information generated.
>
> In the code, inside a loop, I open a file in hdfs, appends some
> information. This is not working and I see only the last write.
>
> How do I accomplish append operation in hadoop? Can anyone share a pointer
> to me?
>
>
>
>
> regards
> Bala
>

--001a1133ce6e0bae8305014586fb
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">What is value of=C2=A0<span style=3D"color:rgb(68,68,68);f=
ont-family:Arial,&#39;Liberation Sans&#39;,&#39;DejaVu Sans&#39;,sans-serif=
;font-size:13px;line-height:17.280000686645508px;background-color:rgb(250,2=
50,250)">dfs.support.append in hdfs-site.cml</span><div>
<span style=3D"color:rgb(68,68,68);font-family:Arial,&#39;Liberation Sans&#=
39;,&#39;DejaVu Sans&#39;,sans-serif;font-size:13px;line-height:17.28000068=
6645508px;background-color:rgb(250,250,250)"><br></span></div><div><span st=
yle=3D"background-color:rgb(250,250,250)"><font color=3D"#444444" face=3D"A=
rial, Liberation Sans, DejaVu Sans, sans-serif"><span style=3D"line-height:=
17.280000686645508px"><a href=3D"https://hadoop.apache.org/docs/r2.3.0/hado=
op-project-dist/hadoop-hdfs/hdfs-default.xml">https://hadoop.apache.org/doc=
s/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml</a></span></font>=
<br>
</span></div><div><span style=3D"background-color:rgb(250,250,250)"><font c=
olor=3D"#444444" face=3D"Arial, Liberation Sans, DejaVu Sans, sans-serif"><=
span style=3D"line-height:17.280000686645508px"><br></span></font></span></=
div>
<div><span style=3D"background-color:rgb(250,250,250)"><font color=3D"#4444=
44" face=3D"Arial, Liberation Sans, DejaVu Sans, sans-serif"><span style=3D=
"line-height:17.280000686645508px"><br></span></font></span></div></div><di=
v class=3D"gmail_extra">
<br><br><div class=3D"gmail_quote">On Sat, Aug 23, 2014 at 1:41 AM, rab ra =
<span dir=3D"ltr">&lt;<a href=3D"mailto:rabmdu@gmail.com" target=3D"_blank"=
>rabmdu@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir=3D"ltr">Hello,<div><br></div><div>I am currently using Hadoop 2.4.=
1.I am running a MR job using hadoop streaming utility.=C2=A0</div><div><br=
></div><div>The executable needs to write large amount of information in a =
file. However, this write is not done in single attempt. The file needs to =
be appended with streams of information generated.=C2=A0</div>

<div><br></div><div>In the code, inside a loop, I open a file in hdfs, appe=
nds some information. This is not working and I see only the last write.=C2=
=A0</div><div><br></div><div>How do I accomplish append operation in hadoop=
? Can anyone share a pointer to me?</div>

<div><br></div><div><br></div><div><br></div><div><br></div><div>regards</d=
iv><div>Bala</div></div>
</blockquote></div><br></div>

--001a1133ce6e0bae8305014586fb--