Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of rabmdu@gmail.com designates
 209.85.220.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAJ-d8Xc=b-13q33zpJ_+Xe7n1qDVg2P5Ka2R+zWqJapu=h_JUQ@mail.gmail.com>
References: 
 <CANXCz3RbBHJmiLT3qHAAYSc=nUsf=VmqB4n8mOJi2X-_yrcG_g@mail.gmail.com>
	<CAJ-d8Xc=b-13q33zpJ_+Xe7n1qDVg2P5Ka2R+zWqJapu=h_JUQ@mail.gmail.com>
Date: Sat, 23 Aug 2014 12:17:01 +0530
Message-ID: 
 <CANXCz3TuOHOLWrHMQ4BR8AkuQP1oPsm8QX4jmKy5XT-MLjuZVg@mail.gmail.com>
Subject: Re: Appending to HDFS file
From: rab ra <rabmdu@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b34313c2b5c7f050146528d

--047d7b34313c2b5c7f050146528d
Content-Type: text/plain; charset=UTF-8

Hi

By default, it is true in hadoop 2.4.1. Nevertheless, I have set it to true
explicitly in hdfs-site.xml. Still, I am not able to achieve append.

Regards
On 23 Aug 2014 11:20, "Jagat Singh" <jagatsingh@gmail.com> wrote:

> What is value of dfs.support.append in hdfs-site.cml
>
>
> https://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
>
>
>
>
> On Sat, Aug 23, 2014 at 1:41 AM, rab ra <rabmdu@gmail.com> wrote:
>
>> Hello,
>>
>> I am currently using Hadoop 2.4.1.I am running a MR job using hadoop
>> streaming utility.
>>
>> The executable needs to write large amount of information in a file.
>> However, this write is not done in single attempt. The file needs to be
>> appended with streams of information generated.
>>
>> In the code, inside a loop, I open a file in hdfs, appends some
>> information. This is not working and I see only the last write.
>>
>> How do I accomplish append operation in hadoop? Can anyone share a
>> pointer to me?
>>
>>
>>
>>
>> regards
>> Bala
>>
>
>

--047d7b34313c2b5c7f050146528d
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p>Hi</p>
<p>By default, it is true in hadoop 2.4.1. Nevertheless, I have set it to t=
rue explicitly in hdfs-site.xml. Still, I am not able to achieve append.</p=
>
<p>Regards</p>
<div class=3D"gmail_quote">On 23 Aug 2014 11:20, &quot;Jagat Singh&quot; &l=
t;<a href=3D"mailto:jagatsingh@gmail.com">jagatsingh@gmail.com</a>&gt; wrot=
e:<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=3D"margi=
n:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir=3D"ltr">What is value of=C2=A0<span style=3D"color:rgb(68,68,68);f=
ont-family:Arial,&#39;Liberation Sans&#39;,&#39;DejaVu Sans&#39;,sans-serif=
;font-size:13px;line-height:17.280000686645508px;background-color:rgb(250,2=
50,250)">dfs.support.append in hdfs-site.cml</span><div>

<span style=3D"color:rgb(68,68,68);font-family:Arial,&#39;Liberation Sans&#=
39;,&#39;DejaVu Sans&#39;,sans-serif;font-size:13px;line-height:17.28000068=
6645508px;background-color:rgb(250,250,250)"><br></span></div><div><span st=
yle=3D"background-color:rgb(250,250,250)"><font color=3D"#444444" face=3D"A=
rial, Liberation Sans, DejaVu Sans, sans-serif"><span style=3D"line-height:=
17.280000686645508px"><a href=3D"https://hadoop.apache.org/docs/r2.3.0/hado=
op-project-dist/hadoop-hdfs/hdfs-default.xml" target=3D"_blank">https://had=
oop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml=
</a></span></font><br>

</span></div><div><span style=3D"background-color:rgb(250,250,250)"><font c=
olor=3D"#444444" face=3D"Arial, Liberation Sans, DejaVu Sans, sans-serif"><=
span style=3D"line-height:17.280000686645508px"><br></span></font></span></=
div>

<div><span style=3D"background-color:rgb(250,250,250)"><font color=3D"#4444=
44" face=3D"Arial, Liberation Sans, DejaVu Sans, sans-serif"><span style=3D=
"line-height:17.280000686645508px"><br></span></font></span></div></div><di=
v class=3D"gmail_extra">

<br><br><div class=3D"gmail_quote">On Sat, Aug 23, 2014 at 1:41 AM, rab ra =
<span dir=3D"ltr">&lt;<a href=3D"mailto:rabmdu@gmail.com" target=3D"_blank"=
>rabmdu@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir=3D"ltr">Hello,<div><br></div><div>I am currently using Hadoop 2.4.=
1.I am running a MR job using hadoop streaming utility.=C2=A0</div><div><br=
></div><div>The executable needs to write large amount of information in a =
file. However, this write is not done in single attempt. The file needs to =
be appended with streams of information generated.=C2=A0</div>


<div><br></div><div>In the code, inside a loop, I open a file in hdfs, appe=
nds some information. This is not working and I see only the last write.=C2=
=A0</div><div><br></div><div>How do I accomplish append operation in hadoop=
? Can anyone share a pointer to me?</div>


<div><br></div><div><br></div><div><br></div><div><br></div><div>regards</d=
iv><div>Bala</div></div>
</blockquote></div><br></div>
</blockquote></div>

--047d7b34313c2b5c7f050146528d--