Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CAO2XNQ8286EdvCrmK-XFQ2+Vc0bVbJzOgthHEU8+_YM-zc84wA@mail.gmail.com>
References: 
 <CAO2XNQ_T9eeMrjnjoutJy=dGZ78nxJs=wNyb9ZF22zrZE390NA@mail.gmail.com>
	<CAO2XNQ8286EdvCrmK-XFQ2+Vc0bVbJzOgthHEU8+_YM-zc84wA@mail.gmail.com>
Date: Wed, 20 Jan 2016 11:21:47 +0100
Message-ID: 
 <CAO2XNQ-6UzNvo0hQw_WRtYQpaNuZ8e=QYFdgtgC4cSTXoK14bg@mail.gmail.com>
Subject: Re: JobHistory location/configuration
From: Robert Schmidtke <ro.schmidtke@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e01228d1a85d8fe0529c15a51

--089e01228d1a85d8fe0529c15a51
Content-Type: text/plain; charset=UTF-8

Nvm, it would seem mapreduce.jobhistory.move.interval-ms specifies exactly
that.

On Wed, Jan 20, 2016 at 10:56 AM, Robert Schmidtke <ro.schmidtke@gmail.com>
wrote:

> Okay so I assumed I could specify paths on my local filesystem, which is
> not the case. After doing a hadoop fs -ls -R on my HDFS I found the done
> and done_intermediate folders. However only the intermediate folder
> contains files (even after the job finished). Is there any amount of time I
> have to wait before they're moved to the done directory? Thanks!
>
> Robert
>
> On Tue, Jan 19, 2016 at 4:21 PM, Robert Schmidtke <ro.schmidtke@gmail.com>
> wrote:
>
>> Hi everyone,
>>
>> I'm running Hadoop 2.7.1 and I'd like to be able to examine the details
>> of my jobs after they're finished. My setup does not permit me to view the
>> history server's UI, so I'm bound to the CLI (bin/hadoop job -history all
>> <dir>). I have configured:
>>
>> mapreduce.jobhistory.address,
>> mapreduce.jobhistory.webapp.address,
>> mapreduce.jobhistory.intermediate-done-dir, and
>> mapreduce.jobhistory.done-dir,
>>
>> but there are no history files to be found. Am I missing something here?
>> How can I get a hold of the files, or make MR produce them at all? Thanks a
>> bunch in advance!
>>
>> Robert
>>
>>
>>
>> --
>> My GPG Key ID: 336E2680
>>
>
>
>
> --
> My GPG Key ID: 336E2680
>


-- 
My GPG Key ID: 336E2680

--089e01228d1a85d8fe0529c15a51
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Nvm, it would seem=C2=A0mapreduce.jobhistory.move.interval=
-ms specifies exactly that.</div><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Wed, Jan 20, 2016 at 10:56 AM, Robert Schmidtke <span d=
ir=3D"ltr">&lt;<a href=3D"mailto:ro.schmidtke@gmail.com" target=3D"_blank">=
ro.schmidtke@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_=
quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1=
ex"><div dir=3D"ltr">Okay so I assumed I could specify paths on my local fi=
lesystem, which is not the case. After doing a hadoop fs -ls -R on my HDFS =
I found the done and done_intermediate folders. However only the intermedia=
te folder contains files (even after the job finished). Is there any amount=
 of time I have to wait before they&#39;re moved to the done directory? Tha=
nks!<span class=3D"HOEnZb"><font color=3D"#888888"><div><br></div><div>Robe=
rt</div></font></span></div><div class=3D"HOEnZb"><div class=3D"h5"><div cl=
ass=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Jan 19, 2016 at =
4:21 PM, Robert Schmidtke <span dir=3D"ltr">&lt;<a href=3D"mailto:ro.schmid=
tke@gmail.com" target=3D"_blank">ro.schmidtke@gmail.com</a>&gt;</span> wrot=
e:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-l=
eft:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi everyone,<div><br>=
</div><div>I&#39;m running Hadoop 2.7.1 and I&#39;d like to be able to exam=
ine the details of my jobs after they&#39;re finished. My setup does not pe=
rmit me to view the history server&#39;s UI, so I&#39;m bound to the CLI (b=
in/hadoop job -history all &lt;dir&gt;). I have configured:</div><div><br><=
/div><div><div>mapreduce.jobhistory.address,<br></div><div>mapreduce.jobhis=
tory.webapp.address,<br></div><div>mapreduce.jobhistory.intermediate-done-d=
ir, and<br></div><div>mapreduce.jobhistory.done-dir,</div><div><br></div><d=
iv>but there are no history files to be found. Am I missing something here?=
 How can I get a hold of the files, or make MR produce them at all? Thanks =
a bunch in advance!</div><span><font color=3D"#888888"><div><br></div><div>=
Robert</div><div><br></div><div><br></div><div><br></div>-- <br><div><div d=
ir=3D"ltr">My GPG Key ID: 336E2680<br></div></div>
</font></span></div></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div><div di=
r=3D"ltr">My GPG Key ID: 336E2680<br></div></div>
</div>
</div></div></blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>=
<div class=3D"gmail_signature"><div dir=3D"ltr">My GPG Key ID: 336E2680<br>=
</div></div>
</div>

--089e01228d1a85d8fe0529c15a51--