Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CAO2XNQ_T9eeMrjnjoutJy=dGZ78nxJs=wNyb9ZF22zrZE390NA@mail.gmail.com>
References: 
 <CAO2XNQ_T9eeMrjnjoutJy=dGZ78nxJs=wNyb9ZF22zrZE390NA@mail.gmail.com>
Date: Wed, 20 Jan 2016 10:56:03 +0100
Message-ID: 
 <CAO2XNQ8286EdvCrmK-XFQ2+Vc0bVbJzOgthHEU8+_YM-zc84wA@mail.gmail.com>
Subject: Re: JobHistory location/configuration
From: Robert Schmidtke <ro.schmidtke@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11401e42765a190529c0fe44

--001a11401e42765a190529c0fe44
Content-Type: text/plain; charset=UTF-8

Okay so I assumed I could specify paths on my local filesystem, which is
not the case. After doing a hadoop fs -ls -R on my HDFS I found the done
and done_intermediate folders. However only the intermediate folder
contains files (even after the job finished). Is there any amount of time I
have to wait before they're moved to the done directory? Thanks!

Robert

On Tue, Jan 19, 2016 at 4:21 PM, Robert Schmidtke <ro.schmidtke@gmail.com>
wrote:

> Hi everyone,
>
> I'm running Hadoop 2.7.1 and I'd like to be able to examine the details of
> my jobs after they're finished. My setup does not permit me to view the
> history server's UI, so I'm bound to the CLI (bin/hadoop job -history all
> <dir>). I have configured:
>
> mapreduce.jobhistory.address,
> mapreduce.jobhistory.webapp.address,
> mapreduce.jobhistory.intermediate-done-dir, and
> mapreduce.jobhistory.done-dir,
>
> but there are no history files to be found. Am I missing something here?
> How can I get a hold of the files, or make MR produce them at all? Thanks a
> bunch in advance!
>
> Robert
>
>
>
> --
> My GPG Key ID: 336E2680
>


-- 
My GPG Key ID: 336E2680

--001a11401e42765a190529c0fe44
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Okay so I assumed I could specify paths on my local filesy=
stem, which is not the case. After doing a hadoop fs -ls -R on my HDFS I fo=
und the done and done_intermediate folders. However only the intermediate f=
older contains files (even after the job finished). Is there any amount of =
time I have to wait before they&#39;re moved to the done directory? Thanks!=
<div><br></div><div>Robert</div></div><div class=3D"gmail_extra"><br><div c=
lass=3D"gmail_quote">On Tue, Jan 19, 2016 at 4:21 PM, Robert Schmidtke <spa=
n dir=3D"ltr">&lt;<a href=3D"mailto:ro.schmidtke@gmail.com" target=3D"_blan=
k">ro.schmidtke@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gma=
il_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-lef=
t:1ex"><div dir=3D"ltr">Hi everyone,<div><br></div><div>I&#39;m running Had=
oop 2.7.1 and I&#39;d like to be able to examine the details of my jobs aft=
er they&#39;re finished. My setup does not permit me to view the history se=
rver&#39;s UI, so I&#39;m bound to the CLI (bin/hadoop job -history all &lt=
;dir&gt;). I have configured:</div><div><br></div><div><div>mapreduce.jobhi=
story.address,<br></div><div>mapreduce.jobhistory.webapp.address,<br></div>=
<div>mapreduce.jobhistory.intermediate-done-dir, and<br></div><div>mapreduc=
e.jobhistory.done-dir,</div><div><br></div><div>but there are no history fi=
les to be found. Am I missing something here? How can I get a hold of the f=
iles, or make MR produce them at all? Thanks a bunch in advance!</div><span=
 class=3D"HOEnZb"><font color=3D"#888888"><div><br></div><div>Robert</div><=
div><br></div><div><br></div><div><br></div>-- <br><div><div dir=3D"ltr">My=
 GPG Key ID: 336E2680<br></div></div>
</font></span></div></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class=
=3D"gmail_signature"><div dir=3D"ltr">My GPG Key ID: 336E2680<br></div></di=
v>
</div>

--001a11401e42765a190529c0fe44--