Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8A92310A50 for ; Tue, 4 Mar 2014 00:30:17 +0000 (UTC) Received: (qmail 49533 invoked by uid 500); 4 Mar 2014 00:30:08 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 49248 invoked by uid 500); 4 Mar 2014 00:30:08 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 49237 invoked by uid 99); 4 Mar 2014 00:30:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Mar 2014 00:30:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sfhadoop@gmail.com designates 74.125.82.46 as permitted sender) Received: from [74.125.82.46] (HELO mail-wg0-f46.google.com) (74.125.82.46) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Mar 2014 00:30:03 +0000 Received: by mail-wg0-f46.google.com with SMTP id z12so4168231wgg.29 for ; Mon, 03 Mar 2014 16:29:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=rzeK1o/GQvMxcg29ggXqAOBXkyyL5wQ/07584vPJ0Sw=; b=UYVHW1uQKNl/pd/DpnnZ0xGAmojc+n5+eNGiE5Q/ox2SJsPyPC2D/KbpEIWZKPsVHP 1r+KFGQtkD/QN0+6PW4kqCYQFMAL91M+JfcyBnTxdYtls98av0O9JDTXpUK+m6vIlDSg Q+e+Qd7jgGuqMeUdU7jo7akt9Sl2syQ04rNI2mLjMtOoMVpje4psLGXG9TUrLK80d+Dy lKAGQMlKQ6KtCJv0VfQ9xUrsPjG3IaZmoCwJwT4ljzD66oVG3AcitoNa71RDZpPxKaik H5nNLMn4KKc+07qUbDYNSLE0pDjfyyK155FVVsHxsmUjTEtVR+9wOWDesg0wbvxophrh Xfkg== MIME-Version: 1.0 X-Received: by 10.194.87.104 with SMTP id w8mr9042712wjz.90.1393892982194; Mon, 03 Mar 2014 16:29:42 -0800 (PST) Received: by 10.194.171.166 with HTTP; Mon, 3 Mar 2014 16:29:42 -0800 (PST) In-Reply-To: References: Date: Mon, 3 Mar 2014 16:29:42 -0800 Message-ID: Subject: Re: Not information in Job History UI From: SF Hadoop To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bf10a780f072e04f3bd00be X-Virus-Checked: Checked by ClamAV on apache.org --047d7bf10a780f072e04f3bd00be Content-Type: text/plain; charset=ISO-8859-1 Thanks for that info Jian. You said, "there are no job logs generated on the server that is running the job.". So am I correct in assuming the logs will be in the dir specified by yarn.nodemanager.log-dirs on the datanodes? I am quite confused as to where the logs for each specific part of the ecosystem reside. If I were to run a job and I wanted to tail the job log as it was running, where would I find that log? Thanks for your help. On Mon, Mar 3, 2014 at 11:46 AM, Jian He wrote: > Note that node manager will not keep the finished applications and only > show running apps, so the UI won't show the finished apps. > Conversely, job history server UI will only show the finished apps but > not the running apps. > > bq. there are no job logs generated on the server that is running the job. > by default, the local logs will be deleted after job finished. you can > config yarn.nodemanager.delete.debug-delay-sec, to delay the deletion of > the logs. > > Jian > > > On Mon, Mar 3, 2014 at 10:45 AM, SF Hadoop wrote: > >> Hadoop 2.2.0 >> CentOS 6.4 >> Viewing UI in various browsers. >> >> I am having a problem where no information is visible in my Job History >> UI. I run test jobs, they complete without error, but no information ever >> populates the nodemanager or jobhistory server UI. >> >> Also, there are no job logs generated on the server that is running the >> job. >> >> I have the following settings configured: >> yarn.nodemanager.local-dirs >> yarn.nodemanager.log-dirs >> yarn.log.server.url >> >> ...plus the basic yarn log dir. I get output in regards to the daemons >> but very little in regards to the job. All I get that refers to the >> jobhistory server is the following (so it appears to be functioning >> properly): >> >> 2014-02-18 11:43:06,824 INFO org.apache.hadoop.http.HttpServer: Jetty >> bound to port 19888 >> 2014-02-18 11:43:06,824 INFO org.mortbay.log: jetty-6.1.26 >> 2014-02-18 11:43:06,847 INFO org.mortbay.log: Extract >> jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.1.0.2.0.5.0-67.jar!/webapps/jobhistory >> to /tmp/Jetty_server_19888_jobhistory____v7gnnv/webapp >> 2014-02-18 11:43:07,085 INFO org.mortbay.log: Started >> SelectChannelConnector@server:19888 >> 2014-02-18 11:43:07,085 INFO org.apache.hadoop.yarn.webapp.WebApps: Web >> app /jobhistory started at 19888 >> 2014-02-18 11:43:07,477 INFO org.apache.hadoop.yarn.webapp.WebApps: >> Registered webapp guice modules >> >> I have a feeling this is a misconfiguration but I cannot figure out what >> setting is missing or wrong. >> >> Other than not being able to see any of the jobs in the UIs, everything >> appears to be working correctly so this is quite confusing. >> >> Any help is appreciated. >> > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. --047d7bf10a780f072e04f3bd00be Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks for that info Jian.

You said, &q= uot;there are n= o job logs generated on the server that is running the job.". =A0So am= I correct in assuming the logs will be in the dir specified by=A0ya= rn.nodemanager.log-dirs on the datanodes?

I a= m quite confused as to where the logs for each specific part of the ecosyst= em reside.

If = I were to run a job and I wanted to tail the job log as it was running, whe= re would I find that log?

Tha= nks for your help.=A0


=
On Mon, Mar 3, 2014 at 11:46 AM, Jian He <jhe@hortonworks.com> wrote:
Note that=A0node manager = will not keep the finished applications and only show running apps, =A0so t= he UI won't show the finished apps.
=A0Conversely, job history server UI wi= ll only show the finished apps but not the running apps.

bq.=A0there are no job logs generated on the server that is running the j= ob.
by default, the local logs will be de= leted after job finished. =A0you can config=A0yarn.nodemanager.delet= e.debug-delay-sec, to delay the deletion of the logs.=A0

Jian


<= div class=3D"gmail_quote">On Mon, Mar 3, 2014 at 10:45 AM, SF Hadoop <sfh= adoop@gmail.com> wrote:
Hadoop 2.2.0
=
CentOS 6.4
Viewing UI in various browsers.
<= div>
I am having a problem where no information is visible in my = Job History UI. =A0I run test jobs, they complete without error, but no inf= ormation ever populates the nodemanager or jobhistory server UI.

Also, there are no job logs generated on the server tha= t is running the job.

I have the following setting= s configured:
yarn.nodemanager.local-dirs
yarn.nodemanager.log-dirs
yarn.log.server.url

...plus the basic yarn log dir. =A0I get output = in regards to the daemons but very little in regards to the job. =A0All I g= et that refers to the jobhistory server is the following (so it appears to = be functioning properly):

2014-02-18 11:43:06,824 INFO org.apache.hadoop.htt= p.HttpServer: Jetty bound to port 19888
2014-02-18 11:43:06,824 I= NFO org.mortbay.log: jetty-6.1.26
2014-02-18 11:43:06,847 INFO or= g.mortbay.log: Extract jar:file:/usr/lib/hadoop-yarn/hadoop-yarn-common-2.1= .0.2.0.5.0-67.jar!/webapps/jobhistory to /tmp/Jetty_server_19888_jobhistory= ____v7gnnv/webapp
2014-02-18 11:43:07,085 INFO org.mortbay.log: Started SelectChannelCon= nector@server:19888
2014-02-18 11:43:07,085 INFO org.apache.hadoo= p.yarn.webapp.WebApps: Web app /jobhistory started at 19888
2014-02-18 11:43:07,477 INFO org.apache.hadoop.yarn.webapp.WebApps: Registe= red webapp guice modules

I have a feeling this is a misconfiguration but I= cannot figure out what setting is missing or wrong.

Other than not being able to see any of the jobs in the UIs, everything = appears to be working correctly so this is quite confusing.

Any help is appreciated.


CONFIDENTIALITY NOTICE
NOTICE: This= message is intended for the use of the individual or entity to which it is= addressed and may contain information that is confidential, privileged and= exempt from disclosure under applicable law. If the reader of this message= is not the intended recipient, you are hereby notified that any printing, = copying, dissemination, distribution, disclosure or forwarding of this comm= unication is strictly prohibited. If you have received this communication i= n error, please contact the sender immediately and delete it from your syst= em. Thank You.
--047d7bf10a780f072e04f3bd00be--