Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2D8E010859 for ; Sun, 5 Jan 2014 21:25:11 +0000 (UTC) Received: (qmail 58455 invoked by uid 500); 5 Jan 2014 21:25:06 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 58282 invoked by uid 500); 5 Jan 2014 21:25:06 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 58275 invoked by uid 99); 5 Jan 2014 21:25:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Jan 2014 21:25:06 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of john.lilley@redpoint.net designates 206.225.164.233 as permitted sender) Received: from [206.225.164.233] (HELO hub021-nj-8.exch021.serverdata.net) (206.225.164.233) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Jan 2014 21:24:59 +0000 Received: from MBX021-E3-NJ-2.exch021.domain.local ([10.240.4.78]) by HUB021-NJ-8.exch021.domain.local ([10.240.4.117]) with mapi id 14.03.0158.001; Sun, 5 Jan 2014 13:24:38 -0800 From: John Lilley To: "user@hadoop.apache.org" Subject: RE: YARN log access Thread-Topic: YARN log access Thread-Index: Ac8Io9JAd+l3Xd3WR4yZQrb7N5o25QATIsyAAB/726AAEfAgAAApGaVw Date: Sun, 5 Jan 2014 21:24:37 +0000 Message-ID: <869970D71E26D7498BDAC4E1CA92226B86E06BAA@MBX021-E3-NJ-2.exch021.domain.local> References: <869970D71E26D7498BDAC4E1CA92226B86E04BB1@MBX021-E3-NJ-2.exch021.domain.local> <869970D71E26D7498BDAC4E1CA92226B86E05D08@MBX021-E3-NJ-2.exch021.domain.local> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [173.160.43.60] Content-Type: multipart/alternative; boundary="_000_869970D71E26D7498BDAC4E1CA92226B86E06BAAMBX021E3NJ2exch_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_869970D71E26D7498BDAC4E1CA92226B86E06BAAMBX021E3NJ2exch_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Thanks, I missed the target 2.4.0 release. For 2.2.0, is there any way to = reach the individual task container logs? John From: Ted Yu [mailto:yuzhihong@gmail.com] Sent: Saturday, January 04, 2014 10:47 AM To: common-user@hadoop.apache.org Subject: Re: YARN log access YARN-649 is targeted at 2.4.0 release and YARN-1524 is Open. >From the link you posted, I see: amContainerLogs The URL of the application master container logs On Sat, Jan 4, 2014 at 9:18 AM, John Lilley > wrote: Ted, Thanks for the pointer. But when I read about the RESTful API: http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceM= anagerRest.html#Cluster_Application_API I only see a method to query the AM logs, not the task container logs. How= does one get from AppID to the list of task container logs? Thanks john From: Ted Yu [mailto:yuzhihong@gmail.com] See: https://issues.apache.org/jira/browse/YARN-649 https://issues.apache.org/jira/browse/YARN-1524 On Fri, Jan 3, 2014 at 8:50 AM, John Lilley > wrote: Is there a programmatic or HTTP interface for querying the logs of a YARN a= pplication run? Ideally I would start with the AppID, query the AppMaster = log, and then descend into the task logs. --_000_869970D71E26D7498BDAC4E1CA92226B86E06BAAMBX021E3NJ2exch_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Thanks, I missed the targ= et 2.4.0 release.  For 2.2.0, is there any way to reach the individual= task container logs?

John

 <= /p>

From: Ted Yu [= mailto:yuzhihong@gmail.com]
Sent: Saturday, January 04, 2014 10:47 AM
To: common-user@hadoop.apache.org
Subject: Re: YARN log access

 

YARN-649 is targeted at 2.4.0 release and YARN-= 1524 is Open.

 

From the link you posted, I see:

amConta= inerLogs   Th= e URL of the application master container logs

 

On Sat, Jan 4, 2014 at 9:18 AM, John Lilley <john.lilley@redpo= int.net> wrote:

Ted,
Thanks for the pointer.  But when I read about the RESTful API:
http:= //hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManage= rRest.html#Cluster_Application_API
I only see a method to query the AM logs, not the task container logs. &nbs= p;How does one get from AppID to the list of task container logs?
Thanks
john


From: Ted Yu [mailto:yuzhihong@gmail= .com]

See:
https://issues.apache.org/jira/browse/YARN-649
https://issues.apache.org/jira/browse/YARN-1524

On Fri, Jan 3, 2014 at 8:50 AM, John Lilley <john.lilley@redpoint.net> wrote:
Is there a programmatic or HTTP interface for querying the logs of a YARN a= pplication run?  Ideally I would start with the AppID, query the AppMa= ster log, and then descend into the task logs.
 
 

 

--_000_869970D71E26D7498BDAC4E1CA92226B86E06BAAMBX021E3NJ2exch_--