Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 33028186E1 for ; Thu, 10 Mar 2016 06:28:07 +0000 (UTC) Received: (qmail 13098 invoked by uid 500); 10 Mar 2016 06:28:03 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 13010 invoked by uid 500); 10 Mar 2016 06:28:03 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 12999 invoked by uid 99); 10 Mar 2016 06:28:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2016 06:28:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 59DA61806E1 for ; Thu, 10 Mar 2016 06:28:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.804 X-Spam-Level: ** X-Spam-Status: No, score=2.804 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HK_RANDOM_ENVFROM=0.626, HK_RANDOM_FROM=0.999, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id xn6BATSs5j43 for ; Thu, 10 Mar 2016 06:28:00 +0000 (UTC) Received: from mail-lb0-f179.google.com (mail-lb0-f179.google.com [209.85.217.179]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 1B2825FAD8 for ; Thu, 10 Mar 2016 06:28:00 +0000 (UTC) Received: by mail-lb0-f179.google.com with SMTP id xr8so94529394lbb.1 for ; Wed, 09 Mar 2016 22:27:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=H3U8cjHYiiPwx0Gr5YL+K0JODcntcDvm+eRmJFm++gE=; b=TrecITtOuigkuR08pSOn/nZ6UyMNsSJ4fsjLC3xU1yXGRoeXUf7wkqHn7ly9TWPUro 9jAIqGIyQvjtX4IWvvZFwgCiI2mnF0BsJLR6VvtcjRzF9/bFpdqKuH9wX9yA4Z3ZFJ8K vJ0tLkxBcr1rjACrY5O6m2ofS5ljdcv4+TkNtIscEA40OE3dXi6YPUq/MIZBCSNA2KIv er+lzmskB+5MynRTRJ4XC+GS38H6VelPK7IywJ9QQ+hdn7EAbO6wrIeT3bGKhAEORCkr h3usMmcLBJs2aiP7Ssl2ltk4CuOpc8mvQt4PNkJzOPj7TMFAXLwuVrareBnTX0bB+cEk +oKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=H3U8cjHYiiPwx0Gr5YL+K0JODcntcDvm+eRmJFm++gE=; b=Q95NhFHbku/WauMdmCMLlA3ZCgDqRZujGaqZDiZLvIWtoADFdg4CY1CbVzOa2dhSYm UWryYzhSBYvru6XcxvGyHsQ16+wUCOTvt+Ywd0bT++qyT8Fc93RArO+uv/GiC8t65RsT m56MBHQyb7ou72X2TkLch17SgPF7Xjk94qucOCTP029k1Jc2psXctiyjQBUKwuqun+Qx Z4rCw9YFaIi/GfrTvcEikituKPCQnQaj89fodFdt/fvf4bvF4/kSUhHpYMR2wEYv4itg OqozwiKmx6eJws45GLmt5vBWONxMlVnO2h7IDElV1ehafNgSolxRz2/jugRoFECaeyEF BOHw== X-Gm-Message-State: AD7BkJKsUq9UKcENeBQBj/rfCgB6t+hvae6MsWK/ovgPpzQFFCfKsyKE7oOtgWvLc5h+YtNV0hey59OWbm0gjw== MIME-Version: 1.0 X-Received: by 10.112.119.144 with SMTP id ku16mr570321lbb.6.1457591278702; Wed, 09 Mar 2016 22:27:58 -0800 (PST) Received: by 10.25.141.198 with HTTP; Wed, 9 Mar 2016 22:27:58 -0800 (PST) In-Reply-To: <1EFFC0EDF85B044A99A02C925FDA3755200DE139@HQITEXCH07.pclc0.merkle.local> References: <1EFFC0EDF85B044A99A02C925FDA3755200DE06B@HQITEXCH07.pclc0.merkle.local> <1EFFC0EDF85B044A99A02C925FDA3755200DE139@HQITEXCH07.pclc0.merkle.local> Date: Thu, 10 Mar 2016 14:27:58 +0800 Message-ID: Subject: Re: how to use Yarn API to find task/attempt status From: Jeff Zhang To: Frank Luo Cc: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=047d7bb0434e65189a052dabea14 --047d7bb0434e65189a052dabea14 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable If it is for M/R, then maybe this is what you want https://hadoop.apache.org/docs/r2.6.0/api/org/apache/hadoop/mapreduce/JobSt= atus.html On Thu, Mar 10, 2016 at 1:58 PM, Frank Luo wrote: > Let=E2=80=99s say there are 10 standard M/R jobs running. How to find how= many > tasks are done/running/pending? > > > > *From:* Jeff Zhang [mailto:zjffdu@gmail.com] > *Sent:* Wednesday, March 09, 2016 9:33 PM > *To:* Frank Luo > *Cc:* user@hadoop.apache.org > *Subject:* Re: how to use Yarn API to find task/attempt status > > > > I don't think it is related with yarn. Yarn don't know about task/task > attempt, it only knows containers. So it should be your application to > provide such function. > > > > On Thu, Mar 10, 2016 at 11:29 AM, Frank Luo wrote: > > Anyone had a similar issue and knows the answer? > > > > *From:* Frank Luo > *Sent:* Wednesday, March 09, 2016 1:59 PM > *To:* 'user@hadoop.apache.org' > *Subject:* how to use Yarn API to find task/attempt status > > > > I have a need to programmatically find out how many tasks are pending in > Yarn. Is there a way to do it through a Java API? > > > > I looked at YarnClient, but not able to find what I need. > > > > Thx in advance. > > > > Frank Luo > > This email and any attachments transmitted with it are intended for use b= y > the intended recipient(s) only. If you have received this email in error, > please notify the sender immediately and then delete it. If you are not t= he > intended recipient, you must not keep, use, disclose, copy or distribute > this email without the author=E2=80=99s prior permission. We take precaut= ions to > minimize the risk of transmitting software viruses, but we advise you to > perform your own virus checks on any attachment to this message. We canno= t > accept liability for any loss or damage caused by software viruses. The > information contained in this communication may be confidential and may b= e > subject to the attorney-client privilege. > > > > > > -- > > Best Regards > > Jeff Zhang > > This email and any attachments transmitted with it are intended for use b= y > the intended recipient(s) only. If you have received this email in error, > please notify the sender immediately and then delete it. If you are not t= he > intended recipient, you must not keep, use, disclose, copy or distribute > this email without the author=E2=80=99s prior permission. We take precaut= ions to > minimize the risk of transmitting software viruses, but we advise you to > perform your own virus checks on any attachment to this message. We canno= t > accept liability for any loss or damage caused by software viruses. The > information contained in this communication may be confidential and may b= e > subject to the attorney-client privilege. > --=20 Best Regards Jeff Zhang --047d7bb0434e65189a052dabea14 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable



On Thu, = Mar 10, 2016 at 1:58 PM, Frank Luo <jluo@merkleinc.com> wro= te:

Let=E2=80=99s say there are 10 standa= rd M/R jobs running. How to find how many tasks are done/running/pending?

=C2=A0

From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Wednesday, March 09, 2016 9:33 PM
To: Frank Luo
Cc: user= @hadoop.apache.org
Subject: Re: how to use Yarn API to find task/attempt status<= u>

=C2=A0

I don't think it is related with yarn. Yarn don&= #39;t know about task/task attempt, it only knows containers. So it should = be your application to provide such function.=C2=A0

=C2=A0

On Thu, Mar 10, 2016 at 11:29 AM, Frank Luo <jluo@merkleinc.com&= gt; wrote:

Anyone had a similar i= ssue and knows the answer?

=C2=A0

From: Frank Luo
Sent: Wednesday, March 09, 2016 1:59 PM
To: 'user@hadoop.apache.org'
Subject: how to use Yarn API to find task/attempt status

=C2=A0

I have a need to programmatically find out how many = tasks are pending in Yarn. Is there a way to do it through a Java API?

=C2=A0

I looked at YarnClient, but not able to find what I = need.

=C2=A0

Thx in advance.

=C2=A0

Frank Luo

This email and any attachments transmitted with it are intended for use by= the intended recipient(s) only. If you have received this email in error, = please notify the sender immediately and then delete it. If you are not the intended recipient, you must not keep, use, = disclose, copy or distribute this email without the author=E2=80=99s prior = permission. We take precautions to minimize the risk of transmitting softwa= re viruses, but we advise you to perform your own virus checks on any attachment to this message. We cannot accept = liability for any loss or damage caused by software viruses. The informatio= n contained in this communication may be confidential and may be subject to= the attorney-client privilege.



=C2=A0

--

Best Regards

Jeff Zhang

This email and any attachments transmitted with it are intend= ed for use by the intended recipient(s) only. If you have received this ema= il in error, please notify the sender immediately and then delete it. If you are not the intended recipient, you= must not keep, use, disclose, copy or distribute this email without the au= thor=E2=80=99s prior permission. We take precautions to minimize the risk o= f transmitting software viruses, but we advise you to perform your own virus checks on any attachment to this mess= age. We cannot accept liability for any loss or damage caused by software v= iruses. The information contained in this communication may be confidential= and may be subject to the attorney-client privilege.




--
Best Regards

Jeff Zhang
--047d7bb0434e65189a052dabea14--