Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 32F84200B76 for ; Tue, 30 Aug 2016 12:59:20 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 316D9160ABA; Tue, 30 Aug 2016 10:59:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 512F8160AA8 for ; Tue, 30 Aug 2016 12:59:19 +0200 (CEST) Received: (qmail 85628 invoked by uid 500); 30 Aug 2016 10:59:17 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 85618 invoked by uid 99); 30 Aug 2016 10:59:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Aug 2016 10:59:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9CA51C05BE for ; Tue, 30 Aug 2016 10:59:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id TE3GFDRGiYO6 for ; Tue, 30 Aug 2016 10:59:14 +0000 (UTC) Received: from mail-qt0-f181.google.com (mail-qt0-f181.google.com [209.85.216.181]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 99C475F240 for ; Tue, 30 Aug 2016 10:59:13 +0000 (UTC) Received: by mail-qt0-f181.google.com with SMTP id w38so7015825qtb.0 for ; Tue, 30 Aug 2016 03:59:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=ULezhniKGQBOCqpDy3p9anLRcMgRskr6tZ+8s7vjAQg=; b=QlG+sYbPMUN5AYvVAvTnCj01w6XOr2Sxe1zIWRpgg7xowcoW4DpAxmteSn/7wkLzvK 1WRNTtWEg+W2gs4KNs4OQOFnSHBPvmAMkVnXwKO6NnpymhxlG+7y0WEiaiyDqZqTmkQE rNszRlIF7dAblLq7ZCFucmRAqIP+TL2FkzexyVhYP8OQIhHkOzEA2oldccRToatw2U5m 64oYin/M+vwYp1oJvzReA2NEcQL8Fqb33BAjS8wWu7Cu4VrBugvxAkuuLc7h3yIK3WpU F3yhkI5szsvjc05VpmpOx8qhrFI09eEB4rPqguVYXqL5RVmJOBrdhEBr8bsZ6/zRvXwT oJBA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=ULezhniKGQBOCqpDy3p9anLRcMgRskr6tZ+8s7vjAQg=; b=QePjA5phyEwMsELLlzLwodDUQ8GsGIyledsVINd4Va4h5Ivrgx78V6ZqcvddLcu1QJ 9c6YWn2gHLbNqULMUHVMU4KWppUmMrBtOMX0l4PlvOrBUtIRBV8dXypxIFrytu/myvH/ 3P4Ds3eeUYGOPmRIRhK0PtltpMAFaTLqXDlzqn7IUTV/sMja90dmnYhnaGnXCFQ0EOaU KfOq17LKFmBFj+xgaGk2w2Nzbz1Vi0Ewy8xZIWljdxV4OjsvbxoJfF4IKVFJNoAoeGEN 0EgD5WgJtcEfCxj1vX8nBmjtpQhWzNzhv9HHVwtPIMfISUv3Yj3Ty/Tzh6JvoRYVbLI4 IQJw== X-Gm-Message-State: AE9vXwPnBr/KSWadaA4zdvktqiBMrWJ1+m7LUG7adQuSN/LbR5n/K8gBR74Qs0LfoQgTHANyNwOPNOMwBBHOhA== X-Received: by 10.237.51.162 with SMTP id v31mr3139238qtd.1.1472554752623; Tue, 30 Aug 2016 03:59:12 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.67.136 with HTTP; Tue, 30 Aug 2016 03:59:12 -0700 (PDT) In-Reply-To: References: From: Mich Talebzadeh Date: Tue, 30 Aug 2016 11:59:12 +0100 Message-ID: Subject: Re: Spark metrics when running with YARN? To: Vijay Kiran Cc: =?UTF-8?Q?Otis_Gospodneti=C4=87?= , "user@spark.apache.org" Content-Type: multipart/alternative; boundary=94eb2c124a32f14884053b47dec1 archived-at: Tue, 30 Aug 2016 10:59:20 -0000 --94eb2c124a32f14884053b47dec1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Spark UI regardless of deployment mode Standalone, yarn etc runs on port 4040 by default that can be accessed directly Otherwise one can specify a specific port with --conf "spark.ui.port=3D5555= 5" for example 55555 HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=3DAAEAAAAWh2gBxianrbJd6= zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 30 August 2016 at 11:48, Vijay Kiran wrote: > > From Yarm RM UI, find the spark application Id, and in the application > details, you can click on the =E2=80=9CTracking URL=E2=80=9D which should= give you the > Spark UI. > > ./Vijay > > > On 30 Aug 2016, at 07:53, Otis Gospodneti=C4=87 > wrote: > > > > Hi, > > > > When Spark is run on top of YARN, where/how can one get Spark metrics? > > > > Thanks, > > Otis > > -- > > Monitoring - Log Management - Alerting - Anomaly Detection > > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscribe@spark.apache.org > > --94eb2c124a32f14884053b47dec1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Spark UI regardless of deployment mode Standalone, ya= rn etc runs on port 4040 by default that can be accessed directly

Otherwise one can specify a specific port with --conf "spark.ui.port= =3D55555" for example 55555
=
<= /div>
= HTH

Dr Mich Talebzadeh

=C2=A0

LinkedIn =C2=A0https://www.linkedin.com/profile/view?id=3DAAEA= AAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

=C2=A0

http:= //talebzadehmich.wordpress.com


Disclaimer:=C2=A0Use = it=C2=A0at your own risk. Any and all responsibilit= y for any loss, damage or destruction of data or any other property which may arise from relying on this email= 9;s=C2=A0technical=C2=A0content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from = such loss, damage or destruction.

=C2=A0

<= font color=3D"#000000" face=3D"Times New Roman" size=3D"3">

On 30 August 2016 at 11:48, Vijay Kiran <= mail@vijaykiran.com> wrote:

From Yarm RM UI, find the spark application Id, and in the application deta= ils, you can click on the =E2=80=9CTracking URL=E2=80=9D which should give = you the Spark UI.

./Vijay

> On 30 Aug 2016, at 07:53, Otis Gospodneti=C4=87 <otis.gospodnetic@gmail.com> wrote:
>
> Hi,
>
> When Spark is run on top of YARN, where/how can one get Spark metrics?=
>
> Thanks,
> Otis
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/=
>


----------------------------------------------------------= -----------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


--94eb2c124a32f14884053b47dec1--