Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9A81320049C for ; Fri, 11 Aug 2017 14:26:37 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 50F4616D2F0; Fri, 11 Aug 2017 12:26:27 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7029716D2EC for ; Fri, 11 Aug 2017 14:26:26 +0200 (CEST) Received: (qmail 73919 invoked by uid 500); 11 Aug 2017 12:26:25 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 73907 invoked by uid 99); 11 Aug 2017 12:26:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Aug 2017 12:26:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D8609180856 for ; Fri, 11 Aug 2017 12:26:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 4MoZTwpY0u26 for ; Fri, 11 Aug 2017 12:26:23 +0000 (UTC) Received: from mail-lf0-f47.google.com (mail-lf0-f47.google.com [209.85.215.47]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 36DF060D44 for ; Fri, 11 Aug 2017 12:26:23 +0000 (UTC) Received: by mail-lf0-f47.google.com with SMTP id o85so15378785lff.3 for ; Fri, 11 Aug 2017 05:26:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=2zBnZdc7HsMjwFZV9YwIFs5zvfkvy/a4yHCawf1tE+8=; b=FUBDB97BqNSCsWRzLZMD5+6Znx2t/6jx2Ta3s8WhQ8XgxjUpSjjPuda05mCtBoxxVG 9nNZDi9uh0xf+cLW/nVVdUdC+WHmCW4rotmBk8xYv29u+JdL/7U6EBWzuiQLGz9UBX0b 3VratoxMH8qcti1C5A+NkRkX74xUSGTS+myOwDj3VV3AZSWKPw91sWpa4m8R3kgr6mAz XWVHCXx/3SxcOMQdFM+z+rOPoJSclJNVxcJdmv21kHHsAMjty9n+ifMQEb7KouXri1WQ Z4va/PzpVTZLc0kd5wW7PxM7KpdrQ/4KL4FcksxEu+i8KiqtWkjDHG3HF1JL4lQzi719 DqLg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=2zBnZdc7HsMjwFZV9YwIFs5zvfkvy/a4yHCawf1tE+8=; b=ErITfmNI8rsKGpoLexRWsF/MeMA6xZKr9XGLbJb7DJ9n465TuXZIEawMyE2Fu3U/UE UMNG8gB0auoPMtnra1+SPc6CvIK1MB9sweu/fui7vHZxoXuDo+xTo9hljFB2CsqfR7Hh 8+L8Bi6+nVF0yWArvpmQ4TkAN8A+MpqznFTrh417UnVaCmh93cHKXa18i0qIz/W2wnkx 2Cgf6/3A9Hc7vaTS7cS0TkN8BnOZ9EtMZ+mAsQetwCg9pR/LuObmqMN4Ngx/IEB555Qy TTC/fHz2agCyImCH7EAX28nydZ8mOzFOabgUVG8wYyc2o79LnQncWoGTFil1OtSnRNol S/NQ== X-Gm-Message-State: AHYfb5i0EYpn7r47zCQC7gOAVtzM/VE608vgzXRmCLJRLNFqslaXjXc4 pHOen/iY4h6jP7ftOJkZW0D0TL7vWQ== X-Received: by 10.25.193.21 with SMTP id r21mr5453883lff.107.1502454382575; Fri, 11 Aug 2017 05:26:22 -0700 (PDT) MIME-Version: 1.0 References: <07EB8D32-ED51-4768-A350-3754EC4DADBD@apache.org> <560BFB25-5AE7-4485-BD18-71F4ACC1ED5E@apache.org> In-Reply-To: <560BFB25-5AE7-4485-BD18-71F4ACC1ED5E@apache.org> From: =?UTF-8?Q?Gyula_F=C3=B3ra?= Date: Fri, 11 Aug 2017 12:26:12 +0000 Message-ID: Subject: Re: Using latency markers To: Aljoscha Krettek , Kien Truong Cc: user@flink.apache.org Content-Type: multipart/alternative; boundary="94eb2c1a1b66c3c6b40556796b49" archived-at: Fri, 11 Aug 2017 12:26:37 -0000 --94eb2c1a1b66c3c6b40556796b49 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Yes, they are enabled by default I think. Gyula On Fri, Aug 11, 2017, 14:14 Aljoscha Krettek wrote: > It seems you have to enable latency tracking > via ExecutionConfig.setLatencyTrackingInterval(...). This will make the > sources emit latency tokens, which then in turn update the latency metric= : > https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/me= trics.html#latency-tracking > . > > Did you enable that? > > Best, > Aljoscha > > > On 10. Aug 2017, at 18:36, Kien Truong wrote: > > Hi, > > I just want to say we're having the same issues. > > There's no metric for latency when we attempted to export the metrics > through graphite either. > > > Regards, > > Kien > > > On 8/10/2017 7:36 PM, Aljoscha Krettek wrote: > > Hi, > > I must admit that I've never used this but I'll try and look into it. > > Best, > Aljoscha > > On 10. Aug 2017, at 11:10, Gyula F=C3=B3ra wrote: > > Hi all! > > Does anyone have a working example of using the latency markers to test > for the topology latency? > We are using Flink 1.3.2 and it seems like however we tune it, whatever > job we use all we get is NaN in the metrics. Maybe we are completely > missing something... > > Thanks! > Gyula > > > > --94eb2c1a1b66c3c6b40556796b49 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Yes, they are enabled by default I think.

Gyula


On Fri, Aug 11, 2017, 14:14= Aljoscha Krettek <aljoscha@apach= e.org> wrote:
It seems you have to enable latency tracking via=C2= =A0ExecutionConfig.setLatencyTrackingInterval(...). This will make the sour= ces emit latency=C2=A0tokens, which then in turn update the latency metric:= =C2=A0https://ci.ap= ache.org/projects/flink/flink-docs-release-1.3/monitoring/metrics.html#late= ncy-tracking.

Did you enable that?

Best,
Aljoscha


On 10. Aug 2017, at 1= 8:36, Kien Truong <duckientruong@gmail.com> wrote:

Hi,

I just want to = say we're having the same issues.

There's no metric for late= ncy when we attempted to export the metrics through graphite either.

Regards,

Kien


On 8/10/2017 7:36 PM, Aljoscha Krettek= wrote:
Hi,

I must admit that I've = never used this but I'll try and look into it.

Best,
Aljoscha=

On 10. Aug 2017, at 11:10, Gyula F=C3=B3r= a <gyula.fora@= gmail.com> wrote:

Hi all!

Does anyone have a working e= xample of using the latency markers to test for the topology latency?
We= are using Flink 1.3.2 and it seems like however we tune it, whatever job w= e use all we get is NaN in the metrics. Maybe we are completely missing som= ething...

Thanks!
Gyula


--94eb2c1a1b66c3c6b40556796b49--