Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <CAKcRf44QwVTUj-P-9FFVUcjYw3VGQ0xwgFmFvjv1Rw9V+=RRtw@mail.gmail.com>
References: <CAKcRf44QwVTUj-P-9FFVUcjYw3VGQ0xwgFmFvjv1Rw9V+=RRtw@mail.gmail.com>
From: Fabian Hueske <fhueske@gmail.com>
Date: Thu, 5 Oct 2017 14:20:05 +0200
Message-ID: <CAAdrtT0B5y1tfkpiW5P=j7CVf9qVZ2XvGOHG=Pe2_8GQPqWn7Q@mail.gmail.com>
Subject: Re: Calculating metrics real time
To: Rahul Raj <rahulrajmsrit@gmail.com>
Cc: user <user@flink.apache.org>
Content-Type: multipart/alternative; boundary="001a113bcdc2fe57e0055acbc0b4"
archived-at: Thu, 05 Oct 2017 12:20:52 -0000

--001a113bcdc2fe57e0055acbc0b4
Content-Type: text/plain; charset="UTF-8"

Hi,

I'd suggest to have a look at the window operators [1]. For example a
tumbling window of 1 minute can be used to compute metrics every minute.
Flink's window operators are very extensible and you can implement very
custom logic if the predefined windows don't match your use case. In any
case, windows are used to collect and perform a computation on a set of
records.

Best, Fabian

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/windows.html

2017-10-05 12:57 GMT+02:00 Rahul Raj <rahulrajmsrit@gmail.com>:

> Hi,
>
> I have to calculate some complicated metrics like click through rate ,
> click value rate and conversions on real time data using flink. But I am
> not sure what functionality of flink should I use to program this because
> it involves collection of some records in memory for certain time may be 1
> minute and then using formula for calculating metrics on those records.
>
> Am I correct with my approach or is there any preferred approach for such
> tasks in flink? Can I use windows for doing this? Any tutorial or example
> would be really great.
>
> Rahul Raj
>

--001a113bcdc2fe57e0055acbc0b4
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div>Hi,<br><br></div>I&#39;d suggest to have a =
look at the window operators [1]. For example a tumbling window of 1 minute=
 can be used to compute metrics every minute.<br></div>Flink&#39;s window o=
perators are very extensible and you can implement very custom logic if the=
 predefined windows don&#39;t match your use case. In any case, windows are=
 used to collect and perform a computation on a set of records.<br><br></di=
v>Best, Fabian<br><div><br>[1] <a href=3D"https://ci.apache.org/projects/fl=
ink/flink-docs-release-1.3/dev/windows.html">https://ci.apache.org/projects=
/flink/flink-docs-release-1.3/dev/windows.html</a><br></div></div><div clas=
s=3D"gmail_extra"><br><div class=3D"gmail_quote">2017-10-05 12:57 GMT+02:00=
 Rahul Raj <span dir=3D"ltr">&lt;<a href=3D"mailto:rahulrajmsrit@gmail.com"=
 target=3D"_blank">rahulrajmsrit@gmail.com</a>&gt;</span>:<br><blockquote c=
lass=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;=
padding-left:1ex"><div dir=3D"ltr">Hi,<div><br></div><div>I have to calcula=
te some complicated metrics like click through rate , click value rate and =
conversions on real time data using flink. But I am not sure what functiona=
lity of flink should I use to program this because it involves collection o=
f some records in memory for certain time may be 1 minute and then using fo=
rmula for calculating metrics on those records.=C2=A0</div><div><br></div><=
div>Am I correct with my approach or is there any preferred approach for su=
ch tasks in flink? Can I use windows for doing this? Any tutorial or exampl=
e would be really great.</div><span class=3D"HOEnZb"><font color=3D"#888888=
"><div><br></div><div>Rahul Raj</div></font></span></div>
</blockquote></div><br></div>

--001a113bcdc2fe57e0055acbc0b4--