Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
From: Paul Joireman <paul.joireman@physiq.com>
To: "user@flink.apache.org" <user@flink.apache.org>
CC: Chad Conkright <chad.conkright@physiq.com>
Subject: Setting EventTime window width using stream data
Thread-Topic: Setting EventTime window width using stream data
Thread-Index: AQHSAvJvTMCwGAAl6UCdg5wcejRUCQ==
Date: Tue, 30 Aug 2016 19:28:29 +0000
Message-ID: <CY1PR02MB1995DF3913ECEF5A85ED34FC80E00@CY1PR02MB1995.namprd02.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
received-spf: None (protection.outlook.com: physiq.com does not designate
 permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
Content-Type: multipart/alternative;
	boundary="_000_CY1PR02MB1995DF3913ECEF5A85ED34FC80E00CY1PR02MB1995namp_"
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 30 Aug 2016 19:28:29.0872
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: ecbda8f3-3c3b-43e4-9663-6beab1acd10b
X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR02MB1993
archived-at: Tue, 30 Aug 2016 19:28:43 -0000

--_000_CY1PR02MB1995DF3913ECEF5A85ED34FC80E00CY1PR02MB1995namp_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi all,


Is it possible to dynamically set the size/width of a SlidingEventTimeWindo=
w based on a data coming from the stream?   Our use case is as follows.   W=
e create a

stream sourced from external system and coming in as a JSON string which is=
 deserialized to a stream of POJO.    The deserialized object contains an e=
vent timestamp,

data and details about how to analyze the contained data as well as the len=
gth of a time window to analyze.    It would be ideal if we could leverage =
the functionality of the

SlidingEventTimeWindows but instead of hard coding the window times, use da=
ta from the message to configure this on the fly.   Is this possible?


Note: the stream is keyed and timestamped with event time and the window si=
ze will not change for the same key.


Ultimately we need a way to dynamically change the window sizes in order to=
 adjust to different timing specifications not directly controlled or even =
known before-hand by

the person writing the flink analysis program.


Paul


--_000_CY1PR02MB1995DF3913ECEF5A85ED34FC80E00CY1PR02MB1995namp_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-=
1">
<style type=3D"text/css" style=3D"display:none;"><!-- P {margin-top:0;margi=
n-bottom:0;} --></style>
</head>
<body dir=3D"ltr">
<div id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;back=
ground-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Hi all,</p>
<p><br>
</p>
<p>Is it possible to dynamically set the size/width of a SlidingEventTimeWi=
ndow based on a data coming from the stream? &nbsp; Our use case is as foll=
ows. &nbsp; We create a&nbsp;</p>
<p>stream sourced from external system and coming in as a JSON string which=
 is deserialized to a stream of POJO. &nbsp; &nbsp;The deserialized object =
contains an event timestamp,</p>
<p>data and details about how to analyze&nbsp;<span style=3D"font-size: 12p=
t;">the contained data as well as the length of a time window to analyze. &=
nbsp; &nbsp;It would be ideal if we could leverage the functionality of the=
&nbsp;</span></p>
<p><span style=3D"font-size: 12pt;">SlidingEventTimeWindows but instead of =
hard coding the window times, use data from the message to configure this o=
n the fly. &nbsp; Is this possible? &nbsp;&nbsp;</span></p>
<p><span style=3D"font-size: 12pt;"><br>
</span></p>
<p><span style=3D"font-size: 12pt;">Note: the stream is&nbsp;</span><span s=
tyle=3D"font-size: 12pt;">keyed and timestamped with event time and the win=
dow size will not change for the same key.</span></p>
<p><span style=3D"font-size: 12pt;"><br>
</span></p>
<p><span style=3D"font-size: 12pt;">Ultimately we need a way to dynamically=
 change the window sizes in order to adjust to different timing specificati=
ons not directly controlled or even known before-hand by</span></p>
<p><span style=3D"font-size: 12pt;">the person writing the flink&nbsp;analy=
sis program. &nbsp;</span></p>
<p><span style=3D"font-size: 12pt;"><br>
</span></p>
<p><span style=3D"font-size: 12pt;">Paul</span></p>
<p><br>
</p>
</div>
</body>
</html>

--_000_CY1PR02MB1995DF3913ECEF5A85ED34FC80E00CY1PR02MB1995namp_--