flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: Streaming time window
Date Thu, 10 Dec 2015 11:20:12 GMT
Hi Martin,

you can get the start and end time of a window from the TimeWindow object.
The following Scala code snippet shows how to access the window end time
(start time is equivalent):

.timeWindow(Time.minutes(5))
.trigger(new EarlyCountTrigger(earlyCountThreshold))
.apply { (
  key: Int,
  window: TimeWindow,
  vals: Iterable[(Int, Short)],
  out: Collector[(Int, Long, Int)]) =>
    out.collect( ( key, window.getEnd, vals.map( _._2 ).sum ) )
}

Cheers, Fabian

2015-12-10 12:04 GMT+01:00 Martin Neumann <mneumann@sics.se>:

> Hej,
>
> Is it possible to extract the start and end window time stamps from within
> a window operator?
>
> I have an event time based window that does a simple fold function. I want
> to put the output into elasticsearch and want to preserve the start and end
> timestamp of the data so I can directly compare it with related data. The
> only Idea I had so far was to manually keep track of the minimum and
> maximum timestamp found in a window and pass them along with the output.
> This is a quite bad approximation since the window I see depends alot on
> how the values are spaced out. Anyone an idea how to do this?
>
> cheers Martin
>

Mime
View raw message