flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Coates <big.andy.coa...@gmail.com>
Subject Flink message & state lifecycle.
Date Wed, 13 Jan 2016 14:12:24 GMT
Hi,

I'm trying to understand how the lifecycle of messages / state is managed
by Flink, but I'm failing to find any documentation.

Specially, if I'm using a windowed stream and a type of trigger that retain
the elements of the window to allow for processing of late data e.g.
ContinousEventTimeTrigger, then where are the contents of the windows, or
their intermediate computation results, stored, and when is the data
removed?

I'm thinking in terms of Google's Dataflow API, setting a windows the
withAllowedLateness option allows the caller to control how long past the
end of a window the data should be maintained.  Does Flink have anything
similar?

Thanks,

Andy

Mime
View raw message