flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Niels Basjes <Ni...@basjes.nl>
Subject Cleanup of OperatorStates?
Date Thu, 26 Nov 2015 21:42:14 GMT

I'm working on a streaming application that ingests clickstream data.
In a specific part of the flow I need to retain a little bit of state per
visitor (i.e. keyBy(sessionid) )

So I'm using the Key/Value state interface (i.e. OperatorState<MyRecord>)
in a map function.

Now in my application I expect to get a huge number of sessions per day.
Since these sessionids are 'random' and become unused after the visitor
leaves the website over time the system will have seen millions of those

So I was wondering: how are these OperatorStates cleaned?

Best regards / Met vriendelijke groeten,

Niels Basjes

View raw message