flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: Iterative queries on Flink
Date Mon, 30 Nov 2015 15:52:09 GMT
Hi Flavio,

Flink does not support caching of data sets in memory yet.

Best, Fabian

2015-11-30 16:45 GMT+01:00 Flavio Pompermaier <pompermaier@okkam.it>:

> Hi to all,
> I was wondering if Flink could fit a use case where a user load a dataset
> in memory and then he/she wants to explore it interactively. Let's say I
> want to load a csv, then filter out the rows where the column value match
> some criteria, then apply another criteria after seeing the results of the
> first filter.
> Is there a way to keep the dataset in memory and modify it interactively
> without re-reading all the dataset every time I want to chain another
> operation to my dataset?
> Best,
> Flavio

View raw message