flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Iterative queries on Flink
Date Mon, 30 Nov 2015 15:55:40 GMT
Is there any effort in this direction? maybe I could achieve something like
that using Tachyon in some way...?

On Mon, Nov 30, 2015 at 4:52 PM, Fabian Hueske <fhueske@gmail.com> wrote:

> Hi Flavio,
>
> Flink does not support caching of data sets in memory yet.
>
> Best, Fabian
>
> 2015-11-30 16:45 GMT+01:00 Flavio Pompermaier <pompermaier@okkam.it>:
>
>> Hi to all,
>> I was wondering if Flink could fit a use case where a user load a dataset
>> in memory and then he/she wants to explore it interactively. Let's say I
>> want to load a csv, then filter out the rows where the column value match
>> some criteria, then apply another criteria after seeing the results of the
>> first filter.
>> Is there a way to keep the dataset in memory and modify it interactively
>> without re-reading all the dataset every time I want to chain another
>> operation to my dataset?
>>
>> Best,
>> Flavio
>>
>
>

Mime
View raw message