flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Non blocking operation in Apache flink
Date Wed, 25 May 2016 09:16:57 GMT
Hi,
there is no functionality to have asynchronous calls in user functions in
Flink.

The asynchronous action feature in Spark is also not meant for such things,
it is targeted at programs that need to pull all data to the application
master. In Flink this is not necessary because you can specify a whole plan
of operations before executing them.

Cheers,
Aljoscha

On Tue, 24 May 2016 at 20:43 Maatary Okouya <maatariokouya@gmail.com> wrote:

> I'm looking for a way to avoid thread starvation in my tasks, by returning
> future but i don't see how is that possible.
>
> Hence i would like to know, how flink handle the case where in your job
> you have to perform network calls (I use akka http or spray) or any IO
> operation and use the result of it.
>
> In sparks i see asynchronous action and so on. I don't see any equivalent
> in apache flink. How does it works ? is it supported, or the network call
> and any io operation have to be synchronous ?
>
> any help, indication, reads and so on would be appreciated
>

Mime
View raw message