Return-Path: <user-return-7091-archive-asf-public=cust-asf.ponee.io@flink.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 36721200A5B
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Wed, 25 May 2016 11:17:16 +0200 (CEST)
Received: by cust-asf.ponee.io (Postfix)
	id 35381160A18; Wed, 25 May 2016 09:17:16 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id 7EB2B160A17
	for <archive-asf-public@cust-asf.ponee.io>; Wed, 25 May 2016 11:17:15 +0200 (CEST)
Received: (qmail 80524 invoked by uid 500); 25 May 2016 09:17:09 -0000
Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@flink.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@flink.apache.org>
List-Post: <mailto:user@flink.apache.org>
List-Id: <user.flink.apache.org>
Reply-To: user@flink.apache.org
Delivered-To: mailing list user@flink.apache.org
Received: (qmail 80515 invoked by uid 99); 25 May 2016 09:17:09 -0000
Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 May 2016 09:17:09 +0000
Received: from mail-lf0-f54.google.com (mail-lf0-f54.google.com [209.85.215.54])
	by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 01D981A0098
	for <user@flink.apache.org>; Wed, 25 May 2016 09:17:08 +0000 (UTC)
Received: by mail-lf0-f54.google.com with SMTP id e130so15553012lfe.3
        for <user@flink.apache.org>; Wed, 25 May 2016 02:17:08 -0700 (PDT)
X-Gm-Message-State: ALyK8tIlZtd9RoqOd/wdyw1Vp4wBcoieAntzsdPWhmx4FG09zR6OlVtbb2myDRSS8wH+6Y9JVjIK3eSmrENdGw==
X-Received: by 10.25.157.213 with SMTP id g204mr695349lfe.216.1464167827440;
 Wed, 25 May 2016 02:17:07 -0700 (PDT)
MIME-Version: 1.0
References: <CAEqpkut0Qt4G+bvUspoZaOwS0hyJ2RgBvSeShvsfPWZ0RFevuQ@mail.gmail.com>
In-Reply-To: <CAEqpkut0Qt4G+bvUspoZaOwS0hyJ2RgBvSeShvsfPWZ0RFevuQ@mail.gmail.com>
From: Aljoscha Krettek <aljoscha@apache.org>
Date: Wed, 25 May 2016 09:16:57 +0000
X-Gmail-Original-Message-ID: <CANMXwW2m1hxjXgZ8H4mebTbFkv4RGvDZ182by6KNWgNhGOBo=Q@mail.gmail.com>
Message-ID: <CANMXwW2m1hxjXgZ8H4mebTbFkv4RGvDZ182by6KNWgNhGOBo=Q@mail.gmail.com>
Subject: Re: Non blocking operation in Apache flink
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a1146f4423f0ae30533a72377
archived-at: Wed, 25 May 2016 09:17:16 -0000

--001a1146f4423f0ae30533a72377
Content-Type: text/plain; charset=UTF-8

Hi,
there is no functionality to have asynchronous calls in user functions in
Flink.

The asynchronous action feature in Spark is also not meant for such things,
it is targeted at programs that need to pull all data to the application
master. In Flink this is not necessary because you can specify a whole plan
of operations before executing them.

Cheers,
Aljoscha

On Tue, 24 May 2016 at 20:43 Maatary Okouya <maatariokouya@gmail.com> wrote:

> I'm looking for a way to avoid thread starvation in my tasks, by returning
> future but i don't see how is that possible.
>
> Hence i would like to know, how flink handle the case where in your job
> you have to perform network calls (I use akka http or spray) or any IO
> operation and use the result of it.
>
> In sparks i see asynchronous action and so on. I don't see any equivalent
> in apache flink. How does it works ? is it supported, or the network call
> and any io operation have to be synchronous ?
>
> any help, indication, reads and so on would be appreciated
>

--001a1146f4423f0ae30533a72377
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div>there is no functionality to have asynchronous cal=
ls in user functions in Flink.=C2=A0</div><div><br></div><div>The asynchron=
ous action feature in Spark is also not meant for such things, it is target=
ed at programs that need to pull all data to the application master. In Fli=
nk this is not necessary because you can specify a whole plan of operations=
 before executing them.=C2=A0</div><div><br></div><div>Cheers,</div><div>Al=
joscha</div></div><br><div class=3D"gmail_quote"><div dir=3D"ltr">On Tue, 2=
4 May 2016 at 20:43 Maatary Okouya &lt;<a href=3D"mailto:maatariokouya@gmai=
l.com">maatariokouya@gmail.com</a>&gt; wrote:<br></div><blockquote class=3D=
"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding=
-left:1ex"><div dir=3D"ltr"><p style=3D"margin:0px 0px 1em;padding:0px;bord=
er:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:Arial,&#39=
;Helvetica Neue&#39;,Helvetica,sans-serif;line-height:19.5px">I&#39;m looki=
ng for a way to avoid thread starvation in my tasks, by returning future bu=
t i don&#39;t see how is that possible.</p><p style=3D"margin:0px 0px 1em;p=
adding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-fa=
mily:Arial,&#39;Helvetica Neue&#39;,Helvetica,sans-serif;line-height:19.5px=
">Hence i would like to know, how flink handle the case where in your job y=
ou have to perform network calls (I use akka http or spray) or any IO opera=
tion and use the result of it.</p><p style=3D"margin:0px 0px 1em;padding:0p=
x;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:Aria=
l,&#39;Helvetica Neue&#39;,Helvetica,sans-serif;line-height:19.5px">In spar=
ks i see asynchronous action and so on. I don&#39;t see any equivalent in a=
pache flink. How does it works ? is it supported, or the network call and a=
ny io operation have to be synchronous ?</p><p style=3D"margin:0px 0px 1em;=
padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-f=
amily:Arial,&#39;Helvetica Neue&#39;,Helvetica,sans-serif;line-height:19.5p=
x">any help, indication, reads and so on would be appreciated</p></div>
</blockquote></div>

--001a1146f4423f0ae30533a72377--