Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CANMXwW2m1hxjXgZ8H4mebTbFkv4RGvDZ182by6KNWgNhGOBo=Q@mail.gmail.com>
References: <CAEqpkut0Qt4G+bvUspoZaOwS0hyJ2RgBvSeShvsfPWZ0RFevuQ@mail.gmail.com>
	<CANMXwW2m1hxjXgZ8H4mebTbFkv4RGvDZ182by6KNWgNhGOBo=Q@mail.gmail.com>
Date: Wed, 25 May 2016 06:21:41 -0400
Message-ID: <CAEqpkuumYd1DegTTwaovhiRkLsEp4ZhnkC_jwLaP8R8zp8-NzQ@mail.gmail.com>
Subject: Re: Non blocking operation in Apache flink
From: Maatary Okouya <maatariokouya@gmail.com>
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a1143dfb42dd4d00533a80afe
archived-at: Wed, 25 May 2016 10:21:47 -0000

--001a1143dfb42dd4d00533a80afe
Content-Type: text/plain; charset=UTF-8

Maybe the following can illustrate better what i mean
http://doc.akka.io/docs/akka/2.4.6/scala/stream/stream-integrations.html#Integrating_with_External_Services

On Wed, May 25, 2016 at 5:16 AM, Aljoscha Krettek <aljoscha@apache.org>
wrote:

> Hi,
> there is no functionality to have asynchronous calls in user functions in
> Flink.
>
> The asynchronous action feature in Spark is also not meant for such
> things, it is targeted at programs that need to pull all data to the
> application master. In Flink this is not necessary because you can specify
> a whole plan of operations before executing them.
>
> Cheers,
> Aljoscha
>
> On Tue, 24 May 2016 at 20:43 Maatary Okouya <maatariokouya@gmail.com>
> wrote:
>
>> I'm looking for a way to avoid thread starvation in my tasks, by
>> returning future but i don't see how is that possible.
>>
>> Hence i would like to know, how flink handle the case where in your job
>> you have to perform network calls (I use akka http or spray) or any IO
>> operation and use the result of it.
>>
>> In sparks i see asynchronous action and so on. I don't see any equivalent
>> in apache flink. How does it works ? is it supported, or the network call
>> and any io operation have to be synchronous ?
>>
>> any help, indication, reads and so on would be appreciated
>>
>

--001a1143dfb42dd4d00533a80afe
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Maybe the following can illustrate better what i mean=C2=
=A0<a href=3D"http://doc.akka.io/docs/akka/2.4.6/scala/stream/stream-integr=
ations.html#Integrating_with_External_Services">http://doc.akka.io/docs/akk=
a/2.4.6/scala/stream/stream-integrations.html#Integrating_with_External_Ser=
vices</a></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On=
 Wed, May 25, 2016 at 5:16 AM, Aljoscha Krettek <span dir=3D"ltr">&lt;<a hr=
ef=3D"mailto:aljoscha@apache.org" target=3D"_blank">aljoscha@apache.org</a>=
&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0=
 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<d=
iv>there is no functionality to have asynchronous calls in user functions i=
n Flink.=C2=A0</div><div><br></div><div>The asynchronous action feature in =
Spark is also not meant for such things, it is targeted at programs that ne=
ed to pull all data to the application master. In Flink this is not necessa=
ry because you can specify a whole plan of operations before executing them=
.=C2=A0</div><div><br></div><div>Cheers,</div><div>Aljoscha</div></div><div=
 class=3D"HOEnZb"><div class=3D"h5"><br><div class=3D"gmail_quote"><div dir=
=3D"ltr">On Tue, 24 May 2016 at 20:43 Maatary Okouya &lt;<a href=3D"mailto:=
maatariokouya@gmail.com" target=3D"_blank">maatariokouya@gmail.com</a>&gt; =
wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8e=
x;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><p style=3D=
"margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:=
rgb(36,39,41);font-family:Arial,&#39;Helvetica Neue&#39;,Helvetica,sans-ser=
if;line-height:19.5px">I&#39;m looking for a way to avoid thread starvation=
 in my tasks, by returning future but i don&#39;t see how is that possible.=
</p><p style=3D"margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;cl=
ear:both;color:rgb(36,39,41);font-family:Arial,&#39;Helvetica Neue&#39;,Hel=
vetica,sans-serif;line-height:19.5px">Hence i would like to know, how flink=
 handle the case where in your job you have to perform network calls (I use=
 akka http or spray) or any IO operation and use the result of it.</p><p st=
yle=3D"margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;=
color:rgb(36,39,41);font-family:Arial,&#39;Helvetica Neue&#39;,Helvetica,sa=
ns-serif;line-height:19.5px">In sparks i see asynchronous action and so on.=
 I don&#39;t see any equivalent in apache flink. How does it works ? is it =
supported, or the network call and any io operation have to be synchronous =
?</p><p style=3D"margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;c=
lear:both;color:rgb(36,39,41);font-family:Arial,&#39;Helvetica Neue&#39;,He=
lvetica,sans-serif;line-height:19.5px">any help, indication, reads and so o=
n would be appreciated</p></div>
</blockquote></div>
</div></div></blockquote></div><br></div>

--001a1143dfb42dd4d00533a80afe--