Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
Sender: ewenstephan@gmail.com
In-Reply-To: <1464169848193-7159.post@n4.nabble.com>
References: <1464118719808-7134.post@n4.nabble.com>
	<CANMXwW0FSwiXxEkNQSQK1SBAfoMN_GU4m4Ypivt+0dcpnJn4wA@mail.gmail.com>
	<1464169848193-7159.post@n4.nabble.com>
Date: Wed, 25 May 2016 12:30:51 +0200
Message-ID: <CANC1h_smjoJRt5=D3mMMfZHs4VaNjAo9b0fhWPWw-gUxOj_UgQ@mail.gmail.com>
Subject: Re: Data ingestion using a Flink TCP Server
From: Stephan Ewen <sewen@apache.org>
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a114a78eef4cc8e0533a82a2f
archived-at: Wed, 25 May 2016 10:31:04 -0000

--001a114a78eef4cc8e0533a82a2f
Content-Type: text/plain; charset=UTF-8

Hi!

A typical example of a parallel source is the Kafka Source.

Actually, other threads than the main run() thread can call ctx.collect(),
provided they use the checkpoint lock properly. The Kafka source does that.

Stephan


On Wed, May 25, 2016 at 11:50 AM, omaralvarez <xxosurfer3xx@gmail.com>
wrote:

> Hi,
>
> Thank you very much for your answer. There is one more doubt in my mind.
> How
> are not parallelized source funtions processed? For instance, lets say I
> have four streams that implement SourceFunction, will they be placed on
> different parallel instances or will they be processed sequentially by the
> same instance?
>
> Could you direct me to an example of a ParallelSourceFunction, because
> looking at the code I don't see an interface or any implementation example
> in the documentation.
>
> Best,
>
> Omar.
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-tp7134p7159.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

--001a114a78eef4cc8e0533a82a2f
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi!<div><br></div><div>A typical example of a parallel sou=
rce is the Kafka Source.</div><div><br></div><div>Actually, other threads t=
han the main run() thread can call ctx.collect(), provided they use the che=
ckpoint lock properly. The Kafka source does that.</div><div><br></div><div=
>Stephan</div><div><br></div></div><div class=3D"gmail_extra"><br><div clas=
s=3D"gmail_quote">On Wed, May 25, 2016 at 11:50 AM, omaralvarez <span dir=
=3D"ltr">&lt;<a href=3D"mailto:xxosurfer3xx@gmail.com" target=3D"_blank">xx=
osurfer3xx@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_qu=
ote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex=
">Hi,<br>
<br>
Thank you very much for your answer. There is one more doubt in my mind. Ho=
w<br>
are not parallelized source funtions processed? For instance, lets say I<br=
>
have four streams that implement SourceFunction, will they be placed on<br>
different parallel instances or will they be processed sequentially by the<=
br>
same instance?<br>
<br>
Could you direct me to an example of a ParallelSourceFunction, because<br>
looking at the code I don&#39;t see an interface or any implementation exam=
ple<br>
in the documentation.<br>
<br>
Best,<br>
<br>
Omar.<br>
<br>
<br>
<br>
--<br>
View this message in context: <a href=3D"http://apache-flink-user-mailing-l=
ist-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-t=
p7134p7159.html" rel=3D"noreferrer" target=3D"_blank">http://apache-flink-u=
ser-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink=
-TCP-Server-tp7134p7159.html</a><br>
<div class=3D"HOEnZb"><div class=3D"h5">Sent from the Apache Flink User Mai=
ling List archive. mailing list archive at Nabble.com.<br>
</div></div></blockquote></div><br></div>

--001a114a78eef4cc8e0533a82a2f--