flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Data ingestion using a Flink TCP Server
Date Wed, 25 May 2016 10:30:51 GMT
Hi!

A typical example of a parallel source is the Kafka Source.

Actually, other threads than the main run() thread can call ctx.collect(),
provided they use the checkpoint lock properly. The Kafka source does that.

Stephan


On Wed, May 25, 2016 at 11:50 AM, omaralvarez <xxosurfer3xx@gmail.com>
wrote:

> Hi,
>
> Thank you very much for your answer. There is one more doubt in my mind.
> How
> are not parallelized source funtions processed? For instance, lets say I
> have four streams that implement SourceFunction, will they be placed on
> different parallel instances or will they be processed sequentially by the
> same instance?
>
> Could you direct me to an example of a ParallelSourceFunction, because
> looking at the code I don't see an interface or any implementation example
> in the documentation.
>
> Best,
>
> Omar.
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-tp7134p7159.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message