flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From omaralvarez <xxosurfer...@gmail.com>
Subject Data ingestion using a Flink TCP Server
Date Tue, 24 May 2016 19:38:39 GMT
I have been trying to send data from several processes to my Flink
application. I want to use a single port that will receive data from
multiple clients. I have implemented my own SourceFunction, but I have two
doubts. 

My TCP server has multiple threads receiving data from multiple clients, is
calling ctx.collect() without synchronization safe?

Second, when I have a source function, how is the data processing of the
arrival messages handled? Is a source function parallelized? For instance
with the simple SocketTextStream, are messages received in parallel or
received sequentially and then processed in parallel by mappers and so on?

Sorry if my questions seem too obvious, but I'm kind of new to the Streaming
API, and thank you in advance!



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-ingestion-using-a-Flink-TCP-Server-tp7134.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message