flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Streaming data from MongoDB using Flink
Date Thu, 16 Feb 2017 09:43:10 GMT
Hi Pedro!

This is definitely possible, by simply writing a Flink `SourceFunction` that uses MongoDB
clients to fetch the data.
It should be straightforward and works well with MongoDB’s cursor APIs.

Could you explain a bit which part in particular you were stuck with?


On February 16, 2017 at 5:31:39 PM, Pedro Monteiro (pedro.mlmonteiro@gmail.com) wrote:

Good morning,

I am trying to get data from MongoDB to be analysed in Flink.
I would like to know if it is possible to stream data from MongoDB into
Flink. I have looked into Flink's source function to add in the addSource
method of the StreamExecutionEnvironment but I had no luck.
Can anyone help me out?

Pedro Lima Monteiro
View raw message