flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Join two kafka topics to do CEP
Date Thu, 27 Apr 2017 16:47:58 GMT
Hi,

Here is my test but it does not work as data arrives i have to re-run, can 
anyone help me please ? 
I think you meant to sent some code snippet? Either way, some code snippet would probably
help in understanding what you’re trying to achieve :)

You mentioned "re-run and no data”, so one thing that I could probably point out now: the
Kafka consumer will commit offsets back to Kafka / ZK for the consumer group (“group.id”)
you’re currently using. So, if in your tests you simply restarting the job, make sure you’re
using different consumer groups if you want to read previous data in the topics.

Cheers,
Gordon


On 28 April 2017 at 12:20:17 AM, tarek26 (tarek.khal.letaief@gmail.com) wrote:

I want to do join between two kafka topics (Data, Rules) in one Datastream.  

In fact the two datastream must have the same id to make the join.  
Event are the data coming from the sensors  
Rules contains the rules that we will check with CEP  
Here is my test but it does not work as data arrives i have to re-run, can  
anyone help me please ?  





--  
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Join-two-kafka-topics-to-do-CEP-tp12865.html
 
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
 

Mime
View raw message