flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Fink: KafkaProducer Data Loss
Date Tue, 06 Jun 2017 17:20:28 GMT
Hi,

From the logs and the description of your test scenarios where data loss is observed and not
observed, it seems like the differentiating factor here is whether or not the session windows
trigger was first fired when the checkpoint occurred.

It doesn’t however explain the case where your tests pass on a standalone cluster. Have
you also re-tested your scenarios on Cloudera, with Flink built against the Cloudera binaries?


On 6 June 2017 at 4:53:30 PM, ninad (nninad@gmail.com) wrote:

Hi Till,  
Attaching the logs to this post again.  

Thanks.  

jobManager.log  
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13527/jobManager.log>
 
tmOne.log  
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13527/tmOne.log>
 
tmTwo.log  
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13527/tmTwo.log>
 



--  
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fink-KafkaProducer-Data-Loss-tp11413p13527.html
 
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
 

Mime
View raw message