flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ninad <nni...@gmail.com>
Subject Re: Fink: KafkaProducer Data Loss
Date Tue, 06 Jun 2017 22:35:06 GMT
I tried to build Flink with hadoop cdc 5.8.3 and test it, but it was unable
to come up. When I ran the yarn-session script, it exited with something
like "Can't get the url for job manager". 

I didn't spend much time figuring out what's wrong, and went straight to
Flink 1.3.0. I ran several tests, but saw data loss just once. It's very
hard to reproduce though, with this version. With 1.2.1, it was pretty easy
to reproduce. 

Attaching the logs again. Although in this run, I had kafka logs on DEBUG,
so the files are pretty big.

jmV3.log
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13549/jmV3.log>
  
tmOneV3.log
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13549/tmOneV3.log>
  
tmTwoV3.log
<http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n13549/tmTwoV3.log>
  





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fink-KafkaProducer-Data-Loss-tp11413p13549.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message