flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Fink: KafkaProducer Data Loss
Date Thu, 13 Jul 2017 07:33:41 GMT
Hi Ninad & Piotr,

AFAIK, when this issue was reported, Ninad was using 09.
FLINK-6996 only affects Flink Kafka Producer 010, so I don’t think that’s the cause here.

Code to reproduce this would definitely be helpful here, thanks. If you prefer to provide
that privately, that would also be fine.


On 13 July 2017 at 4:13:07 PM, Piotr Nowojski (piotr@data-artisans.com) wrote:


I’m not sure how relevant is this, but recently I have found and fixed a bug, that in certain
conditions was causing data losses for all of the FlinkKafkaProducers in Flink:


Namely on checkpoint “flush” method was not being called. It should be fixed in Flink
1.3.2 and 1.4 releases.


On Jul 12, 2017, at 7:32 PM, ninad <nninad@gmail.com> wrote:

Hey guys, any update on this? If needed I can attach our code.

View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fink-KafkaProducer-Data-Loss-tp11413p14224.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

View raw message