flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maxim Parkachov <lazy.gop...@gmail.com>
Subject New kafka producer on each checkpoint
Date Mon, 06 Apr 2020 15:16:28 GMT
Hi everyone,

I'm trying to test exactly once functionality with my job under production
load. The job is reading from kafka, using kafka timestamp as event time,
aggregates every minute and outputs to other kafka topic. I use checkpoint
interval 10 seconds.

Everything seems to be working fine, but when I look to the log on INFO
level, I see that with each checkpoint, new kafka producer is created and
then closed again.

1. Is this how it is supposed to work ?
2. Is checkpoint interval 10 second too often ?

Thanks,
Maxim.

Mime
View raw message