flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karthik Deivasigamani <karthi...@gmail.com>
Subject flink kafka consumer lag
Date Sun, 09 Jul 2017 06:16:22 GMT
Hi,
   I'm using Flink 1.2.1 and FlinkKafkaConsumer09 to read data from
Kafka Server (0.10.1.0). My consumer is able to read and everything
works fine.
But when I use the kafka_consumer_groups.sh command to find the lag
metrics it does not return the lag. Upon reading online I found that
Flink Kafka Consumer uses the low level API and manages the assignment
of partition itself.
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-kafka-group-question-td8185.html

What is the best way to monitor my flink kafka consumer's lag? Does
Flink expose the lag metrics per partition somewhere?

~
Karthik

Mime
View raw message