flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3146) Expose the Kafka consumer lag as a metric in the web interface for Kafka 0.8.x
Date Wed, 24 Aug 2016 09:18:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15434565#comment-15434565
] 

Robert Metzger commented on FLINK-3146:
---------------------------------------

FLINK-4186 is related, as it exposes the current read offset through Flink's metrics.
External systems can use that to determine the lag.

> Expose the Kafka consumer lag as a metric in the web interface for Kafka 0.8.x
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-3146
>                 URL: https://issues.apache.org/jira/browse/FLINK-3146
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Robert Metzger
>
> Right now the Kafka consumer is not reporting any metrics to the web frontend.
> For the Kafka 0.9.0.0 I'll probably use the metrics reported by Kafka, for Kafka 0.8.
we need to manually request the current ("latest") offset and compare it to the last read
offset.
> I've added this JIRA to see how many Flink users are interested in this. If you want
this feature, please comment into the JIRA!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message