kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-6184) report a metric of the lag between the consumer offset and the start offset of the log
Date Wed, 08 Nov 2017 08:24:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16243516#comment-16243516
] 

ASF GitHub Bot commented on KAFKA-6184:
---------------------------------------

GitHub user huxihx opened a pull request:

    https://github.com/apache/kafka/pull/4191

    KAFKA-6184: report a metric of the lag between the consumer offset ...

    Add `records-lead` and partition-level `{topic}-{partition}.records-lead-min|avg` for
fetcher metrics.
    
    @junrao  Please kindly review. Thanks.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/huxihx/kafka KAFKA-6184

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/kafka/pull/4191.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4191
    
----
commit c51f4221905e7601526c320922ab7d9e2061a4e4
Author: huxihx <huxi_2b@hotmail.com>
Date:   2017-11-08T08:21:17Z

    KAFKA-6184: report a metric of the lag between the consumer offset and the start offset
of the log
    
    Add `records-lead` and partition-level `{topic}-{partition}.records-lead-min|avg` for
fetcher metrics.

----


> report a metric of the lag between the consumer offset and the start offset of the log
> --------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6184
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6184
>             Project: Kafka
>          Issue Type: Improvement
>    Affects Versions: 1.0.0
>            Reporter: Jun Rao
>            Assignee: huxihx
>
> Currently, the consumer reports a metric of the lag between the high watermark of a log
and the consumer offset. It will be useful to report a similar lag metric between the consumer
offset and the start offset of the log. If this latter lag gets close to 0, it's an indication
that the consumer may lose data soon.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message