kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiangjie Qin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-2076) Add an API to new consumer to allow user get high watermark of partitions.
Date Fri, 11 Nov 2016 19:42:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15657963#comment-15657963
] 

Jiangjie Qin commented on KAFKA-2076:
-------------------------------------

[~jeffwidman] The consumer actually are able to get the HW after KIP-79(https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65868090).

I should just close this ticket as solved. :)

> Add an API to new consumer to allow user get high watermark of partitions.
> --------------------------------------------------------------------------
>
>                 Key: KAFKA-2076
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2076
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
>
> We have a use case that user wants to know how far it is behind a particular partition
on startup. Currently in each fetch response, we have high watermark for each partition, we
only keep a global max-lag metric. It would be better that we keep a record of high watermark
per partition and update it on each fetch response. We can add a new API to let user query
the high watermark.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message