kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-8338) Improve consumer offset expiration logic to take subscription into account
Date Wed, 08 May 2019 18:48:00 GMT
Gwen Shapira created KAFKA-8338:
-----------------------------------

             Summary: Improve consumer offset expiration logic to take subscription into account
                 Key: KAFKA-8338
                 URL: https://issues.apache.org/jira/browse/KAFKA-8338
             Project: Kafka
          Issue Type: Improvement
            Reporter: Gwen Shapira


Currently, we expire consumer offsets for a group after the group is considered gone.

There is a case where the consumer group still exists, but is now subscribed to different
topics. In that case, the offsets of the old topics will never expire and if lag is monitored,
the monitors will show ever-growing lag on those topics. 

We need to improve the logic to expire the consumer offsets if the consumer group didn't subscribe
to specific topics/partitions for enough time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message