kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashok Bala (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6217) Allow consumers to read messages from LEO
Date Thu, 16 Nov 2017 02:48:00 GMT
Ashok Bala created KAFKA-6217:

             Summary: Allow consumers to read messages from LEO
                 Key: KAFKA-6217
                 URL: https://issues.apache.org/jira/browse/KAFKA-6217
             Project: Kafka
          Issue Type: Improvement
          Components: consumer, core
            Reporter: Ashok Bala

we have a use case(real time customer facing application) to support high throughput(reduced
latency) & high volume of transactions through Kafka. During performance testing, we noted
that consumer listening to single partition topics get messages faster than the consumers
listening to replicated partitions. 

Make messages to be visible immediately to consumer rather than waiting for high water mark.
Make change in consumer & core, based on consumer configuration, LEO messages to be visible
to consumer like followers. It is the risk of consumer to lose messages during fail over of
leader for which we are OK.

This message was sent by Atlassian JIRA

View raw message