kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mayur Patil (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6450) Kafka Transaction with auto-commit=false, showing transaction log as a consumer lag
Date Tue, 16 Jan 2018 15:16:01 GMT
Mayur Patil created KAFKA-6450:
----------------------------------

             Summary: Kafka Transaction with auto-commit=false, showing transaction log as
a consumer lag 
                 Key: KAFKA-6450
                 URL: https://issues.apache.org/jira/browse/KAFKA-6450
             Project: Kafka
          Issue Type: Bug
          Components: consumer
    Affects Versions: 1.0.0
         Environment: Mac and Linux
            Reporter: Mayur Patil


We posted a message to topic with transaction. For testing purposes we are using single message.
Offset incremented by 2, 1 for message and 1 for transaction
 
D25SP18BGQ17IM:confluent-4.0.0 mxp8051$ ./bin/kafka-run-class kafka.tools.GetOffsetShell --broker-list
localhost:9092 --topic transaction-test
transaction-test:0:6
 
Pushed another message to same topic with transaction. Offset incremented by 2.
 
D25SP18BGQ17IM:confluent-4.0.0 mxp8051$ ./bin/kafka-run-class kafka.tools.GetOffsetShell --broker-list
localhost:9092 --topic transaction-test
transaction-test:0:8
 
Consumer lag shows 4 when my consumer is down.
 
D25SP18BGQ17IM:confluent-4.0.0 mxp8051$ ./bin/kafka-consumer-groups --bootstrap-server localhost:9092 
--describe  --group transaction
Note: This will not show information about old Zookeeper-based consumers.
 
Consumer group 'transaction' has no active members.
 
TOPIC                          PARTITION  CURRENT-OFFSET  LOG-END-OFFSET 
LAG        CONSUMER-ID                                       HOST 
                         CLIENT-ID
transaction-test               0          4               8       
       4          -    
 
Started the consumer and lag says 1
 
D25SP18BGQ17IM:confluent-4.0.0 mxp8051$ ./bin/kafka-consumer-groups --bootstrap-server localhost:9092 
--describe  --group transaction
Note: This will not show information about old Zookeeper-based consumers.
 
TOPIC                          PARTITION  CURRENT-OFFSET  LOG-END-OFFSET 
LAG        CONSUMER-ID                                       HOST 
                         CLIENT-ID
transaction-test               0          7               8       
       1          consumer-1-7a792d01-f3df-4e33-9ccc-636f8110ba38   /[172.22.52.231|http://172.22.52.231/] 
               consumer-1

Please see google group discussion for the same at [#https://groups.google.com/d/msg/confluent-platform/IQKd3BKgvYw/hkS1hgiYAQAJ]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message