kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-5000) Framework should log some progress information regularly to assist in troubleshooting
Date Sat, 01 Apr 2017 18:24:41 GMT
Gwen Shapira created KAFKA-5000:
-----------------------------------

             Summary: Framework should log some progress information regularly to assist in
troubleshooting
                 Key: KAFKA-5000
                 URL: https://issues.apache.org/jira/browse/KAFKA-5000
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
            Reporter: Gwen Shapira


We get many questions of the type:
"I started a connector, it doesn't seem to make any progress, I don't know what to do"

I think that periodic "progress reports" on the worker logs may help. 

We have the offset commit message: "INFO WorkerSinkTask{id=cassandra-sink-connector-0} Committing
offsets (org.apache.kafka.connect.runtime.WorkerSinkTask:244)"

But I think we'd also want to know: topic, partition, offsets, how many rows were read from
source/kafka and how many were successfully written.

This will help determine if there is any progress being made and whether some partitions are
"stuck" for some reason.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message