kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Lu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7300) Add Fetcher fetch-error-rate and fetch-error-total metrics
Date Thu, 16 Aug 2018 06:17:00 GMT
Kevin Lu created KAFKA-7300:
-------------------------------

             Summary: Add Fetcher fetch-error-rate and fetch-error-total metrics 
                 Key: KAFKA-7300
                 URL: https://issues.apache.org/jira/browse/KAFKA-7300
             Project: Kafka
          Issue Type: New Feature
          Components: clients, consumer, metrics
            Reporter: Kevin Lu
            Assignee: Kevin Lu


The KafkaConsumer is a complex client that requires many different components to function
properly. When a consumer fails, it can be difficult to identify the root cause and which
component failed (ConsumerCoordinator, Fetcher, ConsumerNetworkClient, etc).

 

This aims to improve the monitoring and detection of KafkaConsumer’s Fetcher component.

 

Fetcher will send a fetch request for each node that the consumer has assigned partitions
for.

 

This fetch request may fail under the following cases:
 * Intermittent network issues (goes to onFailure)
 * Node sent an invalid full/incremental fetch response (FetchSessionHandler’s handleResponse
returns false)
 * FetchSessionIdNotFound
 * InvalidFetchSessionEpochException

 

These cases are logged, but it would be valuable to provide a corresponding metric that allows
for monitoring and alerting.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message