kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kevin Lu <lu.ke...@berkeley.edu>
Subject [DISCUSS] KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics
Date Thu, 16 Aug 2018 06:40:43 GMT
Hi friends! :)

I believe we currently have a gap in KafkaConsumer metrics for errors since
the KafkaConsumer is complex and are many places where things can go wrong.
Currently, these failures are logged and certain ones can be inferred from
the existing metrics (ex. heartbeat-rate).

This KIP seeks to improve monitoring and alerting for the consumer by
providing metrics for the Fetcher class.

https://cwiki.apache.org/confluence/display/KAFKA/KIP-356%3A+Add+KafkaConsumer+fetch-error-rate+and+fetch-error-total+metrics

There are also a few other places in the Fetcher where errors may happen
(parsing completed fetches, offset requests, etc) but it may be appropriate
to monitor them in separate metrics.

Any thoughts?

Thanks!

Regards,
Kevin

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message