kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Babrou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6465) Add a metrics for the number of records per log
Date Mon, 22 Jan 2018 01:55:00 GMT
Ivan Babrou created KAFKA-6465:

             Summary: Add a metrics for the number of records per log
                 Key: KAFKA-6465
                 URL: https://issues.apache.org/jira/browse/KAFKA-6465
             Project: Kafka
          Issue Type: Bug
            Reporter: Ivan Babrou

Currently there are log metrics for:
 * Start offset
 * End offset
 * Size in bytes
 * Number of segments

I propose to add another metric to track number of record batches in the log. This should
provide operators with an idea of how much batching is happening on the producers. Having
this metric in one place seems easier than scraping the metric from each producer.

Having an absolute counter may be infeasible (batches are not assigned sequential IDs), but
gauge should be ok. Average batch size can be calculated as (end offset - start offset) /
number of batches. This will be heavily skewed for logs with long retention, though.

This message was sent by Atlassian JIRA

View raw message