kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-3753) Add size() to the StateStore interface for metrics reporting
Date Thu, 09 Jun 2016 19:07:21 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Guozhang Wang updated KAFKA-3753:
---------------------------------
    Summary: Add size() to the StateStore interface for metrics reporting  (was: Metrics for
StateStores)

> Add size() to the StateStore interface for metrics reporting
> ------------------------------------------------------------
>
>                 Key: KAFKA-3753
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3753
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: Jeff Klukas
>            Assignee: Guozhang Wang
>            Priority: Minor
>              Labels: api
>             Fix For: 0.10.1.0
>
>
> As a developer building a Kafka Streams application, I'd like to have visibility into
what's happening with my state stores. How can I know if a particular store is growing large?
How can I know if a particular store is frequently needing to hit disk?
> I'm interested to know if there are existing mechanisms for extracting this information
or if other people have thoughts on how we might approach this.
> I can't think of a way to provide metrics generically, so each state store implementation
would likely need to handle this separately. Given that the default RocksDBStore will likely
be the most-used, it would be a first target for adding metrics.
> I'd be interested in knowing the total number of entries in the store, the total size
on disk and in memory, rates of gets and puts, and hit/miss ratio for the MemoryLRUCache.
Some of these numbers are likely calculable through the RocksDB API, others may simply not
be accessible.
> Would there be value to the wider community in having state stores register metrics?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message