kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Bejeck (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5784) Add a sensor for dropped records in window stores
Date Tue, 24 Oct 2017 23:39:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217880#comment-16217880

Bill Bejeck commented on KAFKA-5784:

[~sssanthalingam]  Feel free to assign this to yourself.  As for explaining the context in
more detail, take a look at a window store implementation {{RocksDBWindowStore}} you should
be able to step through some of the code to see what is going on.  After that, if you still
have more questions feel free to leave an additional comment. 

> Add a sensor for dropped records in window stores
> -------------------------------------------------
>                 Key: KAFKA-5784
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5784
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Guozhang Wang
>            Assignee: Bill Bejeck
>              Labels: newbie
> Today when a {{put(record)}} call on a windowed store does not find the corresponding
segment, i.e. its corresponding's window has expired, we simply returns a {{null}} and hence
silently drops it.
> We should consider 1) add log4j entries when it happens, 2) add metrics (we can discuss
whether it should be a processor-node level, or store level sensor) for such cases.

This message was sent by Atlassian JIRA

View raw message