kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6273) Allow names for windowing joins
Date Mon, 27 Nov 2017 17:11:00 GMT
Matthias created KAFKA-6273:

             Summary: Allow names for windowing joins
                 Key: KAFKA-6273
                 URL: https://issues.apache.org/jira/browse/KAFKA-6273
             Project: Kafka
          Issue Type: Improvement
            Reporter: Matthias

Currently, the internal name of a windowing join is generated at runtime using a counter to
ensure uniqueness within a running topology. 

If a topology is changed and redeployed, different names can be generated for the same window.
This can result in lost windowing state without intervention modifying offsets to re-consume
the input topics.


The proposed change would be to add an optional configuration parameter "joinName" to Joined.
If provided, this would be used by KStreamImpl to generate internal names when building a
join. If not provided the existing name generation would be used. (Since this is an opt-in,
optional parameter there would be no impact on existing code.)

This message was sent by Atlassian JIRA

View raw message