kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Roesler (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7368) Support joining Windowed KTables
Date Fri, 31 Aug 2018 18:30:00 GMT
John Roesler created KAFKA-7368:
-----------------------------------

             Summary: Support joining Windowed KTables
                 Key: KAFKA-7368
                 URL: https://issues.apache.org/jira/browse/KAFKA-7368
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: John Roesler


Currently, there is no good way to join two `KTable<Windowed<K>, V>`, aka windowed
KTables.

They are KTable, so they have a `join` operator available, but it currently will use a regular
KeyValue store instead of a Windowed store, so it will grow without bound and new windows
enter.

One option is to convert both KTables into KStream, and join them (which is a windowed join),
and then convert them back into KTables for further processing, but this is an awkward way
to accomplish an apparently straightforward task.

It should instead be possible to directly support it, but the trick will be to make it impossible
to accidentally use a window store for normal (aka non-windowed) KTables.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message