kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Van Laer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6248) Enable configuration of internal topics of Kafka Streams applications
Date Tue, 21 Nov 2017 12:33:00 GMT
Tim Van Laer created KAFKA-6248:
-----------------------------------

             Summary: Enable configuration of internal topics of Kafka Streams applications
                 Key: KAFKA-6248
                 URL: https://issues.apache.org/jira/browse/KAFKA-6248
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Tim Van Laer
            Priority: Minor


In the current implementation of Kafka Streams, it is not possible to set custom configuration
to internal topics (e.g. max.message.bytes, retention.ms...). It would be nice if a developer
can set some specific configuration. 

E.g. if you want to store messages bigger than 1MiB in a state store, you have to alter the
corresponding changelog topic with a max.message.bytes setting. 

The workaround is to create the 'internal' topics upfront using the correct naming convention
so Kafka Streams will use the explicitly defined topics as if they are internal. 
An alternative is to alter the internal topics after the Kafka Streams application is started
and has created its internal topics. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message