kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (KAFKA-5386) [Kafka Streams] - custom name for state-store change-log topic
Date Mon, 24 Jul 2017 15:40:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098591#comment-16098591
] 

Matthias J. Sax edited comment on KAFKA-5386 at 7/24/17 3:39 PM:
-----------------------------------------------------------------

Well. With regard to ACL, you can still know the names of the changelog topics: They follow
the pattern {{<application.id>-<storeName>-changelog}} -- thus, as long as you
specify a store name for each `builder.table()` and count/reduce/aggregate and joins, you
would know the changelog topic names and could adjust the ACL accordingly. (only if you omit
a store name, Streams generates one).

ATM, this feature request does not seem to be high priority. It always depends how many people
ask for it. Of course, we are more than happy if anybody picks this up :) I guess, we would
need a KIP though as this change impacts the public API.


was (Author: mjsax):
Well. With regard to ACL, you can still know the names of the changelog topics: They follow
the pattern `<application.id>-<storeName>-changelog` -- thus, as long as you specify
a store name for each `builder.table()` and count/reduce/aggregate and joins, you would know
the changelog topic names and could adjust the ACL accordingly. (only if you omit a store
name, Streams generates one).

ATM, this feature request does not seem to be high priority. It always depends how many people
ask for it. Of course, we are more than happy if anybody picks this up :) I guess, we would
need a KIP though as this change impacts the public API.

> [Kafka Streams] - custom name for state-store change-log topic
> --------------------------------------------------------------
>
>                 Key: KAFKA-5386
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5386
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>    Affects Versions: 0.10.2.1
>            Reporter: Bart Vercammen
>              Labels: needs-kip
>
> Currently, when working with Kafka backed state stores in Kafka Streams, these log compacted
topics are given a hardcoded name :  _my.app.id-storename-changelog_
> {noformat}    public static String storeChangelogTopic(String applicationId, String storeName)
{
>         return applicationId + "-" + storeName + STATE_CHANGELOG_TOPIC_SUFFIX;
>     }{noformat}
> It would be nice if somehow I would be able to override this functionality and provide
the topic-name myself when creating the state-store.
> Any comments?
> Would it be OK to submit a PR for this?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message