kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yeva Byzek (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-5869) SMT to select Kafka topic based on field in message key or value
Date Mon, 11 Sep 2017 21:02:00 GMT
Yeva Byzek created KAFKA-5869:
---------------------------------

             Summary: SMT to select Kafka topic based on field in message key or value
                 Key: KAFKA-5869
                 URL: https://issues.apache.org/jira/browse/KAFKA-5869
             Project: Kafka
          Issue Type: New Feature
          Components: KafkaConnect
            Reporter: Yeva Byzek


For a given source connector, it would be useful to be able to dynamically determine the Kafka
topic to write to based on a field in the message key or value. 

The topic name can be:

(a) derived from the field, e.g.
{noformat}
"topic-${field}"
{noformat}

or

(b) branch on the field, e.g.

{noformat}
"topic1" if ${field}=x
"topic2" if ${field}=y
{noformat}


Workaround: create a custom SMT, that generates a new record to the desired topic



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message