flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai" <tzuli...@apache.org>
Subject Re: Flink Kafka producer with a topic per message
Date Wed, 07 Dec 2016 10:09:12 GMT

The FlinkKafkaProducers currently support per record topic through the
user-provided serialization schema which has a "getTargetTopic(T element)" method called
for per record,
and also decides the partition the record will be sent to through a custom KafkaPartitioner,
which is also provided 
by the user when creating a FlinkKafkaProducer.

Does this already provide the functionality you’ve mentioned? Or have I misunderstood what
you have in mind?


On December 7, 2016 at 5:55:24 PM, Sanne de Roever (sanne.de.roever@gmail.com) wrote:

The next step would be to determine the impact on the interface of a Sink. Currently a Kafka
sink has one topic, for example:

View raw message