flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christophe Jolif <cjo...@gmail.com>
Subject "keyed" aggregation
Date Fri, 05 Jan 2018 16:51:22 GMT
Hi all,

I'm sourcing from a Kafka topic, using the key of the Kafka message to key
the stream, then doing some aggregation on the keyed stream.

Now I want to sink back to a different Kafka topic but re-using the same
key. The thing is that my aggregation "lost" the key. Obviously I can make
sure my aggregation function keeps the key, but I find that a bit strange
as it does not relate to aggregation.

Is there a best practice in that domain? How should the key be carried when
moving from a kafka source to sink but doing some aggregation along the way?


View raw message