flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Kafka and Flink integration
Date Tue, 20 Jun 2017 19:12:57 GMT
Hi!

For general data exchange between systems, it is often good to have a more
standard format.
Being able to evolve the schema of types is very helpful if you evolve the
data pipeline (which almost always happens eventually).

For that reason, Avro and Thrift are very popular for that type of data
exchange.

While they are not as fast as Kryo, they are more "robust" in the sense
that the format is stable.
Kryo is a good choice for intermediate data that is not persistent or at
least not leaving one specific system.

Greetings,
Stephan



On Tue, Jun 20, 2017 at 7:22 PM, nragon <nuno.goncalves@wedotechnologies.com
> wrote:

> Just one more question :).
> Considering I'm producing into kafka with other application other than
> flink, which serializer should i use in order to use pojo types when
> consuming those same messages (now in flink)?
>
>
>
> --
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/Kafka-and-Flink-
> integration-tp13792p13882.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message