flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hicken, Jan" <Jan.Hic...@ottogroup.com>
Subject Serialization in Operator Chaining
Date Thu, 09 Nov 2017 12:57:09 GMT
Hi folks,

I have a question regarding the serialization in Flink's operator
chaining:

Consider these two map functions: Map1<String, T> and Map2<T, String>

As I haven't disabled operator chaining in the environment, these two
functions will be chained into one operator when executing my job.

The thing is, that the serialization for objects of type T is quite
expensive and I'd like to avoid that as much as possible. Does Flink
actually serialize these objects under the hood even if the functions
run in the same operator? If so, is it possible to disable the
serialization somehow?

Kind regards,
Jan
Mime
View raw message