flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: About SerializationSchema/DeserializationSchema's concurrency safety
Date Tue, 11 Jun 2019 15:51:09 GMT

Yes, multiple instances of the same De/SerializationSchema can be executed
in the same JVM.
Regarding 2. I'm not 100%, but would suspect that one
De/SerializationSchema instance handles multiple partitions.
Gordon (in CC) should know this for sure.


Am Mo., 10. Juni 2019 um 05:25 Uhr schrieb Chase Zhang <yun.er.run@gmail.com

> Hi there,
> I'm writing for knowledge about
> SerializationSchema/DeserializationSchema's concurrency safety.
> The problem is, I've implemented my own
> KafkaSerializationSchema/KafkaDeserializationKafka which I have added some
> internal state and object cache as to avoid heavy object(memory)
> allocation. My question is, if the two classes are safe in the following
> two situations:
> 1. Multiple sub-tasks are running in the same JVM.
> 2. One sub-task is outputting to multiple Kafka partitions.
> Will there be shared instance (which lead to unsafe concurrency) or each
> sub-task/thread will have its own instance (safe)?

View raw message