flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhen li <lizhenm...@hotmail.com>
Subject share the big data structure between slots
Date Wed, 29 Aug 2018 10:25:03 GMT
Hi all:
    When I broadcast the big config stream,every parallel instance should store the data,
cause waste of the momery and time. Is there some method to make the slots to share the big
data structure within the taskmanager´╝č
Here is the doc:
   By adjusting the number of task slots, users can define how subtasks are isolated from
each other. Having one slot per TaskManager means each task group runs in a separate JVM (which
can be started in a separate container, for example). Having multiple slots means more subtasks
share the same JVM. Tasks in the same JVM share TCP connections (via multiplexing) and heartbeat
messages. They may also share data sets and data structures, thus reducing the per-task overhead.
View raw message