flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-4940) Add Support for Broadcast/Global State
Date Tue, 01 Nov 2016 09:57:58 GMT

     [ https://issues.apache.org/jira/browse/FLINK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aljoscha Krettek updated FLINK-4940:
------------------------------------
    Assignee: Stefan Richter

> Add Support for Broadcast/Global State
> --------------------------------------
>
>                 Key: FLINK-4940
>                 URL: https://issues.apache.org/jira/browse/FLINK-4940
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Streaming
>            Reporter: Aljoscha Krettek
>            Assignee: Stefan Richter
>             Fix For: 1.2.0
>
>
> We need this to support the pattern where you have one input of a two-input operator
keyed and the other input carries messages that should be broadcast to all operator instances.
This other (side) input can contain configuration updates, models, or what have you that are
relevant for all elements in the other stream.
> We should add something akin to {{KeyedStateBackend}} where state is kept by operator.
When checkpointing, we only checkpoint the state of the first operator instance because we
assume the state to be the same across all instances. When restoring we restore the one snapshot
to all operator instances.
> Current thinking is that this global/broadcast state backend should allow access by key
and possibly also iteration over all stored keys.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message