beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jingsong Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1393) Update Flink Runner to Flink 1.2.0
Date Tue, 07 Feb 2017 09:43:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855649#comment-15855649
] 

Jingsong Lee commented on BEAM-1393:
------------------------------------

[~aljoscha] I found some APIs changed in Flink 1.2.0.
1.ProcessingTimeService replace registerTimer in StreamingRuntimeContext
2.ManualWatermarkContext move to StreamSourceContexts and become private, we can't use it
to check
3.UnboundedSourceWrapper need use getOperatorState to snapshot instead of OutputStream. (change
the parallelism)
4. GlobalConfiguration.getDynamicProperties() replace GlobalConfiguration. (maybe need deal
with NPE)
5.use KeyedStateBackend<ByteBuffer> instead of AbstractStateBackend.
6.need cast timerService to HeapInternalTimerService to advanceWatermark. (we override processWatermark)
7.side-input data: I have some question. I can understand split/merge of SPLIT_DISTRIBUTE,
but not quite understand the split/merge of BROADCAST. Can you explain it? Or give me some
example? 

> Update Flink Runner to Flink 1.2.0
> ----------------------------------
>
>                 Key: BEAM-1393
>                 URL: https://issues.apache.org/jira/browse/BEAM-1393
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Jingsong Lee
>
> When we update to 1.2.0 we can use the new internal Timer API that is available to Flink
operators: {{InternalTimerService}} and also use broadcast state to store side-input data.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message