flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-788) Enable combiner for Reduce with Broadcast Variable
Date Wed, 25 Nov 2015 10:44:11 GMT

    [ https://issues.apache.org/jira/browse/FLINK-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026589#comment-15026589
] 

Chesnay Schepler commented on FLINK-788:
----------------------------------------

i tried propagating the withBroadcastSet() call to the preceding operation, but it still failed
saying there is no broadcastvariable with that name. Does a chained operator not share it's
RuntimeContext with the head of the chain?

> Enable combiner for Reduce with Broadcast Variable
> --------------------------------------------------
>
>                 Key: FLINK-788
>                 URL: https://issues.apache.org/jira/browse/FLINK-788
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: GitHub Import
>            Priority: Minor
>              Labels: github-import
>             Fix For: pre-apache
>
>
> If the `ReduceFunction` uses a broadcast variable, we can currently not execute the combiner
side of the function. The reason is that the combiner is inserted dynamically and has no access
to the broadcast variable.
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/788
> Created by: [StephanEwen|https://github.com/StephanEwen]
> Labels: 
> Created at: Mon May 12 03:01:18 CEST 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message