flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fabian Hueske (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-8918) Introduce Runtime Filter Join
Date Wed, 14 Mar 2018 11:11:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Fabian Hueske updated FLINK-8918:
    Issue Type: Improvement  (was: Bug)

> Introduce Runtime Filter Join
> -----------------------------
>                 Key: FLINK-8918
>                 URL: https://issues.apache.org/jira/browse/FLINK-8918
>             Project: Flink
>          Issue Type: Improvement
>          Components: Table API &amp; SQL
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Major
>             Fix For: 1.6.0
> Right now, for every record that need to be joined, we need to query both `left stream's
state` and `right stream's state`. I proposal to introduce RF join to reduce the `query count`
of state, which could improve the performance of `stream join`, especially when the joined
rate is low. A simple description for RF join can be found [here|https://www.cloudera.com/documentation/enterprise/5-9-x/topics/impala_runtime_filtering.html]
(even though it not for stream join original, but we can easily refer it to `stream join`).

This message was sent by Atlassian JIRA

View raw message