flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2644) State partitioning does not respect the different partitioning of multiple inputs
Date Wed, 09 Sep 2015 12:13:46 GMT
Gyula Fora created FLINK-2644:
---------------------------------

             Summary: State partitioning does not respect the different partitioning of multiple
inputs
                 Key: FLINK-2644
                 URL: https://issues.apache.org/jira/browse/FLINK-2644
             Project: Flink
          Issue Type: Bug
          Components: Streaming
            Reporter: Gyula Fora


Currently state partitioning is only available for one-input stream operators and even for
those, the partitioning will only depend on the first input.

This happens because the keyselector used to extract the partitioning key from each element
is used from the first input stream. We need to make sure that for each input stream the corresponding
key selector is used.

To do this, ctx.nextRecord(record), should be extended by adding a parameter denoting the
index of the input channel which can be used by the partitioner to select the appropriate
key selector.

The same mechanics can be extended to allow state partitioning for TwoInput stream operators
as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message