flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3255) Chaining behavior should not depend on parallelism
Date Mon, 18 Jan 2016 17:38:39 GMT
Stephan Ewen created FLINK-3255:
-----------------------------------

             Summary: Chaining behavior should not depend on parallelism
                 Key: FLINK-3255
                 URL: https://issues.apache.org/jira/browse/FLINK-3255
             Project: Flink
          Issue Type: Bug
          Components: Streaming
    Affects Versions: 1.0.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 0.10.1


Currently, operators are chained more aggressively when the parallelism is one. That makes
debugging tougher as it changes threading behavior.

The benefits are also limited: Real installations where that type of efficiency would be needed
would not run in parallelism 1, or would not use a partitioning/broadcast step there (if explicitly
required to run parallelism 1).

In the future, when we want to allow parallelism to be adjusted dynamically, this will be
even more tricky.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message