flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Gevay (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-7685) CompilerException: "Bug: Logic for branching plans (non-tree plans) has an error, and does not track the re-joining of branches correctly"
Date Mon, 25 Sep 2017 14:18:10 GMT
Gabor Gevay created FLINK-7685:
----------------------------------

             Summary: CompilerException: "Bug: Logic for branching plans (non-tree plans)
has an error, and does not track the re-joining of branches correctly"
                 Key: FLINK-7685
                 URL: https://issues.apache.org/jira/browse/FLINK-7685
             Project: Flink
          Issue Type: Bug
          Components: Optimizer
            Reporter: Gabor Gevay
            Priority: Minor


A Flink program which reads an input DataSet, creates 64 new DataSets from it, and writes
these to separate files throws the following exception:

{code:java}
Exception in thread "main" org.apache.flink.optimizer.CompilerException: Bug: Logic for branching
plans (non-tree plans) has an error, and does not track the re-joining of branches correctly.
	at org.apache.flink.optimizer.Optimizer.compile(Optimizer.java:491)
	at org.apache.flink.optimizer.Optimizer.compile(Optimizer.java:398)
	at org.apache.flink.client.LocalExecutor.executePlan(LocalExecutor.java:187)
	at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:91)
	at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:921)
	at org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:86)
{code}

Here is some code that reproduces it:
https://github.com/ggevay/flink/tree/compiler-exception-new

Note that it works with less than 64 DataSets.

Also note that with more than 64 DataSets it throws {{CompilerException: Cannot currently
handle nodes with more than 64 outputs}}, which is at least a clear error msg that helps the
user to find a workaround.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message