flink-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From g...@apache.org
Subject flink git commit: [hotfix] [gelly] Reduce maximum number of generator blocks
Date Mon, 25 Jul 2016 17:59:13 GMT
Repository: flink
Updated Branches:
  refs/heads/master 177168b2f -> 0360fb968


[hotfix] [gelly] Reduce maximum number of generator blocks

The default maximum akka transfer size is 10 MB. This commit reduces the
number of generator blocks from 2^20 to 2^15 which removes the limit on
graph size. The original limit of one millions blocks was intended to
future-proof scalability.

This is a temporary fix as graph generation will be reworked in FLINK-3997.


Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0360fb96
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/0360fb96
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/0360fb96

Branch: refs/heads/master
Commit: 0360fb968378b3439c9c8724e5f3183de06d3c80
Parents: 177168b
Author: Greg Hogan <code@greghogan.com>
Authored: Mon Jul 25 11:24:10 2016 -0400
Committer: Greg Hogan <code@greghogan.com>
Committed: Mon Jul 25 13:58:21 2016 -0400

----------------------------------------------------------------------
 .../flink/graph/generator/random/AbstractGeneratorFactory.java     | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/flink/blob/0360fb96/flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/generator/random/AbstractGeneratorFactory.java
----------------------------------------------------------------------
diff --git a/flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/generator/random/AbstractGeneratorFactory.java
b/flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/generator/random/AbstractGeneratorFactory.java
index 3bb904e..fc9e1ba 100644
--- a/flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/generator/random/AbstractGeneratorFactory.java
+++ b/flink-libraries/flink-gelly/src/main/java/org/apache/flink/graph/generator/random/AbstractGeneratorFactory.java
@@ -35,7 +35,7 @@ implements RandomGenerableFactory<T> {
 	// A large computation will run in parallel but blocks are generated on
 	// and distributed from a single node. This limit should be greater
 	// than the maximum expected parallelism.
-	public static final int MAXIMUM_BLOCK_COUNT = 1 << 20;
+	public static final int MAXIMUM_BLOCK_COUNT = 1 << 15;
 
 	// This should be sufficiently large relative to the cost of instantiating
 	// and initializing the random generator and sufficiently small relative to


Mime
View raw message