flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From HungChang <unicorn.bana...@gmail.com>
Subject Re: Using Spargel's FilterOnVerices gets stuck.
Date Wed, 18 Feb 2015 19:53:26 GMT
Thank you for your reply.

The dataset:
The 1MB dataset is 38831 nodes and 99565 edges which doesn't get stuck.
The 30MB dataset is 1,134,890 nodes and 2,987,624 edges which gets stuck.

Our code works like the following logic:

do{

filteredGraph = graph.run(algorithm);

// Get sub-graph for next iteration, where the code gets stuck with 30MB
dataset
filteredGraph = filteredGraph.filterOnVertices(new FilterVertex());

}(while filteredGraph.hasNode())


filter function is as follow
-------------------------------------------------------------------------------------------------------
public static final class FilterVertex implements
			FilterFunction<Tuple4&lt;Integer, Integer, Integer, Integer>> {

		@Override
		public boolean filter(Tuple4<Integer, Integer, Integer, Integer> value)
				throws Exception {
			return value.f0 == -1;
		}
	}



--
View this message in context: http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble.com/Using-Spargel-s-FilterOnVerices-gets-stuck-tp743p745.html
Sent from the Apache Flink (Incubator) User Mailing List archive. mailing list archive at
Nabble.com.

Mime
View raw message