flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: iterative processing
Date Wed, 18 Jun 2014 10:57:41 GMT
Yes, I think you can few graphs and sparse matrices very similar.

Flink can do graphs (and sparse matrices) quite well. It has support for
"stateful" iterations what help a lot with graphs. There are also some
custom operators that allow you to write code in a similar form as the GAS
(gather apply scatter) pattern that power-graph implements. Have a look at
the examples here:

  -
https://github.com/apache/incubator-flink/blob/master/stratosphere-addons/spargel/src/main/java/eu/stratosphere/spargel/java/examples/SpargelPageRank.java
  -
https://github.com/apache/incubator-flink/blob/master/stratosphere-addons/spargel/src/main/java/eu/stratosphere/spargel/java/examples/SpargelConnectedComponents.java

Stephan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message