flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From otherwise777 <wou...@onzichtbaar.net>
Subject Retrieving values from a dataset of datasets
Date Mon, 14 Nov 2016 19:44:07 GMT
Hey There,

I'm trying to calculate the betweenness in a graph with Flink and Gelly, the
way I tried this was by calculating the shortest path from every node to the
rest of the nodes. This results in a Dataset of vertices which all have
Datasets of their own with all the other vertices and their paths. 

Next i used the Reduce function on the inner DataSets so every inner DataSet
has 1 value.

Now I have a DataSet of DataSets with 1 value each, but how do i efficiently
transform this into a a single DataSet with values? I can do a mapping on
the DataSet and use collect(), but i think that would be very costly





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Retrieving-values-from-a-dataset-of-datasets-tp10108.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message