flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vasiliki Kalavri <vasilikikala...@gmail.com>
Subject Re: store and retrieve Graph object
Date Wed, 25 Nov 2015 16:16:04 GMT
Hi Stefane,

let me know if I understand the problem correctly. The vertex values are
POJOs that you're somehow inferring from the edge list and this value
creation is what takes a lot of time? Since a graph is just a set of 2
datasets (vertices and edges), you could store the values to disk and have
a custom input format to read them into datasets. Would that work for you?


On 25 November 2015 at 15:09, Stefanos Antaris <antaris.stefanos@gmail.com>

> Hi to all,
> i am working on a project with Gelly and i need to create a graph with
> billions of nodes. Although i have the edge list, the node in the Graph
> needs to be a POJO object, the construction of which takes long time in
> order to finally create the final graph. Is it possible to store the Graph
> object as a file and retrieve it whenever i want to run an experiment?
> Thanks,
> Stefanos

View raw message