giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khaled Ammar <>
Subject Re: InMemoryVertex Format(s)
Date Wed, 03 Jun 2015 18:02:51 GMT
Thank you Sergey,

This is exactly what I am looking for. I would like to run multiple
computation classes following each other, such that each computation class
will execute until convergence.

I think may be the GiraphJob class may help. Can I use setComputationClass
to change the computation class in the configuration object then construct
a new GiraphJob and run it? I am not certain when exactly all vertex and
edge data are going to be deleted from memory.



, but I am not certain how to pass multiple computation classes there.

On Wed, Jun 3, 2015 at 1:34 PM, Sergey Edunov <> wrote:

> Hi Khaled,
> As far as I know, InMemory input and output formats are only used in test
> cases.
> Can you elaborate more on why do you want to use I/O formats? You can use
> different computation classes within one application and you don't need to
> do I/O between them. All intermediate results can be kept in vertex and
> edge data.
> Regards,
> Sergey Edunov
> On Tue, Jun 2, 2015 at 12:46 PM, Khaled Ammar <>
> wrote:
>> Hi all,
>> There are InMemory input and output format for giraph. These could be
>> useful when a specific computation should be executed until convergence and
>> then another computation is needed. Instead of writing intermediate results
>> to HDFS and read it again, InMemoryVertex format sounds very convenient.
>> However, I could not figure out how to use it in a proper Computation or
>> GiraphBenchmark class.
>> I appreciate if any one can share his/her experience using this format.
>> *Link to the InMemoryVertexOutputFormat class :*
>> --
>> Thanks,
>> -Khaled


View raw message