giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khaled Ammar <khaled.am...@gmail.com>
Subject Re: InMemoryVertex Format(s)
Date Wed, 03 Jun 2015 18:02:51 GMT
Thank you Sergey,

This is exactly what I am looking for. I would like to run multiple
computation classes following each other, such that each computation class
will execute until convergence.

I think may be the GiraphJob class may help. Can I use setComputationClass
to change the computation class in the configuration object then construct
a new GiraphJob and run it? I am not certain when exactly all vertex and
edge data are going to be deleted from memory.

Thanks,
-Khaled


*setComputationClass
<https://giraph.apache.org/apidocs/org/apache/giraph/conf/GiraphConfiguration.html#setComputationClass(java.lang.Class)>*

, but I am not certain how to pass multiple computation classes there.



On Wed, Jun 3, 2015 at 1:34 PM, Sergey Edunov <edunov@gmail.com> wrote:

> Hi Khaled,
>
> As far as I know, InMemory input and output formats are only used in test
> cases.
> Can you elaborate more on why do you want to use I/O formats? You can use
> different computation classes within one application and you don't need to
> do I/O between them. All intermediate results can be kept in vertex and
> edge data.
>
> Regards,
> Sergey Edunov
>
> On Tue, Jun 2, 2015 at 12:46 PM, Khaled Ammar <khaled.ammar@gmail.com>
> wrote:
>
>> Hi all,
>>
>> There are InMemory input and output format for giraph. These could be
>> useful when a specific computation should be executed until convergence and
>> then another computation is needed. Instead of writing intermediate results
>> to HDFS and read it again, InMemoryVertex format sounds very convenient.
>> However, I could not figure out how to use it in a proper Computation or
>> GiraphBenchmark class.
>>
>> I appreciate if any one can share his/her experience using this format.
>>
>> *Link to the InMemoryVertexOutputFormat class :*
>>
>> https://giraph.apache.org/apidocs/org/apache/giraph/io/formats/InMemoryVertexOutputFormat.html#InMemoryVertexOutputFormat()
>>
>> --
>> Thanks,
>> -Khaled
>>
>
>


-- 
Thanks,
-Khaled

Mime
View raw message