Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@giraph.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAA8vv09-fyvM8dVD6wbP31SV6ATT7xLmv7q3vm5pn2NDic19UA@mail.gmail.com>
References: 
 <CACEJUc79g8VF3zHFYGK_w-huzrf9pUN05089d2_KBk=f3NrgUQ@mail.gmail.com>
 <CAA8vv09-fyvM8dVD6wbP31SV6ATT7xLmv7q3vm5pn2NDic19UA@mail.gmail.com>
From: Khaled Ammar <khaled.ammar@gmail.com>
Date: Wed, 3 Jun 2015 14:02:51 -0400
Message-ID: 
 <CACEJUc7=eC6FzEdmPXVMRk4ytL0q_MJvB8q1vFkW0zwBZeL-rw@mail.gmail.com>
Subject: Re: InMemoryVertex Format(s)
To: user@giraph.apache.org
Content-Type: multipart/alternative; boundary=089e013d1ea6444d700517a0df85

--089e013d1ea6444d700517a0df85
Content-Type: text/plain; charset=UTF-8

Thank you Sergey,

This is exactly what I am looking for. I would like to run multiple
computation classes following each other, such that each computation class
will execute until convergence.

I think may be the GiraphJob class may help. Can I use setComputationClass
to change the computation class in the configuration object then construct
a new GiraphJob and run it? I am not certain when exactly all vertex and
edge data are going to be deleted from memory.

Thanks,
-Khaled


*setComputationClass
<https://giraph.apache.org/apidocs/org/apache/giraph/conf/GiraphConfiguration.html#setComputationClass(java.lang.Class)>*

, but I am not certain how to pass multiple computation classes there.


On Wed, Jun 3, 2015 at 1:34 PM, Sergey Edunov <edunov@gmail.com> wrote:

> Hi Khaled,
>
> As far as I know, InMemory input and output formats are only used in test
> cases.
> Can you elaborate more on why do you want to use I/O formats? You can use
> different computation classes within one application and you don't need to
> do I/O between them. All intermediate results can be kept in vertex and
> edge data.
>
> Regards,
> Sergey Edunov
>
> On Tue, Jun 2, 2015 at 12:46 PM, Khaled Ammar <khaled.ammar@gmail.com>
> wrote:
>
>> Hi all,
>>
>> There are InMemory input and output format for giraph. These could be
>> useful when a specific computation should be executed until convergence and
>> then another computation is needed. Instead of writing intermediate results
>> to HDFS and read it again, InMemoryVertex format sounds very convenient.
>> However, I could not figure out how to use it in a proper Computation or
>> GiraphBenchmark class.
>>
>> I appreciate if any one can share his/her experience using this format.
>>
>> *Link to the InMemoryVertexOutputFormat class :*
>>
>> https://giraph.apache.org/apidocs/org/apache/giraph/io/formats/InMemoryVertexOutputFormat.html#InMemoryVertexOutputFormat()
>>
>> --
>> Thanks,
>> -Khaled
>>
>
>


-- 
Thanks,
-Khaled

--089e013d1ea6444d700517a0df85
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Thank you Sergey,<div><br></div><div>This is exactly what =
I am looking for. I would like to run multiple computation classes followin=
g each other, such that each computation class will execute until convergen=
ce.=C2=A0</div><div><br></div><div>I think may be the GiraphJob class may h=
elp. Can I use setComputationClass to change the computation class in the c=
onfiguration object then construct a new GiraphJob and run it? I am not cer=
tain when exactly all vertex and edge data are going to be deleted from mem=
ory.</div><div><br></div><div>Thanks,</div><div>-Khaled</div><div><br></div=
><div><br></div><div><strong style=3D"color:rgb(53,56,51);font-family:monos=
pace;font-size:11.8559999465942px;background-color:rgb(238,238,239)"><a hre=
f=3D"https://giraph.apache.org/apidocs/org/apache/giraph/conf/GiraphConfigu=
ration.html#setComputationClass(java.lang.Class)" style=3D"text-decoration:=
none;color:rgb(76,107,135)">setComputationClass</a></strong><br></div><div>=
<br></div><div>, but I am not certain how to pass multiple computation clas=
ses there.=C2=A0</div><div><br></div><div><br></div></div><div class=3D"gma=
il_extra"><br><div class=3D"gmail_quote">On Wed, Jun 3, 2015 at 1:34 PM, Se=
rgey Edunov <span dir=3D"ltr">&lt;<a href=3D"mailto:edunov@gmail.com" targe=
t=3D"_blank">edunov@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D=
"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding=
-left:1ex"><div dir=3D"ltr">Hi Khaled,=C2=A0<div><br></div><div>As far as I=
 know, InMemory input and output formats are only used in test cases.=C2=A0=
</div><div>Can you elaborate more on why do you want to use I/O formats? Yo=
u can use different computation classes within one application and you don&=
#39;t need to do I/O between them. All intermediate results can be kept in =
vertex and edge data.=C2=A0</div><div><br></div><div>Regards,</div><div>Ser=
gey Edunov</div></div><div class=3D"HOEnZb"><div class=3D"h5"><div class=3D=
"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Jun 2, 2015 at 12:46 P=
M, Khaled Ammar <span dir=3D"ltr">&lt;<a href=3D"mailto:khaled.ammar@gmail.=
com" target=3D"_blank">khaled.ammar@gmail.com</a>&gt;</span> wrote:<br><blo=
ckquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #c=
cc solid;padding-left:1ex"><div dir=3D"ltr">Hi all,<div><br></div><div>Ther=
e are InMemory input and output format for giraph. These could be useful wh=
en a specific computation should be executed until convergence and then ano=
ther computation is needed. Instead of writing intermediate results to HDFS=
 and read it again, InMemoryVertex format sounds very convenient. However, =
I could not figure out how to use it in a proper Computation or GiraphBench=
mark class.</div><div><br></div><div>I appreciate if any one can share his/=
her experience using this format.=C2=A0</div><div><br></div><div><b><u>Link=
 to the InMemoryVertexOutputFormat class :</u></b>=C2=A0</div><div><a href=
=3D"https://giraph.apache.org/apidocs/org/apache/giraph/io/formats/InMemory=
VertexOutputFormat.html#InMemoryVertexOutputFormat()" target=3D"_blank">htt=
ps://giraph.apache.org/apidocs/org/apache/giraph/io/formats/InMemoryVertexO=
utputFormat.html#InMemoryVertexOutputFormat()</a><span><font color=3D"#8888=
88"><br clear=3D"all"><div><br></div>-- <br><div>Thanks,<div>-Khaled</div><=
/div>
</font></span></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>=
<div class=3D"gmail_signature">Thanks,<div>-Khaled</div></div>
</div>

--089e013d1ea6444d700517a0df85--