Mailing-List: contact user-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@giraph.apache.org
Received-SPF: pass (athena.apache.org: domain of soozandjohnyost@gmail.com
 designates 209.85.219.49 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACXXjO=sy=Yb3+A-jbtK7VpunAcvLq7Wht5uudh0YMBG22OCjg@mail.gmail.com>
References: 
 <CACXXjO=sy=Yb3+A-jbtK7VpunAcvLq7Wht5uudh0YMBG22OCjg@mail.gmail.com>
Date: Thu, 19 Jun 2014 08:02:39 -0400
Message-ID: 
 <CA+nrXZa-M=WvS_Cja+oDATv93R1JsQBQa0-b68UNd5P38Bc3Ug@mail.gmail.com>
Subject: Re: How to output into multiple files through a GiraphJob
From: John Yost <soozandjohnyost@gmail.com>
To: user@giraph.apache.org
Content-Type: multipart/alternative; boundary=089e0112cb30482aea04fc2f27da

--089e0112cb30482aea04fc2f27da
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Ferenc,

I have an Giraph job that outputs from the Computation class as opposed to
the MasterCompute because I need to maintain alot of state within
VertexValues as opposed to Aggregators.  This is one way of outputting
results as multiple files.  I am assuming that you want to scope output
files per sub-graph groupings of vertices, of course. :)

--John


On Thu, Jun 19, 2014 at 4:02 AM, Ferenc B=C3=A9res <ferdzso05@gmail.com> wr=
ote:

> Hi Everyone,
>
> Currently I'm working on an ALS implementation in giraph 1.1.0 and I woul=
d
> like to output the values of the vertices into multiple output files, but=
 I
> could not figure it out how to do it.
>
> I found that in Hadoop it can be done by using *org.apache.hadoop.mapredu=
ce.lib.output.MultipleOutputs<KEYOUT,VALUEOUT>,
> *but it didn't work with the GiraphJob.
>
> Is it possible to output into multiple files by configuring the GiraphJob=
,
> or there is an other way?
>
> I would appreciate any idea in this matter.
>
> Thank you,
> Ferenc B=C3=A9res
>

--089e0112cb30482aea04fc2f27da
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>Hi Ferenc,<br><br></div>I have an Giraph job tha=
t outputs from the Computation class as opposed to the MasterCompute becaus=
e I need to maintain alot of state within VertexValues as opposed to Aggreg=
ators.=C2=A0 This is one way of outputting results as multiple files.=C2=A0=
 I am assuming that you want to scope output files per sub-graph groupings =
of vertices, of course. :)<br>
<br></div>--John<br></div><div class=3D"gmail_extra"><br><br><div class=3D"=
gmail_quote">On Thu, Jun 19, 2014 at 4:02 AM, Ferenc B=C3=A9res <span dir=
=3D"ltr">&lt;<a href=3D"mailto:ferdzso05@gmail.com" target=3D"_blank">ferdz=
so05@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi Everyone,<br><div><br>Cu=
rrently I&#39;m working on an ALS implementation in giraph=20
1.1.0 and I would like to output the values of the vertices into=20
multiple output files, but I could not figure it out how to do it.<br><br>I=
 found that in Hadoop it can be done by using=C2=A0<b>org.apache.hadoop.map=
reduce.lib.output.MultipleOutputs&lt;KEYOUT,VALUEOUT&gt;, </b>but it didn&#=
39;t work with the GiraphJob.<br>


<br>Is it possible to output into multiple files by configuring the GiraphJ=
ob, or there is an other way?<br><br>I would appreciate any idea in this ma=
tter.<br><br>Thank you,<br>Ferenc B=C3=A9res</div></div>
</blockquote></div><br></div>

--089e0112cb30482aea04fc2f27da--