giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Yost <>
Subject Re: How to output into multiple files through a GiraphJob
Date Thu, 19 Jun 2014 12:02:39 GMT
Hi Ferenc,

I have an Giraph job that outputs from the Computation class as opposed to
the MasterCompute because I need to maintain alot of state within
VertexValues as opposed to Aggregators.  This is one way of outputting
results as multiple files.  I am assuming that you want to scope output
files per sub-graph groupings of vertices, of course. :)


On Thu, Jun 19, 2014 at 4:02 AM, Ferenc Béres <> wrote:

> Hi Everyone,
> Currently I'm working on an ALS implementation in giraph 1.1.0 and I would
> like to output the values of the vertices into multiple output files, but I
> could not figure it out how to do it.
> I found that in Hadoop it can be done by using *org.apache.hadoop.mapreduce.lib.output.MultipleOutputs<KEYOUT,VALUEOUT>,
> *but it didn't work with the GiraphJob.
> Is it possible to output into multiple files by configuring the GiraphJob,
> or there is an other way?
> I would appreciate any idea in this matter.
> Thank you,
> Ferenc Béres

View raw message