giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Puneet Agarwal <>
Subject Re: GiraphJob Vs InternalVertexRunner
Date Sat, 01 Jun 2013 13:03:15 GMT
Hi Yazan,

This indeed if of great help especially the help command:

"/directory-to-hadoop/bin/hadoop jar/directory-to-giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-
org.apache.giraph.GiraphRunner -h"

But there seems to be some problem in your command because there is no class named "org.apache.giraph.examples.SimpleShortestPathsComputation"

I then looked up in the path "org/apache/giraph/examples/" and found that there is a class
named "org.apache.giraph.examples.SimpleShortestPathsVertex" so I tried this instead of yours.
But this does not work

It gives following error. Any guidance will be helpful

13/06/01 18:28:22 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your
InputFormat does not require one.
13/06/01 18:28:22 WARN job.GiraphConfigurationValidator: Output format vertex index type is
not known
13/06/01 18:28:22 WARN job.GiraphConfigurationValidator: Output format vertex value type is
not known
13/06/01 18:28:22 WARN job.GiraphConfigurationValidator: Output format edge value type is
not known
13/06/01 18:28:22 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not
allow any task retries (setting = 0, old value = 4)
Exception in thread "main" java.lang.IllegalArgumentException: checkLocalJobRunnerConfiguration:
When using LocalJobRunner, you cannot run in split master / worker mode since there is only
1 task at a time!
at org.apache.giraph.job.GiraphJob.checkLocalJobRunnerConfiguration(
at org.apache.giraph.GiraphRunner.main(
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
at java.lang.reflect.Method.invoke(
at org.apache.hadoop.util.RunJar.main(



----- Original Message -----
From: Yazan Boshmaf <>
To:; Puneet Agarwal <>
Sent: Saturday, June 1, 2013 7:59 AM
Subject: Re: GiraphJob Vs InternalVertexRunner

After packaging Giraph (i.e., you can locate the JAR files under
"target" folder in each module), you can run one of the included
examples under /directory-to-giraph/giraph-examples as follows:

/directory-to-hadoop/bin/hadoop jar
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
-vip /dfs-user-direcory/some-input-json -of -op
/dfs-user-direcory/some-output-text -w 1

This runs the SimpleShortestPathsComputation using the input file
/dfs-user-direcory/some-input-json, which has the format [source_id,
source_value, [ [dest_id, edge_weight], ...] ]. It comutes the
shortest paths to all nodes from a given source, which is the first
source_id in the input file. The output file is
/dfs-user-direcory/some-output-text, and its format is "source_id
distance_value". The computation is done using one worker.

You can run he following for more info:

/directory-to-hadoop/bin/hadoop jar
org.apache.giraph.GiraphRunner -h

Hope this helps.


On Fri, May 31, 2013 at 6:07 PM, Puneet Agarwal <> wrote:
> It seems there are two ways to run a Giraph job.
> a) using the class InternalVertexRunner
> b) using the class GiraphJob
> Which one should be used where ?
> Thanks
> Puneet

View raw message