giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mirko Kämpf <mirko.kae...@cloudera.com>
Subject Using the RandomEdge ... & RandomVertex InputFormat
Date Mon, 04 Nov 2013 09:57:28 GMT
Hello,

I try to use the RandomInputFormat. My giraph-job is submitted via the
following command:

hadoop jar giraph-ex.jar org.apache.giraph.GiraphRunner -Dgiraph.zkList=
127.0.0.1:2181 -libjars giraph-core.jar
org.apache.giraph.examples.SimpleShortestPathsVertex
-eif org.apache.giraph.io.formats.PseudoRandomEdgeInputFormat
-vif org.apache.giraph.io.formats.PseudoRandomVertexInputFormat
-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat
-op /user/cloudera/goutput/shortestpaths_rand_$NOW -w 1
-ca giraph.pseudoRandomInputFormat.edgesPerVertex=10

but I get the following exception:

 13/11/04 01:28:54 INFO utils.ConfigurationUtils: Setting custom argument
[giraph.pseudoRandomInputFormat.edgesPerVertex] to [10] in
GiraphConfiguration
13/11/04 01:28:54 INFO utils.ConfigurationUtils: No input path for vertex
data was specified. Ensure your InputFormat does not require one.
13/11/04 01:28:54 INFO utils.ConfigurationUtils: No input path for edge
data was specified. Ensure your InputFormat does not require one.
Exception in thread "main" java.lang.IllegalArgumentException:
checkClassTypes: Edge value types don't match, vertex - class
org.apache.hadoop.io.FloatWritable, vertex input format - class
org.apache.hadoop.io.DoubleWritable
 at
org.apache.giraph.job.GiraphConfigurationValidator.verifyVertexInputFormatGenericTypes(GiraphConfigurationValidator.java:245)
at
org.apache.giraph.job.GiraphConfigurationValidator.validateConfiguration(GiraphConfigurationValidator.java:122)
 at
org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:154)
at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

I think that I have not all required command line parameters set. But the
problem is, I can not find any docu, which explains how to run giraph with
random networks, generated on the fly.
The job runs with the tiny_graph.txt file (and appropriate parameters) but
nit with the random format.



Could anybody please help me to find out how to use the *random graph* and
the *watts strogatz model*
which are mentioned by Claudio in this mail:
*http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3COF4E9A3736.19E56FE9-ON85257BFF.000B4243-85257BFF.000D865A@us.ibm.com%3E
<http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3COF4E9A3736.19E56FE9-ON85257BFF.000B4243-85257BFF.000D865A@us.ibm.com%3E>*

Can I use the RandomVertex and the RandomEdgeInputFormat to build random
graphs on the fly?

Thanks a lot in advance.

Best wishes
Mirko

Mime
View raw message