giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: Using the RandomEdge ... & RandomVertex InputFormat
Date Mon, 04 Nov 2013 11:03:18 GMT
Every inputformat has a IVE signature with the type of vertex index, value
and edge value. They have to match the signature of the computation class
you're using.
In your case, the inputformat generates vertices with Long ids, while the
computation class expects floats.


On Mon, Nov 4, 2013 at 10:57 AM, Mirko Kämpf <mirko.kaempf@cloudera.com>wrote:

> Hello,
>
> I try to use the RandomInputFormat. My giraph-job is submitted via the
> following command:
>
> hadoop jar giraph-ex.jar org.apache.giraph.GiraphRunner -Dgiraph.zkList=
> 127.0.0.1:2181 -libjars giraph-core.jar
> org.apache.giraph.examples.SimpleShortestPathsVertex
> -eif org.apache.giraph.io.formats.PseudoRandomEdgeInputFormat
> -vif org.apache.giraph.io.formats.PseudoRandomVertexInputFormat
> -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat
>  -op /user/cloudera/goutput/shortestpaths_rand_$NOW -w 1
> -ca giraph.pseudoRandomInputFormat.edgesPerVertex=10
>
> but I get the following exception:
>
>  13/11/04 01:28:54 INFO utils.ConfigurationUtils: Setting custom argument
> [giraph.pseudoRandomInputFormat.edgesPerVertex] to [10] in
> GiraphConfiguration
> 13/11/04 01:28:54 INFO utils.ConfigurationUtils: No input path for vertex
> data was specified. Ensure your InputFormat does not require one.
> 13/11/04 01:28:54 INFO utils.ConfigurationUtils: No input path for edge
> data was specified. Ensure your InputFormat does not require one.
> Exception in thread "main" java.lang.IllegalArgumentException:
> checkClassTypes: Edge value types don't match, vertex - class
> org.apache.hadoop.io.FloatWritable, vertex input format - class
> org.apache.hadoop.io.DoubleWritable
>  at
> org.apache.giraph.job.GiraphConfigurationValidator.verifyVertexInputFormatGenericTypes(GiraphConfigurationValidator.java:245)
> at
> org.apache.giraph.job.GiraphConfigurationValidator.validateConfiguration(GiraphConfigurationValidator.java:122)
>  at
> org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:154)
> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>  at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>  at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>
> I think that I have not all required command line parameters set. But the
> problem is, I can not find any docu, which explains how to run giraph with
> random networks, generated on the fly.
> The job runs with the tiny_graph.txt file (and appropriate parameters) but
> nit with the random format.
>
>
>
> Could anybody please help me to find out how to use the *random graph*and the *watts
> strogatz model*
> which are mentioned by Claudio in this mail:
> *http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3COF4E9A3736.19E56FE9-ON85257BFF.000B4243-85257BFF.000D865A@us.ibm.com%3E
> <http://mail-archives.apache.org/mod_mbox/giraph-user/201310.mbox/%3COF4E9A3736.19E56FE9-ON85257BFF.000B4243-85257BFF.000D865A@us.ibm.com%3E>*
>
> Can I use the RandomVertex and the RandomEdgeInputFormat to build random
> graphs on the fly?
>
> Thanks a lot in advance.
>
> Best wishes
> Mirko
>
>


-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
View raw message