giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sebastian Schelter <...@apache.org>
Subject Re: IntIntNullTextInputFormat problem
Date Mon, 03 Feb 2014 16:30:13 GMT
What types does the vertex class that you use in your computation require?

On 02/03/2014 05:28 PM, Alexander Frolov wrote:
> On Mon, Feb 3, 2014 at 8:20 PM, Sebastian Schelter <ssc@apache.org> wrote:
>
>> Hi Alexander,
>>
>> what do you use as type for your vertex ids? It looks that you are trying
>> to use longs, while IntIntNullTextInputFormat only provides ints, that
>> could be the error.
>>
>> --sebastian
>>
>>
> I also thought so, but I could not understand why it regard it as long.
> I just use  -vif org.apache.giraph.io.formats.IntIntNullTextInputFormat
> -vip /user/hduser/input/test -vof
>
> and file consists only of two lines:
>
> [hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop dfs -cat
> /user/hduser/input/test
> 0 1
> 1 0
>
> I dont know any other means to specify type of vertex ids.
>
>
>>
>> On 02/03/2014 05:06 PM, Alexander Frolov wrote:
>>
>>> Hello,
>>>
>>> I am trying to load data in from file in IntIntNullTextInputFormat. But I
>>> get is the following message:
>>>
>>>
>>>
>>> [hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop jar
>>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-
>>> SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner
>>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>>> org.apache.giraph.io.formats.IntIntNullTextInputFormat -vip
>>> /user/hduser/input/test -vof
>>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>>> /user/hduser/output/amazon-shortestpaths -w 1
>>>
>>> 14/02/03 19:46:08 INFO utils.ConfigurationUtils: No edge input format
>>> specified. Ensure your InputFormat does not require one.
>>> 14/02/03 19:46:08 INFO utils.ConfigurationUtils: No edge output format
>>> specified. Ensure your OutputFormat does not require one.
>>> Exception in thread "main" java.lang.IllegalArgumentException:
>>> checkClassTypes: vertex index types not assignable, computation - class
>>> org.apache.hadoop.io.LongWritable, VertexInputFormat - class
>>> org.apache.hadoop.io.IntWritable
>>> at
>>> org.apache.giraph.job.GiraphConfigurationValidator.checkAssignable(
>>> GiraphConfigurationValidator.java:381)
>>> at
>>> org.apache.giraph.job.GiraphConfigurationValidator.
>>> verifyVertexInputFormatGenericTypes(GiraphConfigurationValidator.
>>> java:226)
>>> at
>>> org.apache.giraph.job.GiraphConfigurationValidator.validateConfiguration(
>>> GiraphConfigurationValidator.java:141)
>>> at
>>> org.apache.giraph.utils.ConfigurationUtils.parseArgs(
>>> ConfigurationUtils.java:214)
>>> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>>> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>>
>>>
>>>
>>>
>>> The input file is here (just for testing):
>>>
>>> [hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop dfs -cat
>>> /user/hduser/input/test
>>> 0 1
>>> 1 0
>>>
>>> Could you please help with this issue?
>>>
>>> Best,
>>>     Alex
>>>
>>>
>>
>


Mime
View raw message