giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexander Frolov <alexndr.fro...@gmail.com>
Subject Re: IntIntNullTextInputFormat problem
Date Mon, 03 Feb 2014 16:28:18 GMT
On Mon, Feb 3, 2014 at 8:20 PM, Sebastian Schelter <ssc@apache.org> wrote:

> Hi Alexander,
>
> what do you use as type for your vertex ids? It looks that you are trying
> to use longs, while IntIntNullTextInputFormat only provides ints, that
> could be the error.
>
> --sebastian
>
>
I also thought so, but I could not understand why it regard it as long.
I just use  -vif org.apache.giraph.io.formats.IntIntNullTextInputFormat
-vip /user/hduser/input/test -vof

and file consists only of two lines:

[hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop dfs -cat
/user/hduser/input/test
0 1
1 0

I dont know any other means to specify type of vertex ids.


>
> On 02/03/2014 05:06 PM, Alexander Frolov wrote:
>
>> Hello,
>>
>> I am trying to load data in from file in IntIntNullTextInputFormat. But I
>> get is the following message:
>>
>>
>>
>> [hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop jar
>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-
>> SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner
>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>> org.apache.giraph.io.formats.IntIntNullTextInputFormat -vip
>> /user/hduser/input/test -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/hduser/output/amazon-shortestpaths -w 1
>>
>> 14/02/03 19:46:08 INFO utils.ConfigurationUtils: No edge input format
>> specified. Ensure your InputFormat does not require one.
>> 14/02/03 19:46:08 INFO utils.ConfigurationUtils: No edge output format
>> specified. Ensure your OutputFormat does not require one.
>> Exception in thread "main" java.lang.IllegalArgumentException:
>> checkClassTypes: vertex index types not assignable, computation - class
>> org.apache.hadoop.io.LongWritable, VertexInputFormat - class
>> org.apache.hadoop.io.IntWritable
>> at
>> org.apache.giraph.job.GiraphConfigurationValidator.checkAssignable(
>> GiraphConfigurationValidator.java:381)
>> at
>> org.apache.giraph.job.GiraphConfigurationValidator.
>> verifyVertexInputFormatGenericTypes(GiraphConfigurationValidator.
>> java:226)
>> at
>> org.apache.giraph.job.GiraphConfigurationValidator.validateConfiguration(
>> GiraphConfigurationValidator.java:141)
>> at
>> org.apache.giraph.utils.ConfigurationUtils.parseArgs(
>> ConfigurationUtils.java:214)
>> at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>> at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>
>>
>>
>>
>> The input file is here (just for testing):
>>
>> [hduser@localhost ~]$ $HADOOP_HOME/bin/hadoop dfs -cat
>> /user/hduser/input/test
>> 0 1
>> 1 0
>>
>> Could you please help with this issue?
>>
>> Best,
>>    Alex
>>
>>
>

Mime
View raw message