giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: connected components example in giraph 1.0
Date Fri, 04 Oct 2013 12:27:55 GMT
did you try the argument (-vof) i suggested?


On Fri, Oct 4, 2013 at 2:13 PM, Silvio Di gregorio <
silvio.digregorio@gmail.com> wrote:

>
> i've specified  -of
>  org.apache.giraph.io.formats.IdWithValueTextOutputFormat
>
> but the same error was produced
>
> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>         at
> org.apache.giraph.bsp.BspOutputFormat.checkOutputSpecs(BspOutputFormat.java:43)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:984)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:945)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>         at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:945)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:566)
>         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:596)
>         at org.apache.giraph.job.GiraphJob.run(GiraphJob.java:237)
>         at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:94)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>         at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>
>
>
> 2013/10/4 Claudio Martella <claudio.martella@gmail.com>
>
>> Hi,
>>
>> you need to specify the vertex outputformat class (-vof option), e.g.
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat.
>>
>>
>> On Fri, Oct 4, 2013 at 1:06 PM, Silvio Di gregorio <
>> silvio.digregorio@gmail.com> wrote:
>>
>>>
>>> Hi,
>>>
>>> I hope I have sent to the right address.
>>>
>>> i have a graph (directed and unweighted) stored in hdfs like a adjacency
>>> list (140Milions of edges 6Milions of vertex)
>>>
>>> node<tab>neighbors
>>>
>>> 23   2   1    3    4    3
>>>
>>> 1 999 99923 909 .......
>>>
>>> ......
>>>
>>> hadoop version Hadoop 2.0.0-cdh4.3.0 - java 1.6
>>>
>>>
>>> I have executed the giraph-1.0 connected components example, in this
>>> fashion
>>>
>>>> > hadoop jar /usr/local/giraph/giraph-examples/target/giraph-
>>>> examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>>>> org.apache.giraph.GiraphRunner org.apache.giraph.examples.ConnectedComponentsVertex
>>>> -vif org.apache.giraph.io.formats.IntIntNullTextInputFormat -vip
>>>> /user/hdfs/lista_adj_txt -op connectedgiraph --workers 4
>>>
>>>
>>>
>>> and then fail with:
>>>
>>> 13/10/04 09:28:29 INFO utils.ConfigurationUtils: No edge input format
>>> specified. Ensure your InputFormat does not require one.
>>>
>>>
>>>
>>> 13/10/04 09:28:29 INFO utils.ConfigurationUtils: No output format
>>> specified. Ensure your OutputFormat does not require one.
>>>
>>>
>>>
>>> 13/10/04 09:28:30 INFO job.GiraphJob: run: Since checkpointing is
>>> disabled (default), do not allow any task retries (setting
>>> mapred.map.max.attempts = 0, old value = 4)
>>>
>>>
>>>
>>> 13/10/04 09:28:31 WARN mapred.JobClient: Use GenericOptionsParser for
>>> parsing the arguments. Applications should implement Tool for the same.
>>>
>>>
>>>
>>> 13/10/04 09:28:31 INFO mapred.JobClient: Cleaning up the staging area
>>> hdfs://
>>> srv-bigdata-dev-01.int.sose.it:8020/user/hdfs/.staging/job_201309181636_0535
>>>
>>> Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
>>> interface org.apache.hadoop.mapreduce.JobContext, but class was expected
>>>
>>>         at
>>> org.apache.giraph.bsp.BspOutputFormat.checkOutputSpecs(BspOutputFormat.java:43)
>>>
>>>         ......
>>>
>>>
>>>
>>>
>>>
>>> Thanks in advance
>>>
>>>
>>
>>
>> --
>>    Claudio Martella
>>    claudio.martella@gmail.com
>>
>
>


-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
View raw message