giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmet Emre Aladağ <aladage...@gmail.com>
Subject Re: Problem in running giraph program
Date Tue, 05 Nov 2013 12:00:25 GMT
It says no EdgeInputFormat is given. So you might have forgotten to give
edge list?
In the code it says:

JsonLongDoubleFloatDoubleVertexInputFormat

  * VertexInputFormat that features <code>long</code> vertex ID's,
  * <code>double</code> vertex values and <code>float</code>
  * out-edge weights, and <code>double</code> message types,
  *  specified in JSON format.

So giving an EdgeInputFormat and an edge input may make it work.


On Tue, Nov 5, 2013 at 12:22 PM, Jyoti Yadav <rao.jyoti26yadav@gmail.com>wrote:

> Hi Suman..
> In earlier posts,you detailed about how to execute our own giraph job in 4
> steps..
> I successsfully completed 3 steps.
>
> I gave the following command .
>
>
> bin/hadoop jar
> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsComputation1 -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
> -vip /user/hduser/graph_input/graph.txt  -vof
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/hduser/graph_output1/shortestpaths -w 1
>
> Warning: $HADOOP_HOME is deprecated.
>
> 13/11/05 15:28:22 INFO utils.ConfigurationUtils: No edge input format
> specified. Ensure your InputFormat does not require one.
> 13/11/05 15:28:22 INFO utils.ConfigurationUtils: No edge output format
> specified. Ensure your OutputFormat does not require one.
> 13/11/05 15:28:22 INFO job.GiraphJob: run: Since checkpointing is disabled
> (default), do not allow any task retries (setting mapred.map.max.attempts =
> 0, old value = 4)
> 13/11/05 15:28:33 INFO job.GiraphJob: run: Tracking URL:
> http://hdfsmaster:50030/jobdetails.jsp?jobid=job_201311050424_0001
> 13/11/05 15:29:20 INFO
> job.HaltApplicationUtils$DefaultHaltInstructionsWriter:
> writeHaltInstructions: To halt after next superstep execute:
> 'bin/halt-application --zkServer localhost:22181 --zkNode
> /_hadoopBsp/job_201311050424_0001/_haltComputation'
> 13/11/05 15:29:20 INFO mapred.JobClient: Running job: job_201311050424_0001
> 13/11/05 15:29:21 INFO mapred.JobClient:  map 50% reduce 0%
> 13/11/05 15:39:07 INFO mapred.JobClient: Job complete:
> job_201311050424_0001
> 13/11/05 15:39:07 INFO mapred.JobClient: Counters: 5
> 13/11/05 15:39:07 INFO mapred.JobClient:   Job Counters
> 13/11/05 15:39:07 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=614204
> 13/11/05 15:39:07 INFO mapred.JobClient:     Total time spent by all
> reduces waiting after reserving slots (ms)=0
> 13/11/05 15:39:07 INFO mapred.JobClient:     Total time spent by all maps
> waiting after reserving slots (ms)=0
> 13/11/05 15:39:07 INFO mapred.JobClient:     Launched map tasks=2
> 13/11/05 15:39:07 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
>
>
>
> Here above screenful of  output i got.No output file is created...Only log
> file is created..
>
> Any help is really appreciated...
>
> Thanks
>
> Jyoti
>
>
>
> On Sun, Oct 27, 2013 at 8:16 PM, suman bharadwaj <suman.dna@gmail.com>wrote:
>
>> Hi Jyoti,
>>
>> Even I'm new to this and i'm no expert. But this is how i made it work.
>> Note, This might not be the best way to run the job. I'm not sure :)
>>
>> But here you go,
>>
>> *Step 1*: I place my own giraph code containing vertex.compute in
>> *$GIRAPH_HOME/*
>> *giraph-examples/src/main/java/org/apache/giraph/examples/<yourFile.java>*.
>> Note, I added this line to the my vertex giraph java file.
>> *"package org.apache.giraph.examples;"*
>>
>> *Step 2*: Then I went to *$GIRAPH_HOME/**giraph-examples/* directory and
>> executed the following command *"mvn compile"*.
>>
>> *Step 3*: Not sure if this step is needed. But give it a try. I exported
>> the
>> *giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar* which
>> is present in target directory to hadoop classpath.
>>
>> *Step 4*: Ran the below command and job ran successfully.
>>
>> *"hadoop jar
>> giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner org.apache.giraph.examples.MyMaximumValue
>> -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/MaxInput.txt -of
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/graphout/test7/ -w 1"*
>>
>>
>> It worked fine for me. Hopefully it will work for you as well.
>>
>>
>> Regards,
>> Suman Bharadwaj S
>>
>>
>>
>> On Sun, Oct 27, 2013 at 6:33 PM, Jyoti Yadav <rao.jyoti26yadav@gmail.com>wrote:
>>
>>> Hi ..
>>> I want to run my own giraph program. I made some modification to already
>>> existiing SimpleShortestPathsComputation program.
>>>
>>> I compiled it and created a jar file.
>>> I gave following command.
>>>
>>>  bin/hadoop jar
>>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner -libjars /home/hduser/sp2.jar
>>> SimpleShortestPathsComputation*1* -vif
>>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>>> -vip /user/hduser/sp_input/tiny_graph.txt -vof
>>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>>> /user/hduser/sp_output7/shortestpaths -w 1
>>>
>>>
>>> I am getting following error..
>>>
>>>
>>> Exception in thread "main" java.lang.ClassNotFoundException:
>>> SimpleShortestPathsComputation1
>>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>>     at java.security.AccessController.doPrivileged(Native Method)
>>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>>     at java.lang.Class.forName0(Native Method)
>>>     at java.lang.Class.forName(Class.java:190)
>>>     at
>>> org.apache.giraph.utils.ConfigurationUtils.handleComputationClass(ConfigurationUtils.java:470)
>>>     at
>>> org.apache.giraph.utils.ConfigurationUtils.populateGiraphConfiguration(ConfigurationUtils.java:453)
>>>     at
>>> org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:207)
>>>     at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>>>     at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>     at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>     at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>     at java.lang.reflect.Method.invoke(Method.java:606)
>>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>>
>>>
>>> Please help me out..I am badly tangled..
>>>
>>> Thanks
>>> Jyoti
>>>
>>>
>>>
>>
>


-- 
Ahmet Emre Aladağ

Mime
View raw message