giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jyoti Yadav <rao.jyoti26ya...@gmail.com>
Subject Re: Problem in running giraph program
Date Tue, 05 Nov 2013 10:22:32 GMT
Hi Suman..
In earlier posts,you detailed about how to execute our own giraph job in 4
steps..
I successsfully completed 3 steps.

I gave the following command .


bin/hadoop jar
$GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation1 -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/hduser/graph_input/graph.txt  -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/hduser/graph_output1/shortestpaths -w 1

Warning: $HADOOP_HOME is deprecated.

13/11/05 15:28:22 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
13/11/05 15:28:22 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
13/11/05 15:28:22 INFO job.GiraphJob: run: Since checkpointing is disabled
(default), do not allow any task retries (setting mapred.map.max.attempts =
0, old value = 4)
13/11/05 15:28:33 INFO job.GiraphJob: run: Tracking URL:
http://hdfsmaster:50030/jobdetails.jsp?jobid=job_201311050424_0001
13/11/05 15:29:20 INFO
job.HaltApplicationUtils$DefaultHaltInstructionsWriter:
writeHaltInstructions: To halt after next superstep execute:
'bin/halt-application --zkServer localhost:22181 --zkNode
/_hadoopBsp/job_201311050424_0001/_haltComputation'
13/11/05 15:29:20 INFO mapred.JobClient: Running job: job_201311050424_0001
13/11/05 15:29:21 INFO mapred.JobClient:  map 50% reduce 0%
13/11/05 15:39:07 INFO mapred.JobClient: Job complete: job_201311050424_0001
13/11/05 15:39:07 INFO mapred.JobClient: Counters: 5
13/11/05 15:39:07 INFO mapred.JobClient:   Job Counters
13/11/05 15:39:07 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=614204
13/11/05 15:39:07 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
13/11/05 15:39:07 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
13/11/05 15:39:07 INFO mapred.JobClient:     Launched map tasks=2
13/11/05 15:39:07 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0



Here above screenful of  output i got.No output file is created...Only log
file is created..

Any help is really appreciated...

Thanks

Jyoti



On Sun, Oct 27, 2013 at 8:16 PM, suman bharadwaj <suman.dna@gmail.com>wrote:

> Hi Jyoti,
>
> Even I'm new to this and i'm no expert. But this is how i made it work.
> Note, This might not be the best way to run the job. I'm not sure :)
>
> But here you go,
>
> *Step 1*: I place my own giraph code containing vertex.compute in
> *$GIRAPH_HOME/*
> *giraph-examples/src/main/java/org/apache/giraph/examples/<yourFile.java>*.
> Note, I added this line to the my vertex giraph java file.
> *"package org.apache.giraph.examples;"*
>
> *Step 2*: Then I went to *$GIRAPH_HOME/**giraph-examples/* directory and
> executed the following command *"mvn compile"*.
>
> *Step 3*: Not sure if this step is needed. But give it a try. I exported
> the
> *giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar* which
> is present in target directory to hadoop classpath.
>
> *Step 4*: Ran the below command and job ran successfully.
>
> *"hadoop jar
> giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner org.apache.giraph.examples.MyMaximumValue
> -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
> -vip /user/MaxInput.txt -of
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/graphout/test7/ -w 1"*
>
>
> It worked fine for me. Hopefully it will work for you as well.
>
>
> Regards,
> Suman Bharadwaj S
>
>
>
> On Sun, Oct 27, 2013 at 6:33 PM, Jyoti Yadav <rao.jyoti26yadav@gmail.com>wrote:
>
>> Hi ..
>> I want to run my own giraph program. I made some modification to already
>> existiing SimpleShortestPathsComputation program.
>>
>> I compiled it and created a jar file.
>> I gave following command.
>>
>>  bin/hadoop jar
>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner -libjars /home/hduser/sp2.jar
>> SimpleShortestPathsComputation*1* -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/hduser/sp_input/tiny_graph.txt -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/hduser/sp_output7/shortestpaths -w 1
>>
>>
>> I am getting following error..
>>
>>
>> Exception in thread "main" java.lang.ClassNotFoundException:
>> SimpleShortestPathsComputation1
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>     at java.lang.Class.forName0(Native Method)
>>     at java.lang.Class.forName(Class.java:190)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.handleComputationClass(ConfigurationUtils.java:470)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.populateGiraphConfiguration(ConfigurationUtils.java:453)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:207)
>>     at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>>     at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>     at java.lang.reflect.Method.invoke(Method.java:606)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>
>>
>> Please help me out..I am badly tangled..
>>
>> Thanks
>> Jyoti
>>
>>
>>
>

Mime
View raw message