giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jyoti Yadav <rao.jyoti26ya...@gmail.com>
Subject Re: Problem in running giraph program
Date Sun, 27 Oct 2013 15:41:49 GMT
Thanks Suman for your active reply.
I completed the first step you suggested then I gave a command

mvn compile

it gave the following pageful of error.

[INFO] Scanning for projects...
[INFO]

[INFO]
------------------------------------------------------------------------
[INFO] Building Apache Giraph Examples 1.1.0-SNAPSHOT
[INFO]
------------------------------------------------------------------------
Downloading:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata
org.apache.giraph:giraph-core:1.1.0-SNAPSHOT/maven-metadata.xml from/to
codehausSnapshots (http://snapshots.maven.codehaus.org/maven2): Access
denied to:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/maven-metadata.xml
[WARNING] Failure to transfer
org.apache.giraph:giraph-core:1.1.0-SNAPSHOT/maven-metadata.xml from
http://snapshots.maven.codehaus.org/maven2 was cached in the local
repository, resolution will not be reattempted until the update interval of
codehausSnapshots has elapsed or updates are forced. Original error: Could
not transfer metadata
org.apache.giraph:giraph-core:1.1.0-SNAPSHOT/maven-metadata.xml from/to
codehausSnapshots (http://snapshots.maven.codehaus.org/maven2): Access
denied to:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/maven-metadata.xml
Downloading:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/giraph-core-1.1.0-SNAPSHOT.pom
[WARNING] Failure to transfer
org.apache.giraph:giraph-core:1.1.0-SNAPSHOT/maven-metadata.xml from
http://snapshots.maven.codehaus.org/maven2 was cached in the local
repository, resolution will not be reattempted until the update interval of
codehausSnapshots has elapsed or updates are forced. Original error: Could
not transfer metadata
org.apache.giraph:giraph-core:1.1.0-SNAPSHOT/maven-metadata.xml from/to
codehausSnapshots (http://snapshots.maven.codehaus.org/maven2): Access
denied to:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/maven-metadata.xml
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 2.182s
[INFO] Finished at: Sun Oct 27 21:07:40 IST 2013
[INFO] Final Memory: 12M/87M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal on project giraph-examples: Could not
resolve dependencies for project
org.apache.giraph:giraph-examples:jar:1.1.0-SNAPSHOT: Failed to collect
dependencies for [com.google.guava:guava:jar:12.0 (compile),
com.yammer.metrics:metrics-core:jar:2.2.0 (compile),
commons-cli:commons-cli:jar:1.2 (compile),
commons-collections:commons-collections:jar:3.2.1 (provided),
commons-io:commons-io:jar:2.1 (compile), io.netty:netty:jar:3.5.3.Final
(compile), net.iharder:base64:jar:2.3.8 (compile),
org.apache.zookeeper:zookeeper:jar:3.3.3 (compile),
org.codehaus.jackson:jackson-core-asl:jar:1.8.0 (compile),
org.codehaus.jackson:jackson-mapper-asl:jar:1.8.0 (compile),
org.json:json:jar:20090211 (compile), org.slf4j:slf4j-api:jar:1.7.2
(compile), org.slf4j:slf4j-log4j12:jar:1.7.2 (compile),
org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT (compile),
org.apache.giraph:giraph-core:jar:tests:1.1.0-SNAPSHOT (compile),
junit:junit:jar:4.8 (test), org.mockito:mockito-all:jar:1.8.5 (test),
commons-net:commons-net:jar:3.1 (provided),
org.apache.hadoop:hadoop-core:jar:0.20.203.0 (provided)]: Failed to read
artifact descriptor for org.apache.giraph:giraph-core:jar:1.1.0-SNAPSHOT:
Could not transfer artifact
org.apache.giraph:giraph-core:pom:1.1.0-SNAPSHOT from/to codehausSnapshots (
http://snapshots.maven.codehaus.org/maven2): Access denied to:
http://snapshots.maven.codehaus.org/maven2/org/apache/giraph/giraph-core/1.1.0-SNAPSHOT/giraph-core-1.1.0-SNAPSHOT.pom->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException


Would you suggest me some way to get out of this..
Thanks in advance..
Jyoti



On Sun, Oct 27, 2013 at 8:16 PM, suman bharadwaj <suman.dna@gmail.com>wrote:

> Hi Jyoti,
>
> Even I'm new to this and i'm no expert. But this is how i made it work.
> Note, This might not be the best way to run the job. I'm not sure :)
>
> But here you go,
>
> *Step 1*: I place my own giraph code containing vertex.compute in *
> $GIRAPH_HOME/**
> giraph-examples/src/main/java/org/apache/giraph/examples/<yourFile.java>*.
> Note, I added this line to the my vertex giraph java file.
> *"package org.apache.giraph.examples;"*
>
> *Step 2*: Then I went to *$GIRAPH_HOME/**giraph-examples/* directory and
> executed the following command *"mvn compile"*.
>
> *Step 3*: Not sure if this step is needed. But give it a try. I exported
> the *giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> * which is present in target directory to hadoop classpath.
>
> *Step 4*: Ran the below command and job ran successfully.
>
> *"hadoop jar
> giraph-examples-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner org.apache.giraph.examples.MyMaximumValue
> -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
> -vip /user/MaxInput.txt -of
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/graphout/test7/ -w 1"*
>
>
> It worked fine for me. Hopefully it will work for you as well.
>
>
> Regards,
> Suman Bharadwaj S
>
>
>
> On Sun, Oct 27, 2013 at 6:33 PM, Jyoti Yadav <rao.jyoti26yadav@gmail.com>wrote:
>
>> Hi ..
>> I want to run my own giraph program. I made some modification to already
>> existiing SimpleShortestPathsComputation program.
>>
>> I compiled it and created a jar file.
>> I gave following command.
>>
>>  bin/hadoop jar
>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner -libjars /home/hduser/sp2.jar
>> SimpleShortestPathsComputation*1* -vif
>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>> -vip /user/hduser/sp_input/tiny_graph.txt -vof
>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>> /user/hduser/sp_output7/shortestpaths -w 1
>>
>>
>> I am getting following error..
>>
>>
>> Exception in thread "main" java.lang.ClassNotFoundException:
>> SimpleShortestPathsComputation1
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>>     at java.lang.Class.forName0(Native Method)
>>     at java.lang.Class.forName(Class.java:190)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.handleComputationClass(ConfigurationUtils.java:470)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.populateGiraphConfiguration(ConfigurationUtils.java:453)
>>     at
>> org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:207)
>>     at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>>     at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>     at java.lang.reflect.Method.invoke(Method.java:606)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>
>>
>> Please help me out..I am badly tangled..
>>
>> Thanks
>> Jyoti
>>
>>
>>
>

Mime
View raw message