giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Puneet Agarwal <puagar...@yahoo.com>
Subject Re: GIRAPH 1.1.0 - Example Does not work
Date Wed, 26 Nov 2014 02:41:01 GMT
Here are my system settings:======================
~$ echo $PATH/home/puneet/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/home/puneet/bin:/usr/lib/jvm/java-7-openjdk-amd64/bin:/home/puneet/sw/hadoop/bin:/bin:/home/puneet/sw/apache-ant-1.8.1/bin:.:/home/puneet/sw/Giraph-1.1/giraph/bin
~$ which giraph
/home/puneet/sw/Giraph-1.1/giraph/bin/giraph
~$ which hadoop
/home/puneet/sw/hadoop/bin/hadoop
~$ ls -l /home/puneet/sw/hadoop
lrwxrwxrwx 1 puneet puneet 12 Nov 24 09:30 /home/puneet/sw/hadoop -> hadoop-1.2.1
~$ echo $HADOOP_CONF_DIR 
/home/puneet/sw/hadoop/conf
~$ echo $HADOOP_HOME
/home/puneet/sw/hadoop
I tried your command, and this time it gave another error (details given below).
I just saw the announcement about Giraph-1.1.0I guess this is because of the way I built Giraph-1.1.0,
I used the command given on the website (Quick Start)- 
"mvn package -DskipTests"I did not specify anywhere that I am using Hadoop 1.2.1.Just that
path settings point to it. Has it built the right thing?

Logs and the command you suggested:
=============================
~$ giraph $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/puneet/input/tiny_graph.txt
-vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/puneet/output/shortestpaths
-w 1
No lib directory, assuming dev environment
HADOOP_CONF_DIR=/home/puneet/sw/hadoop/conf
Warning: $HADOOP_HOME is deprecated.

14/11/26 08:02:31 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your
InputFormat does not require one.
14/11/26 08:02:31 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your
OutputFormat does not require one.
Exception in thread "main" java.lang.RuntimeException: class org.apache.giraph.GiraphRunner
not org.apache.giraph.graph.Computation
    at org.apache.hadoop.conf.Configuration.setClass(Configuration.java:931)
    at org.apache.giraph.conf.ClassConfOption.set(ClassConfOption.java:182)
    at org.apache.giraph.conf.GiraphConfiguration.setComputationClass(GiraphConfiguration.java:124)
    at org.apache.giraph.utils.ConfigurationUtils.handleComputationClass(ConfigurationUtils.java:491)
    at org.apache.giraph.utils.ConfigurationUtils.populateGiraphConfiguration(ConfigurationUtils.java:474)
    at org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:215)
    at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:160)

-Puneet 

     On Wednesday, November 26, 2014 6:24 AM, Roman Shaposhnik <roman@shaposhnik.org>
wrote:
   

 Have you tried running it via the giraph cmd line entry point?

As in:
  $ HADOOP_HOME=XXX
  $ HADOOP_CONF_DIR=YYY
  $ PATH=$GIRAPH_HOME/bin:$HADOOP_HOME/bin:$PATH
  $ giraph $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/puneet/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/puneet/output/shortestpaths -w 1

The reason I'm asking is because it seems to be working for me.

Thanks,
Roman.

On Tue, Nov 25, 2014 at 7:35 AM, Puneet Agarwal <puagarwal@yahoo.com> wrote:
> On Hadoop 1.2.1, and Giraph 1.1.0
> I tried following command
>
> hadoop jar
> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip
> /user/puneet/input/tiny_graph.txt -vof
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/puneet/output/shortestpaths -w 1
>
> It fails with following log messages.
> Please help.
>
> Logs in the Worker Thread ( last three lines)
> ================================
>
> 2014-11-25 20:55:13,583 INFO org.apache.giraph.comm.netty.NettyClient:
> waitAllRequests: Finished all requests. MBytes/sec received = 0,
> MBytesReceived = 0, ave received req MBytes = 0, secs waited = 1.41692902E9
> MBytes/sec sent = 0, MBytesSent = 0, ave sent req MBytes = 0, secs waited =
> 1.41692902E9
> 2014-11-25 20:55:13,583 INFO org.apache.giraph.worker.BspServiceWorker:
> setup: Finally loaded a total of (v=5, e=12)
>
>
> Logs in the Master
> ==============
>
> 2014-11-25 20:55:13,445 INFO org.apache.giraph.comm.netty.NettyClient: Using
> Netty without authentication.
> 2014-11-25 20:55:13,452 INFO org.apache.giraph.comm.netty.NettyClient:
> connectAllAddresses: Successfully added 1 connections, (1 total connected) 0
> failed, 0 failures total.
> 2014-11-25 20:55:13,454 INFO org.apache.giraph.partition.PartitionUtils:
> computePartitionCount: Creating 1, default would have been 1 partitions.
> 2014-11-25 20:55:13,491 INFO org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: 0 out of 1 workers finished on superstep -1 on path
> /_hadoopBsp/job_201411251752_0003/_vertexInputSplitDoneDir
> 2014-11-25 20:55:13,493 INFO org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: Waiting on [01hw789772_1]
> 2014-11-25 20:55:13,503 INFO org.apache.giraph.comm.netty.NettyServer:
> start: Using Netty without authentication.
> 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
> MRtaskID=1, port=30001)] on superstep -1
> 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
> masterThread: Master algorithm failed with IllegalStateException
> java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> during input split (currently not supported)
>     at
> org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
>     at
> org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
>     at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
> 2014-11-25 20:55:13,591 FATAL org.apache.giraph.graph.GraphTaskManager:
> uncaughtException: OverrideExceptionHandler on thread
> org.apache.giraph.master.MasterThread, msg =
> java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> during input split (currently not supported), exiting...
> java.lang.IllegalStateException: java.lang.IllegalStateException:
> coordinateVertexInputSplits: Worker failed during input split (currently not
> supported)
>     at org.apache.giraph.master.MasterThread.run(MasterThread.java:194)
> Caused by: java.lang.IllegalStateException: coordinateVertexInputSplits:
> Worker failed during input split (currently not supported)
>     at
> org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
>     at
> org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
>     at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
> 2014-11-25 20:55:13,591 WARN org.apache.giraph.zk.ZooKeeperManager:
> logZooKeeperOutput: Dumping up to last 100 lines of the ZooKeeper process
> STDOUT and STDERR.
>
> -Puneet
>
>


   
Mime
View raw message