giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Shaposhnik <ro...@shaposhnik.org>
Subject Re: GIRAPH 1.1.0 - Example Does not work
Date Wed, 26 Nov 2014 00:54:19 GMT
Have you tried running it via the giraph cmd line entry point?

As in:
   $ HADOOP_HOME=XXX
   $ HADOOP_CONF_DIR=YYY
   $ PATH=$GIRAPH_HOME/bin:$HADOOP_HOME/bin:$PATH
   $ giraph $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner
org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /user/puneet/input/tiny_graph.txt -vof
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/puneet/output/shortestpaths -w 1

The reason I'm asking is because it seems to be working for me.

Thanks,
Roman.

On Tue, Nov 25, 2014 at 7:35 AM, Puneet Agarwal <puagarwal@yahoo.com> wrote:
> On Hadoop 1.2.1, and Giraph 1.1.0
> I tried following command
>
> hadoop jar
> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-for-hadoop-1.2.1-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner
> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip
> /user/puneet/input/tiny_graph.txt -vof
> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
> /user/puneet/output/shortestpaths -w 1
>
> It fails with following log messages.
> Please help.
>
> Logs in the Worker Thread ( last three lines)
> ================================
>
> 2014-11-25 20:55:13,583 INFO org.apache.giraph.comm.netty.NettyClient:
> waitAllRequests: Finished all requests. MBytes/sec received = 0,
> MBytesReceived = 0, ave received req MBytes = 0, secs waited = 1.41692902E9
> MBytes/sec sent = 0, MBytesSent = 0, ave sent req MBytes = 0, secs waited =
> 1.41692902E9
> 2014-11-25 20:55:13,583 INFO org.apache.giraph.worker.BspServiceWorker:
> setup: Finally loaded a total of (v=5, e=12)
>
>
> Logs in the Master
> ==============
>
> 2014-11-25 20:55:13,445 INFO org.apache.giraph.comm.netty.NettyClient: Using
> Netty without authentication.
> 2014-11-25 20:55:13,452 INFO org.apache.giraph.comm.netty.NettyClient:
> connectAllAddresses: Successfully added 1 connections, (1 total connected) 0
> failed, 0 failures total.
> 2014-11-25 20:55:13,454 INFO org.apache.giraph.partition.PartitionUtils:
> computePartitionCount: Creating 1, default would have been 1 partitions.
> 2014-11-25 20:55:13,491 INFO org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: 0 out of 1 workers finished on superstep -1 on path
> /_hadoopBsp/job_201411251752_0003/_vertexInputSplitDoneDir
> 2014-11-25 20:55:13,493 INFO org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: Waiting on [01hw789772_1]
> 2014-11-25 20:55:13,503 INFO org.apache.giraph.comm.netty.NettyServer:
> start: Using Netty without authentication.
> 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.BspServiceMaster:
> barrierOnWorkerList: Missing chosen workers [Worker(hostname=01hw789772,
> MRtaskID=1, port=30001)] on superstep -1
> 2014-11-25 20:55:13,590 ERROR org.apache.giraph.master.MasterThread:
> masterThread: Master algorithm failed with IllegalStateException
> java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> during input split (currently not supported)
> 	at
> org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
> 	at
> org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
> 	at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
> 2014-11-25 20:55:13,591 FATAL org.apache.giraph.graph.GraphTaskManager:
> uncaughtException: OverrideExceptionHandler on thread
> org.apache.giraph.master.MasterThread, msg =
> java.lang.IllegalStateException: coordinateVertexInputSplits: Worker failed
> during input split (currently not supported), exiting...
> java.lang.IllegalStateException: java.lang.IllegalStateException:
> coordinateVertexInputSplits: Worker failed during input split (currently not
> supported)
> 	at org.apache.giraph.master.MasterThread.run(MasterThread.java:194)
> Caused by: java.lang.IllegalStateException: coordinateVertexInputSplits:
> Worker failed during input split (currently not supported)
> 	at
> org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1483)
> 	at
> org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1650)
> 	at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
> 2014-11-25 20:55:13,591 WARN org.apache.giraph.zk.ZooKeeperManager:
> logZooKeeperOutput: Dumping up to last 100 lines of the ZooKeeper process
> STDOUT and STDERR.
>
> -Puneet
>
>

Mime
View raw message