giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexandros Daglis <alexandros.dag...@epfl.ch>
Subject Re: Problem running PageRank Example
Date Fri, 19 Apr 2013 11:05:34 GMT
Hello Claudio,

The log says:

2013-04-19 12:50:40,109 FATAL org.apache.giraph.graph.GraphMapper:
uncaughtException: OverrideExceptionHandler on thread
org.apache.giraph.graph.MasterThread, msg = generateVertexInputSplits: Got
IOException, exiting...
java.lang.IllegalStateException: generateVertexInputSplits: Got IOException
    at
org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:268)
    at
org.apache.giraph.graph.BspServiceMaster.createInputSplits(BspServiceMaster.java:568)
    at
org.apache.giraph.graph.BspServiceMaster.createVertexInputSplits(BspServiceMaster.java:633)
    at org.apache.giraph.graph.MasterThread.run(MasterThread.java:102)
Caused by: java.io.IOException: No input paths specified in job
    at
org.apache.giraph.io.GiraphFileInputFormat.listStatus(GiraphFileInputFormat.java:191)
    at
org.apache.giraph.io.GiraphFileInputFormat.listVertexStatus(GiraphFileInputFormat.java:251)
    at
org.apache.giraph.io.GiraphFileInputFormat.getVertexSplits(GiraphFileInputFormat.java:322)
    at
org.apache.giraph.io.TextVertexInputFormat.getSplits(TextVertexInputFormat.java:61)
    at
org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:266)
    ... 3 more
2013-04-19 12:50:40,112 INFO org.apache.giraph.zk.ZooKeeperManager: run:
Shutdown hook started.
2013-04-19 12:50:40,113 WARN org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Forced a shutdown hook kill of the ZooKeeper
process.
2013-04-19 12:50:40,432 INFO org.apache.zookeeper.ClientCnxn: Unable to
read additional data from server sessionid 0x13e21eac5320000, likely server
has closed socket, closing socket connection and attempting reconnect
2013-04-19 12:50:40,432 INFO org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: ZooKeeper process exited with 143 (note that 143
typically means killed).

My input file is in the hdfs and apparently there is no problem with the
paths, as the output directory is created.

Best,
Alexandros


On 19 April 2013 01:56, Claudio Martella <claudio.martella@gmail.com> wrote:

> what do the logs say?
>
>
> On Thu, Apr 18, 2013 at 9:04 PM, Alexandros Daglis <
> alexandros.daglis@epfl.ch> wrote:
>
>> Hello everybody,
>>
>> it's been a while since I last ran the PageRank example. Back then, there
>> was no GiraphRunner, and the example cound be executed directly. Now, I am
>> trying to test something but I cannot manage to make the example work. I
>> use the following command:
>>
>> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>> org.apache.giraph.GiraphRunner
>> org.apache.giraph.examples.SimplePageRankVertex
>> -if org.apache.giraph.io.JsonLongDoubleFloatDoubleVertexInputFormat -w 1
>> -ip JSON_input -of
>> org.apache.giraph.io.JsonLongDoubleFloatDoubleVertexOutputFormat -op
>> outputJSON
>>
>> The map phase proceeds up to 50% and then it freezes.
>> If I use 2 workers it freezes at 66%, with 3 workers at 75% etc.
>>
>> Anyone has any idea about what might be causing the problem?
>>
>> Thanks a lot in advance,
>> Alexandros
>>
>
>
>
> --
>    Claudio Martella
>    claudio.martella@gmail.com
>

Mime
View raw message