giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: Problem running PageRank Example
Date Fri, 19 Apr 2013 13:20:52 GMT
What version of giraph are you using?


On Fri, Apr 19, 2013 at 1:05 PM, Alexandros Daglis <
alexandros.daglis@epfl.ch> wrote:

> Hello Claudio,
>
> The log says:
>
> 2013-04-19 12:50:40,109 FATAL org.apache.giraph.graph.GraphMapper:
> uncaughtException: OverrideExceptionHandler on thread
> org.apache.giraph.graph.MasterThread, msg = generateVertexInputSplits: Got
> IOException, exiting...
> java.lang.IllegalStateException: generateVertexInputSplits: Got IOException
>     at
> org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:268)
>     at
> org.apache.giraph.graph.BspServiceMaster.createInputSplits(BspServiceMaster.java:568)
>     at
> org.apache.giraph.graph.BspServiceMaster.createVertexInputSplits(BspServiceMaster.java:633)
>     at org.apache.giraph.graph.MasterThread.run(MasterThread.java:102)
> Caused by: java.io.IOException: No input paths specified in job
>     at
> org.apache.giraph.io.GiraphFileInputFormat.listStatus(GiraphFileInputFormat.java:191)
>     at
> org.apache.giraph.io.GiraphFileInputFormat.listVertexStatus(GiraphFileInputFormat.java:251)
>     at
> org.apache.giraph.io.GiraphFileInputFormat.getVertexSplits(GiraphFileInputFormat.java:322)
>     at
> org.apache.giraph.io.TextVertexInputFormat.getSplits(TextVertexInputFormat.java:61)
>     at
> org.apache.giraph.graph.BspServiceMaster.generateInputSplits(BspServiceMaster.java:266)
>     ... 3 more
> 2013-04-19 12:50:40,112 INFO org.apache.giraph.zk.ZooKeeperManager: run:
> Shutdown hook started.
> 2013-04-19 12:50:40,113 WARN org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: Forced a shutdown hook kill of the ZooKeeper
> process.
> 2013-04-19 12:50:40,432 INFO org.apache.zookeeper.ClientCnxn: Unable to
> read additional data from server sessionid 0x13e21eac5320000, likely server
> has closed socket, closing socket connection and attempting reconnect
> 2013-04-19 12:50:40,432 INFO org.apache.giraph.zk.ZooKeeperManager:
> onlineZooKeeperServers: ZooKeeper process exited with 143 (note that 143
> typically means killed).
>
> My input file is in the hdfs and apparently there is no problem with the
> paths, as the output directory is created.
>
> Best,
> Alexandros
>
>
> On 19 April 2013 01:56, Claudio Martella <claudio.martella@gmail.com>wrote:
>
>> what do the logs say?
>>
>>
>> On Thu, Apr 18, 2013 at 9:04 PM, Alexandros Daglis <
>> alexandros.daglis@epfl.ch> wrote:
>>
>>> Hello everybody,
>>>
>>> it's been a while since I last ran the PageRank example. Back then,
>>> there was no GiraphRunner, and the example cound be executed directly. Now,
>>> I am trying to test something but I cannot manage to make the example work.
>>> I use the following command:
>>>
>>> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner
>>> org.apache.giraph.examples.SimplePageRankVertex
>>> -if org.apache.giraph.io.JsonLongDoubleFloatDoubleVertexInputFormat -w 1
>>> -ip JSON_input -of
>>> org.apache.giraph.io.JsonLongDoubleFloatDoubleVertexOutputFormat -op
>>> outputJSON
>>>
>>> The map phase proceeds up to 50% and then it freezes.
>>> If I use 2 workers it freezes at 66%, with 3 workers at 75% etc.
>>>
>>> Anyone has any idea about what might be causing the problem?
>>>
>>> Thanks a lot in advance,
>>> Alexandros
>>>
>>
>>
>>
>> --
>>    Claudio Martella
>>    claudio.martella@gmail.com
>>
>
>


-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
View raw message