giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sai Ganesh Muthuraman" <saiganesh...@gmail.com>
Subject Re: RELATION BETWEEN THE NUMBER OF GIRAPH WORKERS AND THE PROBLEM SIZE
Date Sat, 25 Feb 2017 06:24:53 GMT
Hi,

I used one worker per node and that worked for smaller files. When the file size was more
than 25 MB, I got this strange exception. I tried using 2 nodes and 3 nodes, the result is
the same.

**ERROR** [org.apache.giraph.master.MasterThread] master.BspServiceMaster (BspServiceMaster.java:barrierOnWorkerList(1415))
- barrierOnWorkerList:**Missing chosen workers**[Worker(hostname=comet-10-68.sdsc.edu, MRtaskID=2,
port=30002)] on superstep 2

**FATAL** [org.apache.giraph.master.MasterThread] master.BspServiceMaster (BspServiceMaster.java:getLastGoodCheckpoint(1291))
- getLastGoodCheckpoint: No last good checkpoints can be found, killing the job.

java.io.FileNotFoundException: File hdfs://comet-10-33.ibnet:54310/user/saiganes/_bsp/_checkpoints/giraph_yarn_application_1488002378889_0001
does not exist.

        at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:697)

        at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:105)


Mime
View raw message