giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kammer, John" <KAMM...@bit-sys.com>
Subject Trying to run SimpleShortestPathsVertex example in Eclipse.
Date Tue, 15 Jan 2013 17:08:08 GMT
Hello,
   Still rather new to Giraph and Hadoop but trying to research and learn the software.

   Am trying to get the SimpleShortestPathsVertex in the examples directory to run from within
Eclipse. I would swear that it ran and produced results once last week, but have been unable
to get the results output from the code since. If I am reading this output correctly it appears
that the application is not (currently) reading the input data, although I have no idea why
that would be the case.

   Input args:
    /home/hduser/Downloads/shortestPathsInputGraph/
    /home/hduser/Downloads/shortestPathsOutputGraph
    1
    1

The three files in the input directory are as follows:
part-m-00001  part-m-00002  part-m-00003
and contain:
[10,4500,[[11,2000]]]
[11,5500,[[12,1100]]]
[12,6600,[[13,1200]]]
[13,7800,[[14,1300]]]
[14,9100,[[0,1400]]]

[5,1000,[[6,500]]]
[6,1500,[[7,600]]]
[7,2100,[[8,700]]]
[8,2800,[[9,800]]]
[9,3600,[[10,900]]]

[0,0,[[1,0]]]
[1,0,[[2,100]]]
[2,100,[[3,200]]]
[3,300,[[4,300]]]
[4,600,[[5,400]]]

Running with the above results in creation of the output directory having an empty file named
_success within. No accompanying  results.

Log messages from the run are as follows:
: 13/01/14 16:44:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
13/01/14 16:44:45 INFO mapred.JobClient: Running job: job_local_0001
13/01/14 16:44:45 INFO util.ProcessTree: setsid exited with exit code 0
13/01/14 16:44:45 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@676c6370
13/01/14 16:44:45 INFO graph.GraphMapper: Distributed cache is empty. Assuming fatjar.
13/01/14 16:44:45 INFO graph.GraphMapper: setup: classpath @ /tmp/hadoop-hduser/mapred/staging/hduser-418008403/.staging/job_local_0001/job.jar
13/01/14 16:44:45 INFO zk.ZooKeeperManager: createCandidateStamp: Made the directory _bsp/_defaultZkManagerDir/job_local_0001
13/01/14 16:44:45 INFO zk.ZooKeeperManager: createCandidateStamp: Creating my filestamp _bsp/_defaultZkManagerDir/job_local_0001/_task/bitskammer
0
13/01/14 16:44:45 INFO zk.ZooKeeperManager: getZooKeeperServerList: For task 0, got file 'zkServerList_bitskammer
0 ' (polling period is 3000)
13/01/14 16:44:45 INFO zk.ZooKeeperManager: getZooKeeperServerList: Found [bitskammer, 0]
2 hosts in filename 'zkServerList_bitskammer 0 '
13/01/14 16:44:45 INFO graph.GraphMapper: cleanup: Starting for UNKNOWN
13/01/14 16:44:45 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is done. And is in
the process of commiting
13/01/14 16:44:46 INFO mapred.JobClient:  map 0% reduce 0%
13/01/14 16:44:48 INFO mapred.LocalJobRunner: setup: Setting up Zookeeper manager.
13/01/14 16:44:48 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' done.
13/01/14 16:44:49 INFO mapred.JobClient:  map 100% reduce 0%
13/01/14 16:44:49 INFO mapred.JobClient: Job complete: job_local_0001
13/01/14 16:44:49 INFO mapred.JobClient: Counters: 12
13/01/14 16:44:49 INFO mapred.JobClient:   File Output Format Counters
13/01/14 16:44:49 INFO mapred.JobClient:     Bytes Written=0
13/01/14 16:44:49 INFO mapred.JobClient:   File Input Format Counters
13/01/14 16:44:49 INFO mapred.JobClient:     Bytes Read=0
13/01/14 16:44:49 INFO mapred.JobClient:   FileSystemCounters
13/01/14 16:44:49 INFO mapred.JobClient:     FILE_BYTES_READ=5138685
13/01/14 16:44:49 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=5212576
13/01/14 16:44:49 INFO mapred.JobClient:   Map-Reduce Framework
13/01/14 16:44:49 INFO mapred.JobClient:     Map input records=1
13/01/14 16:44:49 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0
13/01/14 16:44:49 INFO mapred.JobClient:     Spilled Records=0
13/01/14 16:44:49 INFO mapred.JobClient:     Total committed heap usage (bytes)=60162048
13/01/14 16:44:49 INFO mapred.JobClient:     CPU time spent (ms)=0
13/01/14 16:44:49 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0
13/01/14 16:44:49 INFO mapred.JobClient:     SPLIT_RAW_BYTES=44
13/01/14 16:44:49 INFO mapred.JobClient:     Map output records=0



Any help would be appreciated.

Is there by any chance a tutorial anywhere on how to build your own Giraph application? I've
been reading through source code but feel like I've started somewhere in the middle and can
never find the starting place - just going around in circles. I could really use a "start-here"
reference.

In any event, thanks for any and all help!
[https://mail.google.com/mail/images/cleardot.gif]

Mime
View raw message