giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ghufran malik <ghufran1ma...@gmail.com>
Subject Fwd: ConnectedComponents example
Date Mon, 31 Mar 2014 18:04:55 GMT
Hey,

No even after I added the .txt it gets to map 100% then drops back down to
50 and gives me the error:

14/03/31 18:22:56 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
14/03/31 18:22:56 WARN job.GiraphConfigurationValidator: Output format
vertex index type is not known
14/03/31 18:22:56 WARN job.GiraphConfigurationValidator: Output format
vertex value type is not known
14/03/31 18:22:56 WARN job.GiraphConfigurationValidator: Output format edge
value type is not known
14/03/31 18:22:56 INFO job.GiraphJob: run: Since checkpointing is disabled
(default), do not allow any task retries (setting mapred.map.max.attempts =
0, old value = 4)
14/03/31 18:22:57 INFO mapred.JobClient: Running job: job_201403311622_0004
14/03/31 18:22:58 INFO mapred.JobClient:  map 0% reduce 0%
14/03/31 18:23:16 INFO mapred.JobClient:  map 50% reduce 0%
14/03/31 18:23:19 INFO mapred.JobClient:  map 100% reduce 0%
14/03/31 18:33:25 INFO mapred.JobClient:  map 50% reduce 0%
14/03/31 18:33:30 INFO mapred.JobClient: Job complete: job_201403311622_0004
14/03/31 18:33:30 INFO mapred.JobClient: Counters: 6
14/03/31 18:33:30 INFO mapred.JobClient:   Job Counters
14/03/31 18:33:30 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=1238858
14/03/31 18:33:30 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
14/03/31 18:33:30 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
14/03/31 18:33:30 INFO mapred.JobClient:     Launched map tasks=2
14/03/31 18:33:30 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
14/03/31 18:33:30 INFO mapred.JobClient:     Failed map tasks=1


I did a check to make sure the graph was being stored correctly by doing:

ghufran@ghufran:~/Downloads/hadoop-0.20.203.0/bin$ hadoop dfs -cat input/*
1 2
2 1 3 4
3 2
4 2

Mime
View raw message