giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Unable to run Giraph Example (SimpleShortestPathsVertex) when number of workers > 1
Date Tue, 05 Jun 2012 06:55:12 GMT
Hey Harshit,

How many map slots are configured at each TaskTracker? What is the
reported total Map Task Capacity of your MapReduce cluster (viewed at
the JobTracker)?

On Sat, Jun 2, 2012 at 3:09 PM, Harshit Sharan <hsincredible@gmail.com> wrote:
> Hi,
>
> I recently started working on Haddop. Currently I have created a setup on 3
> machines, where one is the job-tracker and all three are tasktrackers.
> The hadoop is working absolutely fine with the hadoop examples.
> When I ran Giraph eg of SimpleShortestPathsVertex , it worked absolutely
> fine when number of workers=1.
> When I increase the number of workers to 2 or 3 the program hangs up.
>
> I'm using the following command to run the giraph jar :
> hadoop jar
> /home/harshit/Downloads/giraph-0.1.0-incubating-src/target/giraph-0.1-jar-with-dependencies.jar
> org.apache.giraph.examples.SimpleShortestPathsVertex
> -Dgiraph.zkList=master:22181 /user/hduser/giraph/spig
> /user/hduser/giraph/output/spig90/ 6 2
>
> The program sticks here :
> 12/06/02 15:02:36 INFO mapred.JobClient: Running job: job_201206021425_0006
> 12/06/02 15:02:37 INFO mapred.JobClient:  map 0% reduce 0%
> 12/06/02 15:02:54 INFO mapred.JobClient:  map 33% reduce 0%
>
>
> A part of the tasktracker log of machine1 is :
>
> 2012-06-02 15:02:46,899 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201206021425_0006_m_-330406748 given task:
> attempt_201206021425_0006_m_000001_0
> 2012-06-02 15:02:53,848 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201206021425_0006_m_000001_0 0.0% startSuperstep: WORKER_ONLY -
> Attempt=0, Superstep=-1
>
>
> and part of the tasktracker log of machine2 is:
>
> 2012-06-02 15:00:36,960 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201206021425_0006_m_1076001946 given task:
> attempt_201206021425_0006_m_000000_0
> 2012-06-02 15:00:44,124 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201206021425_0006_m_000000_0 1.0% MASTER_ONLY - 0 finished out
> of 2 on superstep -1
> 2012-06-02 15:01:44,215 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201206021425_0006_m_000000_0 1.0% MASTER_ONLY - 0 finished out
> of 2 on superstep -1
>
>
> Please provide any help possible. Am I missing out anything or there is
> some other problem??
>
> Thanks,
> Harshit Sharan



-- 
Harsh J

Mime
View raw message