hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1174) Reducers stuck in 'sort'
Date Wed, 28 Mar 2007 18:32:25 GMT
Reducers stuck in 'sort'
------------------------

                 Key: HADOOP-1174
                 URL: https://issues.apache.org/jira/browse/HADOOP-1174
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.12.2
            Reporter: Arun C Murthy


A couple of reduces seem stuck on a small 20-node cluster in the 'sort' phase for almost an
hour:

TaskTracker logs:
------------------------
2007-03-28 14:13:46,471 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000005_0 0.33333334%
reduce > sort
2007-03-28 14:13:46,478 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000009_0 0.33333334%
reduce > sort
2007-03-28 14:13:47,476 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000005_0 0.33333334%
reduce > sort
2007-03-28 14:13:47,483 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000009_0 0.33333334%
reduce > sort
...
...
...
2007-03-28 15:06:04,376 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000005_0 0.33333334%
reduce > sort
2007-03-28 15:06:04,411 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000009_0 0.33333334%
reduce > sort
2007-03-28 15:06:05,379 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000005_0 0.33333334%
reduce > sort
2007-03-28 15:06:05,414 INFO org.apache.hadoop.mapred.TaskTracker: task_0002_r_000009_0 0.33333334%
reduce > sort


Eventually the JobTracker declared the same TT 'lost' (presumably for no heartbeats):

2007-03-28 15:18:20,341 INFO org.apache.hadoop.mapred.JobTracker: Lost tracker 'tracker_XXX:9020'


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message