hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-98) The JobTracker's count of the number of running maps and reduces is wrong
Date Thu, 23 Mar 2006 19:34:20 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-98?page=all ]

Owen O'Malley updated HADOOP-98:

    Attachment: task-counter.patch

This patch consolidate all of the places where status was put in to or out of the taskTrackers
status map, so that
the counts of maps and reduces are maintained consistently. 

I also added the cluster status to the webapp so that you can get a quick view of how busy
the cluster is.

> The JobTracker's count of the number of running maps and reduces is wrong
> -------------------------------------------------------------------------
>          Key: HADOOP-98
>          URL: http://issues.apache.org/jira/browse/HADOOP-98
>      Project: Hadoop
>         Type: Bug
>   Components: mapred
>     Versions: 0.1
>     Reporter: Owen O'Malley
>     Assignee: Owen O'Malley
>      Fix For: 0.1
>  Attachments: task-counter.patch
> When a heatbeat comes in from a task tracker, the job tracker just adds the number of
currently running maps and reduces. The jobs from the previous heartbear are never subtracted.
This causes the scheduling to misjudge the "loading" levels of the task trackers.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message