Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 99335 invoked from network); 23 Mar 2006 19:34:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 23 Mar 2006 19:34:42 -0000 Received: (qmail 25359 invoked by uid 500); 23 Mar 2006 19:34:42 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 25274 invoked by uid 500); 23 Mar 2006 19:34:41 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 25265 invoked by uid 99); 23 Mar 2006 19:34:41 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Mar 2006 11:34:41 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO ajax.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Mar 2006 11:34:40 -0800 Received: from ajax (localhost.localdomain [127.0.0.1]) by ajax.apache.org (Postfix) with ESMTP id 1A8E46ACAC for ; Thu, 23 Mar 2006 19:34:20 +0000 (GMT) Message-ID: <1135581815.1143142460106.JavaMail.jira@ajax> Date: Thu, 23 Mar 2006 19:34:20 +0000 (GMT) From: "Owen O'Malley (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Updated: (HADOOP-98) The JobTracker's count of the number of running maps and reduces is wrong In-Reply-To: <1952812446.1143101653374.JavaMail.jira@ajax> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N [ http://issues.apache.org/jira/browse/HADOOP-98?page=all ] Owen O'Malley updated HADOOP-98: -------------------------------- Attachment: task-counter.patch This patch consolidate all of the places where status was put in to or out of the taskTrackers status map, so that the counts of maps and reduces are maintained consistently. I also added the cluster status to the webapp so that you can get a quick view of how busy the cluster is. > The JobTracker's count of the number of running maps and reduces is wrong > ------------------------------------------------------------------------- > > Key: HADOOP-98 > URL: http://issues.apache.org/jira/browse/HADOOP-98 > Project: Hadoop > Type: Bug > Components: mapred > Versions: 0.1 > Reporter: Owen O'Malley > Assignee: Owen O'Malley > Fix For: 0.1 > Attachments: task-counter.patch > > When a heatbeat comes in from a task tracker, the job tracker just adds the number of currently running maps and reduces. The jobs from the previous heartbear are never subtracted. This causes the scheduling to misjudge the "loading" levels of the task trackers. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira