Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 2923 invoked from network); 30 Jun 2009 20:50:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 30 Jun 2009 20:50:59 -0000 Received: (qmail 16875 invoked by uid 500); 30 Jun 2009 20:51:09 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 16852 invoked by uid 500); 30 Jun 2009 20:51:09 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 16842 invoked by uid 99); 30 Jun 2009 20:51:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Jun 2009 20:51:09 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Jun 2009 20:51:07 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 92B49234C004 for ; Tue, 30 Jun 2009 13:50:47 -0700 (PDT) Message-ID: <1476339542.1246395047586.JavaMail.jira@brutus> Date: Tue, 30 Jun 2009 13:50:47 -0700 (PDT) From: "Matei Zaharia (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Resolved: (MAPREDUCE-540) Upate thread in FairScheduler runs too frequently MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved MAPREDUCE-540. ------------------------------------- Resolution: Fixed Assignee: Matei Zaharia Alright, closing the JIRA because it is resolved in MAPREDUCE-551. > Upate thread in FairScheduler runs too frequently > ------------------------------------------------- > > Key: MAPREDUCE-540 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-540 > Project: Hadoop Map/Reduce > Issue Type: Bug > Reporter: Vinod K V > Assignee: Matei Zaharia > > The UpdateThread in FairScheduler runs every 500ms (hardcoded). This proves to be very costly when running large clusters. UpdateThread tries to acquire lock on JT object every that often and so seriously affects HeartBeat processing besides everything else. The update interval should be a function of the cluster size. Or in the minimum it should be configurable and by default should be set to a reasonably high default value. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.