Return-Path: Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: (qmail 52141 invoked from network); 1 Oct 2010 03:21:05 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Oct 2010 03:21:05 -0000 Received: (qmail 36838 invoked by uid 500); 1 Oct 2010 03:21:05 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 36517 invoked by uid 500); 1 Oct 2010 03:21:03 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 36509 invoked by uid 99); 1 Oct 2010 03:21:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Oct 2010 03:21:01 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Oct 2010 03:20:55 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o913KXs8011591 for ; Fri, 1 Oct 2010 03:20:33 GMT Message-ID: <7857711.491161285903233742.JavaMail.jira@thor> Date: Thu, 30 Sep 2010 23:20:33 -0400 (EDT) From: "Greg Roelofs (JIRA)" To: mapreduce-dev@hadoop.apache.org Subject: [jira] Resolved: (MAPREDUCE-529) Code to create the UI display string for queues in the Capacity Scheduler needs to be synchronized, and needs to better update its information MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Roelofs resolved MAPREDUCE-529. ------------------------------------ Resolution: Fixed Resolving fixed per previous comment (via HADOOP-6980 patch). Please reopen and update if necessary. > Code to create the UI display string for queues in the Capacity Scheduler needs to be synchronized, and needs to better update its information > ---------------------------------------------------------------------------------------------------------------------------------------------- > > Key: MAPREDUCE-529 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-529 > Project: Hadoop Map/Reduce > Issue Type: Bug > Reporter: Vivek Ratan > > There are a couple of problems with _SchedulingInfo.toString()_, the code which creates the UI display string for a queue: > * it needs synchronized access to the _QueueSchedulingInfo_ object, as this same object can be updated by the reclaim-capacity thread, and during a heartbeat. > * the code directly updates its count of running map/reduce tasks. this should be done in a better way, perhaps by calling updateQSIObjects(), rather than walking through the data structures directly. It's also not clear that we want to pay the performance penalty of updating the structures. it maybe OK to provide slightly stale info (the 'staleness' is tiny, in a steady-state and large system, where heartbeats are coming in frequently). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.