Return-Path: Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: (qmail 6014 invoked from network); 28 Apr 2010 20:44:13 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 28 Apr 2010 20:44:13 -0000 Received: (qmail 58830 invoked by uid 500); 28 Apr 2010 20:44:13 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 58672 invoked by uid 500); 28 Apr 2010 20:44:13 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 58660 invoked by uid 99); 28 Apr 2010 20:44:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Apr 2010 20:44:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Apr 2010 20:44:10 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o3SKhmOM009600 for ; Wed, 28 Apr 2010 20:43:49 GMT Message-ID: <12959471.6031272487428958.JavaMail.jira@thor> Date: Wed, 28 Apr 2010 16:43:48 -0400 (EDT) From: "Scott Chen (JIRA)" To: mapreduce-dev@hadoop.apache.org Subject: [jira] Created: (MAPREDUCE-1739) Collecting CPU and memory usage for MapReduce jobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Collecting CPU and memory usage for MapReduce jobs -------------------------------------------------- Key: MAPREDUCE-1739 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1739 Project: Hadoop Map/Reduce Issue Type: New Feature Reporter: Scott Chen Assignee: Scott Chen MAPREDUCE-220 collects CPU and memory usage for each task. We can aggregate them to get the information per job. Such information can be used for scheduling, profiling or charging the users based on the resource they consumed. Here are some information that should be useful: 1. Total CPU cycles (# of giga-cycles) 2. Total Memory occupied time (GB-sec) 3. Maximum peak memory on one task (GB) 4. Maximum peak CPU on one task (GHz) Thoughts? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.