Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1329B7B6C for ; Tue, 4 Oct 2011 17:41:58 +0000 (UTC) Received: (qmail 10277 invoked by uid 500); 4 Oct 2011 17:41:57 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 10246 invoked by uid 500); 4 Oct 2011 17:41:57 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 10238 invoked by uid 500); 4 Oct 2011 17:41:57 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 10235 invoked by uid 99); 4 Oct 2011 17:41:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Oct 2011 17:41:57 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Oct 2011 17:41:55 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 06EC72A8347 for ; Tue, 4 Oct 2011 17:41:34 +0000 (UTC) Date: Tue, 4 Oct 2011 17:41:34 +0000 (UTC) From: "Kevin Wilfong (Updated) (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <124089200.8385.1317750094030.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1625261728.8272.1317748299310.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HIVE-2479) Log more Hadoop task counter values in the MapRedStats class. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2479: -------------------------------- Attachment: HIVE-2479.1.patch.txt > Log more Hadoop task counter values in the MapRedStats class. > ------------------------------------------------------------- > > Key: HIVE-2479 > URL: https://issues.apache.org/jira/browse/HIVE-2479 > Project: Hive > Issue Type: Improvement > Reporter: Kevin Wilfong > Assignee: Kevin Wilfong > Attachments: HIVE-2479.1.patch.txt > > > We should log more of the Hadoop task tracker counters in the MapRedStats class, in order to make them available to hooks and improve logging. Specifically these are the counters we should add: > MAP_SPILL_CPU, > MAP_SPILL_WALLCLOCK, > MAP_SPILL_NUMBER, > MAP_SPILL_BYTES, > MAP_MEM_SORT_CPU, > MAP_MEM_SORT_WALLCLOCK, > MAP_MERGE_CPU, > MAP_MERGE_WALLCLOCK, > REDUCE_SHUFFLE_BYTES, > REDUCE_COPY_WALLCLOCK, > REDUCE_COPY_CPU, > REDUCE_SORT_WALLCLOCK, > REDUCE_SORT_CPU, > MAP_TASK_WALLCLOCK, > REDUCE_TASK_WALLCLOCK, > MAP_INPUT_BYTES -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira