Return-Path: Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: (qmail 29065 invoked from network); 7 Mar 2010 07:26:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 Mar 2010 07:26:10 -0000 Received: (qmail 97213 invoked by uid 500); 7 Mar 2010 07:25:51 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 97125 invoked by uid 500); 7 Mar 2010 07:25:50 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 97117 invoked by uid 99); 7 Mar 2010 07:25:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Mar 2010 07:25:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Mar 2010 07:25:48 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 33557234C4B9 for ; Sun, 7 Mar 2010 07:25:27 +0000 (UTC) Message-ID: <1186748598.122731267946727209.JavaMail.jira@brutus.apache.org> Date: Sun, 7 Mar 2010 07:25:27 +0000 (UTC) From: "Amar Kamat (JIRA)" To: mapreduce-issues@hadoop.apache.org Subject: [jira] Updated: (MAPREDUCE-1482) Better handling of task diagnostic information stored in the TaskInProgress In-Reply-To: <364527324.202761265876548508.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated MAPREDUCE-1482: ---------------------------------- Attachment: mapreduce-1482-v1.7.patch Attaching a new patch for review. In this patch, the state-strings and diag-infos are logged only when they overflow and trimming is involved. Note that at the jobtracker, these strings will always be trimmed before sending and hence no info will be logged in heartbeats. test-patch and ant tests passed on my box. > Better handling of task diagnostic information stored in the TaskInProgress > --------------------------------------------------------------------------- > > Key: MAPREDUCE-1482 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1482 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: jobtracker > Reporter: Amar Kamat > Assignee: Amar Kamat > Attachments: mapreduce-1482-v1.1.patch, mapreduce-1482-v1.2.patch, mapreduce-1482-v1.3.patch, mapreduce-1482-v1.7.patch > > > Task diagnostic information can be very large at times eating up Jobtracker's memory. There should be some way to avoid storing large error strings in JobTracker. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.