Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 2301 invoked from network); 18 Aug 2008 03:31:11 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 18 Aug 2008 03:31:11 -0000 Received: (qmail 9975 invoked by uid 500); 18 Aug 2008 03:31:04 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 9933 invoked by uid 500); 18 Aug 2008 03:31:03 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 9917 invoked by uid 99); 18 Aug 2008 03:31:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Aug 2008 20:31:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Aug 2008 03:30:15 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6326A234C1B6 for ; Sun, 17 Aug 2008 20:30:44 -0700 (PDT) Message-ID: <108904105.1219030244404.JavaMail.jira@brutus> Date: Sun, 17 Aug 2008 20:30:44 -0700 (PDT) From: "Ramya R (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3150) Move task file promotion into the task In-Reply-To: <1005772078.1207083747584.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623250#action_12623250 ] Ramya R commented on HADOOP-3150: --------------------------------- Tested the patch for small jobs benchmark on 500 nodes with 900 maps, 450 reduces and 10000 lines per job. The patch did not degrade the performance. The deviation observed was less than 2%. > Move task file promotion into the task > -------------------------------------- > > Key: HADOOP-3150 > URL: https://issues.apache.org/jira/browse/HADOOP-3150 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: Owen O'Malley > Assignee: Amareshwari Sriramadasu > Fix For: 0.19.0 > > Attachments: 3150.patch, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt > > > We need to move the task file promotion from the JobTracker to the Task and move it down into the output format. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.