Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 84802 invoked from network); 11 Aug 2008 11:26:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 11 Aug 2008 11:26:36 -0000 Received: (qmail 59592 invoked by uid 500); 11 Aug 2008 11:26:34 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 59568 invoked by uid 500); 11 Aug 2008 11:26:34 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 59557 invoked by uid 99); 11 Aug 2008 11:26:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Aug 2008 04:26:34 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Aug 2008 11:25:46 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5A0C7234C19E for ; Mon, 11 Aug 2008 04:25:44 -0700 (PDT) Message-ID: <1637906680.1218453944356.JavaMail.jira@brutus> Date: Mon, 11 Aug 2008 04:25:44 -0700 (PDT) From: "Amareshwari Sriramadasu (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-3150) Move task file promotion into the task In-Reply-To: <1005772078.1207083747584.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: -------------------------------------------- Attachment: patch-3150.txt Here is patch after adding the change to do with getWorkPath in FileOutputFormat and incorporating Devaraj's comments. bq. I don't understand why there is a sendLastUpdate before sendDone. sendLastUpdate is required before sendDone because sometimes last status update can be missed by communication thread. So, before sending done, we make sure counters are updated by sending a last update. > Move task file promotion into the task > -------------------------------------- > > Key: HADOOP-3150 > URL: https://issues.apache.org/jira/browse/HADOOP-3150 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Reporter: Owen O'Malley > Assignee: Amareshwari Sriramadasu > Fix For: 0.19.0 > > Attachments: 3150.patch, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt > > > We need to move the task file promotion from the JobTracker to the Task and move it down into the output format. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.