Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 73933 invoked from network); 31 Mar 2008 19:02:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 31 Mar 2008 19:02:52 -0000 Received: (qmail 65397 invoked by uid 500); 31 Mar 2008 19:02:50 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 65358 invoked by uid 500); 31 Mar 2008 19:02:50 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 65349 invoked by uid 99); 31 Mar 2008 19:02:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Mar 2008 12:02:50 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Mar 2008 19:02:08 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 204AF234C0B0 for ; Mon, 31 Mar 2008 12:00:26 -0700 (PDT) Message-ID: <724595959.1206990026131.JavaMail.jira@brutus> Date: Mon, 31 Mar 2008 12:00:26 -0700 (PDT) From: "Runping Qi (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-3041) Within a task, the value ofJobConf.getOutputPath() method is modified In-Reply-To: <798474908.1205837848130.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583798#action_12583798 ] Runping Qi commented on HADOOP-3041: ------------------------------------ I think it is better to removing the getOutputPath() from the api and replace it with something else. That way, the application can detect the problem at compile time. Otherwise, the apps will misbehave without any warnings. > Within a task, the value ofJobConf.getOutputPath() method is modified > --------------------------------------------------------------------- > > Key: HADOOP-3041 > URL: https://issues.apache.org/jira/browse/HADOOP-3041 > Project: Hadoop Core > Issue Type: Bug > Components: mapred > Affects Versions: 0.16.1 > Environment: all > Reporter: Alejandro Abdelnur > Assignee: Amareshwari Sriramadasu > Priority: Blocker > Fix For: 0.17.0 > > Attachments: patch-3041-0.16.2.txt, patch-3041.txt, patch-3041.txt, patch-3041.txt, patch-3041.txt > > > Until 0.16.0 the value of the getOutputPath() method, if queried within a task, pointed to the part file assigned to the task. > For example: /user/foo/myoutput/part_00000 > In 0.16.1, now it returns an internal hadoop for the task output temporary location. > For the above example: /user/foo/myoutput/_temporary/part_00000 > This change breaks applications that use the getOutputPath() to compute other directories. > IMO, this has always being broken, Hadoop should not change the values of properties injected by the client, instead it should use private properties or internal helper methods. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.