Return-Path: 
 <mapreduce-issues-return-43089-apmail-hadoop-mapreduce-issues-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 178CB9D9B
	for <apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org>;
 Thu,  8 Mar 2012 16:46:24 +0000 (UTC)
Received: (qmail 31369 invoked by uid 500); 8 Mar 2012 16:46:23 -0000
Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org
Received: (qmail 31158 invoked by uid 500); 8 Mar 2012 16:46:23 -0000
Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:mapreduce-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:mapreduce-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:mapreduce-issues@hadoop.apache.org>
List-Id: <mapreduce-issues.hadoop.apache.org>
Reply-To: mapreduce-issues@hadoop.apache.org
Delivered-To: mailing list mapreduce-issues@hadoop.apache.org
Received: (qmail 31110 invoked by uid 99); 8 Mar 2012 16:46:22 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Mar 2012 16:46:22 +0000
X-ASF-Spam-Status: No, hits=-2000.0 required=5.0
	tests=ALL_TRUSTED,T_RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Mar 2012 16:46:19 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
	by hel.zones.apache.org (Postfix) with ESMTP id 95AFF1088E
	for <mapreduce-issues@hadoop.apache.org>;
 Thu,  8 Mar 2012 16:45:58 +0000 (UTC)
Date: Thu, 8 Mar 2012 16:45:58 +0000 (UTC)
From: "Robert Joseph Evans (Commented) (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: 
 <1130512726.39238.1331225158614.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <802932357.35860.1331150337221.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (MAPREDUCE-3982) TestEmptyJob fails with
 FileNotFound
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org


    [ https://issues.apache.org/jira/browse/MAPREDUCE-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225294#comment-13225294 ] 

Robert Joseph Evans commented on MAPREDUCE-3982:
------------------------------------------------

That would not really work.  The directory structure is the following.

<OUTPUT>/_temporary/<ATTEMPT_ID>/...

The problem was that the code assumed that <OUTPUT>/_temporary/<ATTEMPT_ID>/ was being created by the individual map/reduce tasks.  If it was not then other code would blowup, so instead of just creating <OUTPUT>/_temporary in the setup from before we are now creating <OUTPUT>/_temporary/<ATTEMPT_ID>/

When we clean up from a job we still want to completely remove the _temporary directory, not just <OUTPUT>/_temporary/<ATTEMPT_ID>/ or there will be an extra directory sitting around in the <OUTPUT> directory that will cause other problems.
                
> TestEmptyJob fails with FileNotFound
> ------------------------------------
>
>                 Key: MAPREDUCE-3982
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3982
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.2
>            Reporter: Robert Joseph Evans
>            Assignee: Robert Joseph Evans
>            Priority: Critical
>         Attachments: MR-3982.txt
>
>
> TestEmptyJob fails because teh FileOutputCommitter expects a directory to be created that is not created.  The FileOutputCommitter should either ignore the error or create the directory itself.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira