hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-5889) Allow writing to output directories that exist, as long as they are empty
Date Tue, 22 Jul 2014 19:54:39 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer resolved HADOOP-5889.
--------------------------------------

    Resolution: Incomplete

I'm just going to close this as stale, esp given s3 allegedly works.

> Allow writing to output directories that exist, as long as they are empty
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-5889
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5889
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 0.18.3
>            Reporter: Ian Nowland
>         Attachments: HADOOP-5889-0.patch
>
>
> The current behavior in FileOutputFormat.checkOutputSpecs is to fail if the path specified
by mapred.output.dir exists at the start of the job. This is to protect from accidentally
overwriting existing data. There seems no harm then in slightly relaxing this check to allow
the case for the output to exist if it is an empty directory.
> At a minimum this would allow outputting to the root of S3N buckets, which is currently
impossible (https://issues.apache.org/jira/browse/HADOOP-5805).



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message