hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Mitic (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-5911) Terasort TeraOutputFormat does not check for output directory existance
Date Mon, 20 Oct 2014 04:04:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ivan Mitic resolved MAPREDUCE-5911.
-----------------------------------
    Resolution: Duplicate

I reverted the patch from trunk, branch-2 and branch-2.6. Resolving this Jira as a dupe of
MAPREDUCE-4879, let's iterate on the right fix there.

> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: examples
>            Reporter: Ivan Mitic
>            Assignee: Bruno P. Kinoshita
>            Priority: Minor
>         Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in {{FileOutputFormat#checkOutputSpecs}}
by throwing {{FileAlreadyExistsException}}.  However, terasort uses a specialized output format,
{{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}.  The subclass overrides
{{checkOutputSpecs}}, but does not re-implement the existence check and throw {{FileAlreadyExistsException}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message