hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5911) Terasort TeraOutputFormat does not check for output directory existance
Date Sun, 19 Oct 2014 23:12:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176479#comment-14176479
] 

Hudson commented on MAPREDUCE-5911:
-----------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #6289 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/6289/])
MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed
by Bruno P. Kinoshita. (ivanmi: rev 7bbda6ef92e9bf4a28e67b8736067b38defab51e)
* hadoop-mapreduce-project/CHANGES.txt
* hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/terasort/TeraOutputFormat.java


> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: examples
>            Reporter: Ivan Mitic
>            Assignee: Bruno P. Kinoshita
>            Priority: Minor
>         Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in {{FileOutputFormat#checkOutputSpecs}}
by throwing {{FileAlreadyExistsException}}.  However, terasort uses a specialized output format,
{{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}.  The subclass overrides
{{checkOutputSpecs}}, but does not re-implement the existence check and throw {{FileAlreadyExistsException}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message