hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bruno P. Kinoshita (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5911) Terasort TeraOutputFormat does not check for output directory existance
Date Mon, 20 Oct 2014 11:45:35 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176835#comment-14176835
] 

Bruno P. Kinoshita commented on MAPREDUCE-5911:
-----------------------------------------------

Apologies Ivan, Gera. I hadn't seen 4879 either, and thanks for reverting it Ivan :)

> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: examples
>            Reporter: Ivan Mitic
>            Assignee: Bruno P. Kinoshita
>            Priority: Minor
>         Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in {{FileOutputFormat#checkOutputSpecs}}
by throwing {{FileAlreadyExistsException}}.  However, terasort uses a specialized output format,
{{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}.  The subclass overrides
{{checkOutputSpecs}}, but does not re-implement the existence check and throw {{FileAlreadyExistsException}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message