hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bruno P. Kinoshita (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5911) Terasort TeraOutputFormat does not check for output directory existance
Date Wed, 10 Sep 2014 03:53:28 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bruno P. Kinoshita updated MAPREDUCE-5911:
------------------------------------------
    Attachment: HADOOP-5911.patch

Hi, first time writing a patch for Hadoop. Based on the description provided by Ivan. Couldn't
find any tests referencing this class, but no tests failed in maven.

HTH, Bruno

> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5911
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: examples
>            Reporter: Ivan Mitic
>            Assignee: Ivan Mitic
>            Priority: Minor
>         Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in {{FileOutputFormat#checkOutputSpecs}}
by throwing {{FileAlreadyExistsException}}.  However, terasort uses a specialized output format,
{{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}.  The subclass overrides
{{checkOutputSpecs}}, but does not re-implement the existence check and throw {{FileAlreadyExistsException}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message