hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-3) Output directories are not cleaned up before the reduces run
Date Fri, 09 Jun 2017 21:44:19 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045075#comment-16045075
] 

Hudson commented on HADOOP-3:
-----------------------------

FAILURE: Integrated in Jenkins build HBase-2.0 #17 (See [https://builds.apache.org/job/HBase-2.0/17/])
HBASE-18033 Fix license check for hadoop-3.x (busbey: rev eb5c5a9bc8aa3e39b7da87d0a4130da480ba3a95)
* (edit) hbase-resource-bundle/src/main/resources/META-INF/LICENSE.vm
* (edit) hbase-resource-bundle/src/main/resources/supplemental-models.xml


> Output directories are not cleaned up before the reduces run
> ------------------------------------------------------------
>
>                 Key: HADOOP-3
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.1.0
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Minor
>             Fix For: 0.1.0
>
>         Attachments: clean-out-dir.patch, noclobber.patch
>
>
> The output directory for the reduces is not cleaned up and therefore if you can see left
overs from previous runs, if they had more reduces. For example, if you run the application
once with reduces=10 and then rerun with reduces=8, your output directory will have frag00000
to frag00009 with the first 8 fragments from the second run and the last 2 fragments from
the first run.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message