hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1841) o.a.h.mapreduce.FileOutputCommitter doens't check for existence of ${mapred.output.dir}/_temporary
Date Thu, 03 Jun 2010 18:44:57 GMT
o.a.h.mapreduce.FileOutputCommitter doens't check for existence of ${mapred.output.dir}/_temporary
--------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1841
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1841
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: task
    Affects Versions: 0.20.2
            Reporter: Arun C Murthy
            Assignee: Arun C Murthy
             Fix For: 0.22.0


o.a.h.mapred.FileOutputCommitter.getWorkOutputPath checks for existence of ${mapred.output.dir}/_temporary
to ensure tasks launched _after_ the job-cleanup task fail early (in a vast majority of cases).
This check is missing in the mapreduce libraries.

Related note: FileOutputCommitter.setupTask seems a more appropriate place for the above check...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message