hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Subroto Sanyal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4280) LocalJobRunner doesn't honor custom OutputCommiter cleanupJob
Date Wed, 23 May 2012 11:36:41 GMT
Subroto Sanyal created MAPREDUCE-4280:

             Summary: LocalJobRunner doesn't honor custom OutputCommiter cleanupJob
                 Key: MAPREDUCE-4280
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4280
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.23.1
            Reporter: Subroto Sanyal

I have an implementation SampleFileOutputCommiter which extends org.apache.hadoop.mapred.FileOutputCommitter
. The implementation has specific code to be executed during cleanupJob() execution.
When the framework(LocalJobRunner) makes a call to commitJob(), the framework never takes
care of calling the cleanupJob() instead it calls org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
commitJob() which internally calls its own cleanupJob().
Though the method cleanupJob is deprecated but, still I feel the framework should take care
of executing it as it is being executed from org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.
Currently the framework is not letting the Jobs written with MRV1 to run properly.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message