hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jane Chen (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-3377) Compatibility issue with 0.20.203.
Date Tue, 08 Nov 2011 19:47:51 GMT
Compatibility issue with 0.20.203.

                 Key: MAPREDUCE-3377
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3377
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions:
         Environment: standalone JDK 1.6 Linux
            Reporter: Jane Chen

I have an OutputFormat which implements Configurable.  I set new config entries to a job configuration
during checkOutputSpec() so that the tasks will get the config entries through the job configuration.
 This works fine in 0.20.2, but stopped working starting from 0.20.203.  With 0.20.203, my
OutputFormat still has the configuration set, but the copy a task gets does not have the new
entries that are set as part of checkOutputSpec().  

I believe that the problem is with JobClient.  The job configuration needs to wait till checkOutputSpec()
is returned before being cloned and submitted.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message