hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5813) YarnChild does not load job.xml with mapreduce.job.classloader=true
Date Thu, 27 Mar 2014 11:48:15 GMT
Gera Shegalov created MAPREDUCE-5813:
----------------------------------------

             Summary: YarnChild does not load job.xml with mapreduce.job.classloader=true

                 Key: MAPREDUCE-5813
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5813
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2, task
    Affects Versions: 2.3.0
            Reporter: Gera Shegalov
            Priority: Blocker


{{YarnChild.main}} uses {{JobConf.addResource(String)}} to load {{job.xml}} that relies on
class loading. When {{mapreduce.job.classloader=true}} the job-speicific part of the class
path is separated from {{CLASSPATH}} into {{APP_CLASSPATH}}. Therefore {{job.xml}} is inaccessible
for the default class loader. Later {{writeLocalJobFile}} overwrites the correct localized
{{job.xml}} on disk as well.

This problem is easily avoided by using  {{JobConf.addResource(Path)}} to read the localized
{{job.xml}} without relying on class loading.





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message