hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Tian (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5929) YARNRunner.java, path for jobJarPath not set correctly
Date Mon, 16 Jun 2014 17:04:01 GMT
Chao Tian created MAPREDUCE-5929:

             Summary: YARNRunner.java, path for jobJarPath not set correctly
                 Key: MAPREDUCE-5929
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5929
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.2.0
            Reporter: Chao Tian

In YARNRunner.java, line 357,

Path jobJarPath = new Path(jobConf.get(MRJobConfig.JAR));

This causes the job.jar file to miss scheme, host and port number on distributed file systems
other than hdfs. 

If we compare line 357 with line 344, there "job.xml" is actually set as
Path jobConfPath = new Path(jobSubmitDir,MRJobConfig.JOB_CONF_FILE);

It appears "jobSubmitDir" is missing on line 357, which causes this problem. In hdfs, the
additional qualify process will correct this problem, but not other generic distributed file

The proposed change is to replace 35 7 with

Path jobJarPath = new Path(jobConf.get(jobSubmitDir,MRJobConfig.JAR));


This message was sent by Atlassian JIRA

View raw message