hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2872) Default value for hadoop.job.history.location is broken
Date Thu, 21 Feb 2008 23:52:20 GMT
Default value for hadoop.job.history.location is broken

                 Key: HADOOP-2872
                 URL: https://issues.apache.org/jira/browse/HADOOP-2872
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.17.0
            Reporter: Owen O'Malley
            Assignee: Amareshwari Sri Ramadasu
             Fix For: 0.17.0

The default value for hadoop.job.history.location is currently:


which assumes that hadoop.log.dir is an absolute path. If the path is relative, the job tracker
dies with:

08/02/21 23:43:04 FATAL mapred.JobTracker: java.lang.IllegalArgumentException: Wrong FS: file://./logs/history,
expected: file:///
        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:268)
        at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:54)
        at org.apache.hadoop.fs.RawLocalFileSystem.exists(RawLocalFileSystem.java:223)
        at org.apache.hadoop.fs.FilterFileSystem.exists(FilterFileSystem.java:147)
        at org.apache.hadoop.mapred.JobHistory.init(JobHistory.java:124)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:706)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:124)
        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:2146)

I think that the right fix is to make the default value:


and when building, use the Path code:

new Path(get("hadoop.log.dir", conf), get("hadoop.job.history.location"));

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message