hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2463) Job History files are not moving to done folder when job history location is hdfs location
Date Wed, 18 May 2011 18:24:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035547#comment-13035547

Hadoop QA commented on MAPREDUCE-2463:

+1 overall.  Here are the results of testing the latest attachment 
  against trunk revision 1104687.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/263//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/263//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/263//console

This message is automatically generated.

> Job History files are not moving to done folder when job history location is hdfs location
> ------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-2463
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2463
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.0
>         Attachments: MAPREDUCE-2463-1.patch, MAPREDUCE-2463.patch
> If "mapreduce.jobtracker.jobhistory.location" is configured as HDFS location then either
during initialization of Job Tracker (while moving old job history files) or after completion
of the job, history files are not moving to done and giving following exception.
> {code:xml} 
> 2011-04-29 15:27:27,813 ERROR org.apache.hadoop.mapreduce.jobhistory.JobHistory: Unable
to move history file to DONE folder.
> java.lang.IllegalArgumentException: Wrong FS: hdfs://,
expected: file:///
> 	at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:402)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:58)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:419)
> 	at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:294)
> 	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:215)
> 	at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1516)
> 	at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1492)
> 	at org.apache.hadoop.fs.FileSystem.moveFromLocalFile(FileSystem.java:1482)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistory.moveToDoneNow(JobHistory.java:348)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistory.access$200(JobHistory.java:61)
> 	at org.apache.hadoop.mapreduce.jobhistory.JobHistory$1.run(JobHistory.java:439)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:619)
> {code} 

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message