hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3889) job client tries to use /tasklog interface, but that doesn't exist anymore
Date Wed, 22 Feb 2012 15:29:49 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13213704#comment-13213704
] 

Daryn Sharp commented on MAPREDUCE-3889:
----------------------------------------

Yes, this particular bug happens when tasks fail.  We probably need another jira for the underlying
error that trips this bug:
{noformat}
2012-02-21 23:13:51,600 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child
:
java.lang.NoSuchMethodError: org.apache.hadoop.tools.DistCp.checkAndClose(Ljava/io/Closeable;)Z
        at org.apache.hadoop.tools.DistCp$CopyFilesMapper.doCopyFile(DistCp.java:465)
        at org.apache.hadoop.tools.DistCp$CopyFilesMapper.copy(DistCp.java:519)
        at org.apache.hadoop.tools.DistCp$CopyFilesMapper.copyWithRetries(DistCp.java:594)
        at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:650)
        at org.apache.hadoop.tools.DistCp$CopyFilesMapper.map(DistCp.java:324)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:399)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:334)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:147)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:142)
{noformat}

It's bizarre, because the caller is in the same class as the supposedly missing method.
                
> job client tries to use /tasklog interface, but that doesn't exist anymore
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3889
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3889
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.1
>            Reporter: Thomas Graves
>            Priority: Critical
>
> if you specify  -Dmapreduce.client.output.filter=SUCCEEDED option when running a job
it tries to fetch task logs to print out on the client side from a url like: http://nodemanager:8080/tasklog?plaintext=true&attemptid=attempt_1329857083014_0003_r_000000_0&filter=stdout
> It always errors on this request with: Required param job, map and reduce
> We saw this error when using distcp and the distcp failed. I'm not sure if it is mandatory
for distcp or just informational purposes.  I'm guessing the latter.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message