hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3744) Unable to retrieve application logs via "yarn logs" or "mapred job -logs"
Date Tue, 31 Jan 2012 20:02:10 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jason Lowe updated MAPREDUCE-3744:
----------------------------------

    Attachment: MAPREDUCE-3744.patch

Patch to address both the yarn logs issue and better error messages when log aggregation not
enabled.

yarn logs problem was a copy-n-paste error grabbing the wrong property when computing the
log dir suffix.  To improve the error messages, it catches FileNotFound to print an error
about aggregation rather than pass along the exception to the end user.
                
> Unable to retrieve application logs via "yarn logs" or "mapred job -logs"
> -------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3744
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3744
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>            Priority: Blocker
>         Attachments: MAPREDUCE-3744.patch
>
>
> Trying to retrieve application logs via the "yarn logs" shell command results in an error
similar to this:
> Exception in thread "main" java.io.FileNotFoundException: File /tmp/logs/application_1327694122989_0001
does not exist.
> 	at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:226)
> 	at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:217)
> 	at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:192)
> 	at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:192)
> 	at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1371)
> 	at org.apache.hadoop.fs.FileContext$20.next(FileContext.java:1)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
> 	at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1373)
> 	at org.apache.hadoop.yarn.logaggregation.LogDumper.dumpAllContainersLogs(LogDumper.java:191)
> 	at org.apache.hadoop.yarn.logaggregation.LogDumper.run(LogDumper.java:107)
> 	at org.apache.hadoop.yarn.logaggregation.LogDumper.main(LogDumper.java:226)
> Trying to grab the logs via the "mapred jobs -logs" command results in this error:
> 2012-01-27 14:05:52,040 INFO  mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(246))
- Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history
server
> 2012-01-27 14:05:52,041 WARN  mapred.ClientServiceDelegate (ClientServiceDelegate.java:checkAndGetHSProxy(257))
- Job History Server is not configured.
> Unable to get log information for job: job_1327694122989_0001
> Even though the historyserver process is running.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message