[ https://issues.apache.org/jira/browse/YARN-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-1005. ------------------------------------- Resolution: Cannot Reproduce > Log aggregators should check for FSDataOutputStream close before renaming to aggregated file. > --------------------------------------------------------------------------------------------- > > Key: YARN-1005 > URL: https://issues.apache.org/jira/browse/YARN-1005 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Affects Versions: 2.1.0-beta, 2.0.5-alpha > Reporter: Rohith Sharma K S > > If AggregatedLogFormat.LogWriter.closeWriter() is interuppted, then "remoteNodeTmpLogFileForApp" is renamed to "remoteNodeLogFileForApp" file. This renamed file does not contain valid aggregated logs. There can be situation renamed file can be not in BCFile format. > This cause issue while viewing from JobHistoryServer web page. > {noformat} > 2013-07-27 18:51:14,787 ERROR org.apache.hadoop.yarn.webapp.View: Error getting logs for job_1374918614757_0002 > java.io.IOException: Not a valid BCFile. > at org.apache.hadoop.io.file.tfile.BCFile$Magic.readAndVerify(BCFile.java:927) > at org.apache.hadoop.io.file.tfile.BCFile$Reader.(BCFile.java:628) > at org.apache.hadoop.io.file.tfile.TFile$Reader.(TFile.java:804) > at org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogReader.(AggregatedLogFormat.java:337) > at org.apache.hadoop.yarn.webapp.log.AggregatedLogsBlock.render(AggregatedLogsBlock.java:89) > at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:64) > at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:74) > {noformat} > -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org