hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2735) MR279: finished applications should be added to an application summary log
Date Wed, 31 Aug 2011 16:11:17 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094649#comment-13094649
] 

Thomas Graves commented on MAPREDUCE-2735:
------------------------------------------

The application summary log is formatted the same as the old job summary log.  example output
is:

2011-08-31 16:02:01,237 INFO resourcemanager.RMAppManager$ApplicationSummary: appId=application_1314806486924_1,name=word
count,user=user1,queue=default,state=FINISHED,trackingUrl=99.99.99.99:19888/yarn/job/job_1314806486924_1_1,appMasterHost=99.99.99.99,startTime=1314806497546,finishTime=1314806521231


To configured would be something like this:
rm.appsummary.logger=INFO,RMSUMMARY
log4j.logger.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=${rm.appsummary.logger}
log4j.additivity.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=false
log4j.appender.RMSUMMARY=org.apache.log4j.DailyRollingFileAppender
log4j.appender.RMSUMMARY.File=${hadoop.log.dir}/rm-appsummary.log
log4j.appender.RMSUMMARY.layout=org.apache.log4j.PatternLayout
log4j.appender.RMSUMMARY.layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
log4j.appender.JSA.DatePattern=.yyyy-MM-dd

> MR279: finished applications should be added to an application summary log
> --------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2735
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2735
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>         Attachments: MAPREDUCE-2735.patch
>
>
> When an application finishes it should be added to an application summary log for historical
purposes.  jira MAPREDUCE-2649 is going to start purging applications from RM when certain
limits are hit which makes this more critical. We also need to save the information early
enough after the app finishes so we don't lose the info if the RM does get restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message