ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sumit Mohanty (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AMBARI-4061) Upgraded cluster may be missing yarn job summary entries
Date Fri, 13 Dec 2013 17:43:08 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sumit Mohanty resolved AMBARI-4061.
-----------------------------------

    Resolution: Fixed

> Upgraded cluster may be missing yarn job summary entries
> --------------------------------------------------------
>
>                 Key: AMBARI-4061
>                 URL: https://issues.apache.org/jira/browse/AMBARI-4061
>             Project: Ambari
>          Issue Type: Bug
>          Components: controller
>    Affects Versions: 1.4.3
>            Reporter: Sumit Mohanty
>            Assignee: Sumit Mohanty
>             Fix For: 1.4.3
>
>         Attachments: AMBARI-4061.patch
>
>
> When MR2 is installed after YARN and YARN-ResourceManager shares the host with MR2 components
then this problem will occur.
> The updated script will install MR2 first and then YARN. Alternatively, users can patch
the log4j file with the following after putting the proper value for "[yarn_log_dir_prefix]/[yarn_user]".
> {noformat}
> #
> # Job Summary Appender 
> #
> # Use following logger to send summary to separate file defined by 
> # hadoop.mapreduce.jobsummary.log.file rolled daily:
> # hadoop.mapreduce.jobsummary.logger=INFO,JSA
> # 
> hadoop.mapreduce.jobsummary.logger=${hadoop.root.logger}
> hadoop.mapreduce.jobsummary.log.file=hadoop-mapreduce.jobsummary.log
> log4j.appender.JSA=org.apache.log4j.DailyRollingFileAppender
> # Set the ResourceManager summary log filename
> yarn.server.resourcemanager.appsummary.log.file=hadoop-mapreduce.jobsummary.log
> # Set the ResourceManager summary log level and appender
> yarn.server.resourcemanager.appsummary.logger=${hadoop.root.logger}
> #yarn.server.resourcemanager.appsummary.logger=INFO,RMSUMMARY
> # To enable AppSummaryLogging for the RM,
> # set yarn.server.resourcemanager.appsummary.logger to
> # <LEVEL>,RMSUMMARY in hadoop-env.sh
> # Appender for ResourceManager Application Summary Log
> # Requires the following properties to be set
> #    - hadoop.log.dir (Hadoop Log directory)
> #    - yarn.server.resourcemanager.appsummary.log.file (resource manager app summary
log filename)
> #    - yarn.server.resourcemanager.appsummary.logger (resource manager app summary log
level and appender)
> log4j.appender.RMSUMMARY=org.apache.log4j.RollingFileAppender
> log4j.appender.RMSUMMARY.File=/grid/0/log/hadoop-yarn/yarn/${yarn.server.resourcemanager.appsummary.log.file}
> log4j.appender.RMSUMMARY.MaxFileSize=256MB
> log4j.appender.RMSUMMARY.MaxBackupIndex=20
> log4j.appender.RMSUMMARY.layout=org.apache.log4j.PatternLayout
> log4j.appender.RMSUMMARY.layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
> log4j.appender.JSA.layout=org.apache.log4j.PatternLayout
> log4j.appender.JSA.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p %c{2}: %m%n
> log4j.appender.JSA.DatePattern=.yyyy-MM-dd
> log4j.appender.JSA.layout=org.apache.log4j.PatternLayout
> log4j.logger.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=${yarn.server.resourcemanager.appsummary.logger}
> log4j.additivity.org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary=false
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message