hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: customize containter-log4j.properties
Date Sat, 05 Apr 2014 17:13:34 GMT
This is intentional, and only within MR2's scope - we do not support
configuring the formatting, but do support switching the levels (via
job properties). You should still be able to customise your own YARN
apps' logging configuration though.

On Sat, Apr 5, 2014 at 7:09 PM, Federico Baldo <baldo.federico@gmail.com> wrote:
> Hi there,
> I am trying to customize the log format of containers, as a first step I
> have tried using  a containter-log4j.properties  with a different value for
> log4j.appender.CLA.layout.ConversionPattern located in the container's
> classpath. Tthe result is that the syslog file is written to:
>
> /mnt/var/lib/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1396678720329_0009/container_1396678720329_0009_01_000009/null/syslog
>
> instead of the configured yarn.app.mapreduce.container.log.dir that is
> specified in the cmdline as :
>
> -Dyarn.app.container.log.dir=/mnt/var/log/hadoop/userlogs/application_1396678720329_0009/container_1396678720329_0009_01_000009
>
> Additionally I can see that in Hadoop 2.2.0 the
> log4j.configuration=container-log4j.properties is set in
> MRApps.addLog4jSystemProperties() and cannot be modified:
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hadoop/hadoop-mapreduce-client-common/2.2.0/org/apache/hadoop/mapreduce/v2/util/MRApps.java#457
>
> Do you have any idea on how to possibly customize this configuration file?
>
> Thanks
> --
> Federico Baldo



-- 
Harsh J

Mime
View raw message