hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Federico Baldo <baldo.feder...@gmail.com>
Subject Re: customize containter-log4j.properties
Date Mon, 07 Apr 2014 16:23:54 GMT
Thank you for the feedback on that. Though I don't understand why the
container-log4j.properties should be included in the
hadoop-yarn-server-nodemanager  and not as a standard configuration file in
the configuration directory, is there any specific requirements for this
config file that I'm missing?

Thanks,
Federico


2014-04-05 18:13 GMT+01:00 Harsh J <harsh@cloudera.com>:

> This is intentional, and only within MR2's scope - we do not support
> configuring the formatting, but do support switching the levels (via
> job properties). You should still be able to customise your own YARN
> apps' logging configuration though.
>
> On Sat, Apr 5, 2014 at 7:09 PM, Federico Baldo <baldo.federico@gmail.com>
> wrote:
> > Hi there,
> > I am trying to customize the log format of containers, as a first step I
> > have tried using  a containter-log4j.properties  with a different value
> for
> > log4j.appender.CLA.layout.ConversionPattern located in the container's
> > classpath. Tthe result is that the syslog file is written to:
> >
> >
> /mnt/var/lib/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1396678720329_0009/container_1396678720329_0009_01_000009/null/syslog
> >
> > instead of the configured yarn.app.mapreduce.container.log.dir that is
> > specified in the cmdline as :
> >
> >
> -Dyarn.app.container.log.dir=/mnt/var/log/hadoop/userlogs/application_1396678720329_0009/container_1396678720329_0009_01_000009
> >
> > Additionally I can see that in Hadoop 2.2.0 the
> > log4j.configuration=container-log4j.properties is set in
> > MRApps.addLog4jSystemProperties() and cannot be modified:
> >
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hadoop/hadoop-mapreduce-client-common/2.2.0/org/apache/hadoop/mapreduce/v2/util/MRApps.java#457
> >
> > Do you have any idea on how to possibly customize this configuration
> file?
> >
> > Thanks
> > --
> > Federico Baldo
>
>
>
> --
> Harsh J
>



-- 
Federico Baldo

Mime
View raw message