Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of eric818@gmail.com designates
 209.85.216.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEkTJkSd8vH1ktwc5txEdaLNxR6VV94QMLLX+ZaVNTkBhEazyg@mail.gmail.com>
References: <1326770418572-3665088.post@n3.nabble.com>
	<CADfbTpGcW8iD+8WaXKwmaTjhem8bdtMmPh-oMQt5RzAF5jfkYA@mail.gmail.com>
	<CAEkTJkSd8vH1ktwc5txEdaLNxR6VV94QMLLX+ZaVNTkBhEazyg@mail.gmail.com>
Date: Thu, 19 Jan 2012 18:24:51 -0800
Message-ID: 
 <CADfbTpEkV8-iB=90x2zxwQaxwt=4h+eRQicAF+MRS_7pSWdS0g@mail.gmail.com>
Subject: Re: hadoop's attempt directory logs
From: Eric Yang <eric818@gmail.com>
To: chukwa-user@incubator.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

The logger should set to INFO because the information are logged at
INFO level.  The increased severity level to ERROR filtered out all
log entries from task attempts.
Hope this helps.

regards,
Eric


On Thu, Jan 19, 2012 at 6:13 PM, Abhijit Dhar <abhijit.dhar.in@gmail.com> w=
rote:
> I added this in my $HADOOP_CONF_DIR/log4j.properties
>
> log4j.appender.TLA=3Dorg.apache.hadoop.chukwa.inputtools.log4j.TaskLogApp=
ender
> log4j.appender.TLA.recordType=3DCrawlerLog
> log4j.appender.TLA.taskId=3D${hadoop.tasklog.taskid}
> log4j.appender.TLA.layout=3Dorg.apache.log4j.PatternLayout
> log4j.appender.TLA.layout.ConversionPattern=3D%d{ISO8601} %p [%t]
> [%c{5}.%M()]:: %m%n
>
> But, it looks like when I add this to the rootlogger
> (log4j.rootLogger=3DERROR, stdout, TLA), it stops going through even my s=
tdout
> log appender.
> Any idea, what might be going on? (chukwa jar is on my classpath, and I
> don't see any ClassNotFound exception, so I think that part is good)
>
> Thanks,
>
>
>
> On Tue, Jan 17, 2012 at 6:03 PM, Eric Yang <eric818@gmail.com> wrote:
>>
>> This can be setup by using TaskLogAppender that comes with Chukwa.
>> In $HADOOP_CONF_DIR/log4j.properties, modify the TaskLogAppender
>> configuration
>> to:
>>
>>
>> log4j.appender.TLA=3Dorg.apache.hadoop.chukwa.inputtools.log4j.TaskLogAp=
pender
>>
>> Make sure chukwa-0.x.0-client.jar is in Hadoop class path, and restart
>> Hadoop.
>>
>> This should enable Task Attempt Logs to be sent through Chukwa data
>> collection system, and also log a copy locally on the task tracker
>> node. =C2=A0Hope this is what you are looking for.
>>
>> regards,
>> Eric
>>
>> On Mon, Jan 16, 2012 at 7:20 PM, Abhijit Dhar <abhijit.dhar.in@gmail.com=
>
>> wrote:
>> > Hi,
>> >
>> > Could you please point me how to stream the attempt logs that hadoop
>> > generates to chukwa, while at the same time saving them the way hadoop
>> > saves
>> > by default under attempt directories/stdout ?
>> >
>> > Thanks a lot
>> >
>> > --
>> > View this message in context:
>> > http://apache-chukwa.679492.n3.nabble.com/hadoop-s-attempt-directory-l=
ogs-tp3665088p3665088.html
>> > Sent from the Chukwa - Users mailing list archive at Nabble.com.
>
>
>
>
> --
> =D0=90=D0=B1=D0=B8=D0=B6=D0=B8=D1=82 =D0=94=D0=B0=D1=80