chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ariel Rabkin <>
Subject Re: Adaptor options for Hadoop log files (TaskTracker, DataNode)
Date Mon, 18 May 2009 16:02:33 GMT
You shouldn't need to recompile hadoop -- you can add Chuwka code to
Hadoop just by putting the chukwa-hadoop-xyz jar in the hadoop lib
directory. (Chukwa also needs json.jar, so you know.) You do need to
reconfigure Hadoop, and chukwa/conf/ does the
Right Thing.

I'll defer to others for the second half of that question.

On Mon, May 18, 2009 at 7:14 AM, Jiaqi Tan <> wrote:
> Hi Eric,
>> Chukwa has a special log4j appender which escapes return character.  The
>> multi-lines exception will be stored as a single chunk, and processed as a
>> single chukwa record after Demux.
> In this case, I suppose I would need to configure the monitored Hadoop
> cluster to actually use the Chukwa log4j appender? Would I also need
> to recompile the Hadoop of the monitored cluster to include the Chukwa
> code then?

Ari Rabkin
UC Berkeley Computer Science Department

View raw message