chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ariel Rabkin <asrab...@gmail.com>
Subject Re: Planning for SyslogAdaptor
Date Sun, 03 Oct 2010 03:30:24 GMT
Yes. That sounds like a good idea.  Can you reuse any of the
UDPAdaptor code by inheritance?  (Or by refactoring, and then using
inheritance?)

--Ari

On Sat, Oct 2, 2010 at 5:05 PM, Eric Yang <eric818@gmail.com> wrote:
> Hi,
>
> UDPAdaptor can record syslog logs but the log entry is tagged with
> Chukwa internal data type at adaptor start up time.  I am thinking to
> extend UDPAdaptor to record syslog messages with small enhancements.
> SyslogAdaptor can extract facility name field from syslog message to
> tag facility name as the data type.  This would provide the ability to
> invoke different demux parsers base on the facility name in syslog.
> HOSTNAME can also be mapped to source for Chukwa chunk meta data.
>
> My use case is to configure hadoop log4j.properties to log everything
> through org.apache.log4j.net.SyslogAppender to one SysLogAdaptor on
> the local Chukwa agent, and invokes different parsers for audit log
> and name node log.  Facility name is some what limited, but it should
> be enough type left to manage hadoop log files.  Suggestion and
> feedbacks are welcome.
>
> regards,
> Eric
>



-- 
Ari Rabkin asrabkin@gmail.com
UC Berkeley Computer Science Department

Mime
View raw message