chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ariel Rabkin <>
Subject Re: Planning for SyslogAdaptor
Date Sun, 03 Oct 2010 03:30:24 GMT
Yes. That sounds like a good idea.  Can you reuse any of the
UDPAdaptor code by inheritance?  (Or by refactoring, and then using


On Sat, Oct 2, 2010 at 5:05 PM, Eric Yang <> wrote:
> Hi,
> UDPAdaptor can record syslog logs but the log entry is tagged with
> Chukwa internal data type at adaptor start up time.  I am thinking to
> extend UDPAdaptor to record syslog messages with small enhancements.
> SyslogAdaptor can extract facility name field from syslog message to
> tag facility name as the data type.  This would provide the ability to
> invoke different demux parsers base on the facility name in syslog.
> HOSTNAME can also be mapped to source for Chukwa chunk meta data.
> My use case is to configure hadoop to log everything
> through to one SysLogAdaptor on
> the local Chukwa agent, and invokes different parsers for audit log
> and name node log.  Facility name is some what limited, but it should
> be enough type left to manage hadoop log files.  Suggestion and
> feedbacks are welcome.
> regards,
> Eric

Ari Rabkin
UC Berkeley Computer Science Department

View raw message