chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <>
Subject Re: Planning for SyslogAdaptor
Date Sun, 03 Oct 2010 04:23:48 GMT
Yes, I plan to refactor UDPAdaptor run method.  The while loop logic
is slightly different for SyslogAdaptor, and the rest are the same.


On Sat, Oct 2, 2010 at 8:30 PM, Ariel Rabkin <> wrote:
> Yes. That sounds like a good idea.  Can you reuse any of the
> UDPAdaptor code by inheritance?  (Or by refactoring, and then using
> inheritance?)
> --Ari
> On Sat, Oct 2, 2010 at 5:05 PM, Eric Yang <> wrote:
>> Hi,
>> UDPAdaptor can record syslog logs but the log entry is tagged with
>> Chukwa internal data type at adaptor start up time.  I am thinking to
>> extend UDPAdaptor to record syslog messages with small enhancements.
>> SyslogAdaptor can extract facility name field from syslog message to
>> tag facility name as the data type.  This would provide the ability to
>> invoke different demux parsers base on the facility name in syslog.
>> HOSTNAME can also be mapped to source for Chukwa chunk meta data.
>> My use case is to configure hadoop to log everything
>> through to one SysLogAdaptor on
>> the local Chukwa agent, and invokes different parsers for audit log
>> and name node log.  Facility name is some what limited, but it should
>> be enough type left to manage hadoop log files.  Suggestion and
>> feedbacks are welcome.
>> regards,
>> Eric
> --
> Ari Rabkin
> UC Berkeley Computer Science Department

View raw message