Return-Path: Delivered-To: apmail-incubator-chukwa-dev-archive@www.apache.org Received: (qmail 10291 invoked from network); 10 Oct 2010 04:17:56 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 10 Oct 2010 04:17:56 -0000 Received: (qmail 66579 invoked by uid 500); 10 Oct 2010 04:17:55 -0000 Delivered-To: apmail-incubator-chukwa-dev-archive@incubator.apache.org Received: (qmail 66504 invoked by uid 500); 10 Oct 2010 04:17:53 -0000 Mailing-List: contact chukwa-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@incubator.apache.org Delivered-To: mailing list chukwa-dev@incubator.apache.org Received: (qmail 66490 invoked by uid 99); 10 Oct 2010 04:17:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Oct 2010 04:17:52 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Oct 2010 04:17:52 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o9A4HWK9023805 for ; Sun, 10 Oct 2010 04:17:32 GMT Message-ID: <4056404.62761286684252185.JavaMail.jira@thor> Date: Sun, 10 Oct 2010 00:17:32 -0400 (EDT) From: "Eric Yang (JIRA)" To: chukwa-dev@incubator.apache.org Subject: [jira] Updated: (CHUKWA-530) Syslog Adaptor for mapping Syslog facility name to Chukwa data type In-Reply-To: <13397306.520211286127812431.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CHUKWA-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated CHUKWA-530: ----------------------------- Status: Patch Available (was: Open) > Syslog Adaptor for mapping Syslog facility name to Chukwa data type > ------------------------------------------------------------------- > > Key: CHUKWA-530 > URL: https://issues.apache.org/jira/browse/CHUKWA-530 > Project: Chukwa > Issue Type: New Feature > Components: data collection > Environment: Java 6, Mac OS X > Reporter: Eric Yang > Assignee: Eric Yang > Attachments: CHUKWA-530-draft.patch, CHUKWA-530.patch > > > UDPAdaptor can record syslog logs but the log entry is tagged with Chukwa internal data type at adaptor start up time. I am thinking to extend UDPAdaptor to record syslog messages with small enhancements. SyslogAdaptor can extract facility name field from syslog message to tag facility name as the data type. This would provide the ability to invoke different demux parsers base on the facility name in syslog. HOSTNAME can also be mapped to source for Chukwa chunk meta data. > My use case is to configure hadoop log4j.properties to log everything through org.apache.log4j.net.SyslogAppender to one SysLogAdaptor on the local Chukwa agent, and invokes different parsers for audit log and name node log. Facility name is some what limited, but it should be enough type left to manage hadoop log files. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.