Return-Path: Delivered-To: apmail-incubator-chukwa-dev-archive@www.apache.org Received: (qmail 36254 invoked from network); 3 Oct 2010 03:30:56 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 3 Oct 2010 03:30:56 -0000 Received: (qmail 33338 invoked by uid 500); 3 Oct 2010 03:30:56 -0000 Delivered-To: apmail-incubator-chukwa-dev-archive@incubator.apache.org Received: (qmail 33270 invoked by uid 500); 3 Oct 2010 03:30:54 -0000 Mailing-List: contact chukwa-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@incubator.apache.org Delivered-To: mailing list chukwa-dev@incubator.apache.org Received: (qmail 33251 invoked by uid 99); 3 Oct 2010 03:30:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Oct 2010 03:30:52 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of asrabkin@gmail.com designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-wy0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Oct 2010 03:30:45 +0000 Received: by wyb35 with SMTP id 35so4133815wyb.6 for ; Sat, 02 Oct 2010 20:30:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=7CHOtzeD+TIWiVlaBHiMB1hiCdr/9/ph0KyEjtt+dcQ=; b=lHN8khP5kz2iCYcMcRXz1uxea7ttcSZCac78EEDQPHl7IWYBvorKdRisA+073txrab tLk/OPMmE8FsaASdDUCYq+P62aQScX9MCb4SXCugvLeh8Y4J9Yc2SGbzxcsQQS/AYSvI HbVSwdsWOFjts6ArH5CGkYmEnCv/z0NC3H8AI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Pw3qRGpNxl2CsXpK4xX5T5vzsQkkz+ru6oXgNoW6+/F1URg/OCndHvu+YRUQwO/RuG HXP8DaMmPXJrw5QBodKc0XbV/7AreC8pS9tlUDMKC/LvMRvM4XjlTPuF8QV9Ob1Dn0Ol 1V+bPYtV7UhAIXlQ7RsjbK1Az3gDwBjdvahO4= MIME-Version: 1.0 Received: by 10.216.22.193 with SMTP id t43mr3821622wet.82.1286076624802; Sat, 02 Oct 2010 20:30:24 -0700 (PDT) Received: by 10.216.52.19 with HTTP; Sat, 2 Oct 2010 20:30:24 -0700 (PDT) In-Reply-To: References: Date: Sat, 2 Oct 2010 20:30:24 -0700 Message-ID: Subject: Re: Planning for SyslogAdaptor From: Ariel Rabkin To: chukwa-dev@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Yes. That sounds like a good idea. Can you reuse any of the UDPAdaptor code by inheritance? (Or by refactoring, and then using inheritance?) --Ari On Sat, Oct 2, 2010 at 5:05 PM, Eric Yang wrote: > Hi, > > UDPAdaptor can record syslog logs but the log entry is tagged with > Chukwa internal data type at adaptor start up time. =A0I am thinking to > extend UDPAdaptor to record syslog messages with small enhancements. > SyslogAdaptor can extract facility name field from syslog message to > tag facility name as the data type. =A0This would provide the ability to > invoke different demux parsers base on the facility name in syslog. > HOSTNAME can also be mapped to source for Chukwa chunk meta data. > > My use case is to configure hadoop log4j.properties to log everything > through org.apache.log4j.net.SyslogAppender to one SysLogAdaptor on > the local Chukwa agent, and invokes different parsers for audit log > and name node log. =A0Facility name is some what limited, but it should > be enough type left to manage hadoop log files. =A0Suggestion and > feedbacks are welcome. > > regards, > Eric > --=20 Ari Rabkin asrabkin@gmail.com UC Berkeley Computer Science Department