Return-Path: Delivered-To: apmail-hadoop-chukwa-user-archive@minotaur.apache.org Received: (qmail 24641 invoked from network); 7 Jul 2010 09:43:12 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 Jul 2010 09:43:12 -0000 Received: (qmail 17793 invoked by uid 500); 7 Jul 2010 09:43:12 -0000 Delivered-To: apmail-hadoop-chukwa-user-archive@hadoop.apache.org Received: (qmail 17686 invoked by uid 500); 7 Jul 2010 09:43:09 -0000 Mailing-List: contact chukwa-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-user@hadoop.apache.org Delivered-To: mailing list chukwa-user@hadoop.apache.org Received: (qmail 17673 invoked by uid 99); 7 Jul 2010 09:43:08 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jul 2010 09:43:08 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Stuti_Awasthi@persistent.co.in designates 202.54.11.87 as permitted sender) Received: from [202.54.11.87] (HELO bmapps.persistent.co.in) (202.54.11.87) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jul 2010 09:43:00 +0000 X-AuditID: 0a4e0006-b7c0aae00000732e-5c-4c344bee1b8f Received: from puneexchange.persistent.co.in ( [10.78.0.1]) by bmapps.persistent.co.in (Symantec Mail Security) with SMTP id 0A.38.29486.EEB443C4; Wed, 7 Jul 2010 15:12:06 +0530 (IST) Received: from Exchange.persistent.co.in ([fe80::ad8a:d553:ef93:bfdd]) by CAS2 ([10.77.224.47]) with mapi; Wed, 7 Jul 2010 15:12:06 +0530 From: Stuti Awasthi To: "chukwa-user@hadoop.apache.org" CC: Jerome Boulon Date: Wed, 7 Jul 2010 15:11:59 +0530 Subject: Adapter for multiple line record Thread-Topic: Adapter for multiple line record Thread-Index: AcsduKUlD8dXAkJtTn+7o4M69cQ1Xg== Message-ID: Accept-Language: en-US, en-IN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-cr-hashedpuzzle: AsSB FRrU GFE4 I/Gw JgCK KMcU K0IF MP2v MhP1 MiwN Ollh RrgZ UXjv Wn04 W0tl Xchf;2;YwBoAHUAawB3AGEALQB1AHMAZQByAEAAaABhAGQAbwBvAHAALgBhAHAAYQBjAGgAZQAuAG8AcgBnADsAagBiAG8AdQBsAG8AbgBAAG4AZQB0AGYAbABpAHgALgBjAG8AbQA=;Sosha1_v1;7;{CE88E98B-A036-45B7-AD8C-867E0537A7D6};cwB0AHUAdABpAF8AYQB3AGEAcwB0AGgAaQBAAHAAZQByAHMAaQBzAHQAZQBuAHQALgBjAG8ALgBpAG4A;Wed, 07 Jul 2010 09:41:59 GMT;QQBkAGEAcAB0AGUAcgAgAGYAbwByACAAbQB1AGwAdABpAHAAbABlACAAbABpAG4AZQAgAHIAZQBjAG8AcgBkAA== x-cr-puzzleid: {CE88E98B-A036-45B7-AD8C-867E0537A7D6} acceptlanguage: en-US, en-IN Content-Type: multipart/alternative; boundary="_000_F544E3AA46CA024ABF9609FED980E5F108798B1626EXCHANGEpersi_" MIME-Version: 1.0 X-Brightmail-Tracker: AAAAAQAAAZE= X-Virus-Checked: Checked by ClamAV on apache.org --_000_F544E3AA46CA024ABF9609FED980E5F108798B1626EXCHANGEpersi_ Content-Type: text/plain; charset="us-ascii" content-transfer-encoding: quoted-printable Hi All, Till now I have worked with logs which have single record in one line. I was= able to use the specified adapters like CharcaterFileTailing for processing= the logs. But now, I have different requirement, I having logs which have multiple lin= es in a single record. Here I want my whole record to be parsed as a single= record. CharacterFileTailingAdapter, FileTailing adapter are not fulfilling my purpo= se. As in CharacterFileTailingAdapter process the log on the basis of separa= tor as "\n" and FileTailingAdapter process the logs as chunks. For example : Log [ Record 1: { [Line1 ............] [Line2 ............] [Line3 ............] } Record 2: { [Line1 ............] [Line2 ............] [Line3 ............] } ] Is there any way that I can use specified adapters by chukwa or else I have= to generate my own Adapter. Please Help :) Stuti DISCLAIMER=0A= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A= This e-mail may contain privileged and confidential information which is the= property of Persistent Systems Ltd. It is intended only for the use of the= individual or entity to which it is addressed. If you are not the intended= recipient, you are not authorized to read, retain, copy, print, distribute= or use this message. If you have received this communication in error, plea= se notify the sender and delete all copies of this message. Persistent Syste= ms Ltd. does not accept any liability for virus infected mails. --_000_F544E3AA46CA024ABF9609FED980E5F108798B1626EXCHANGEpersi_ Content-Type: text/html; charset="us-ascii" content-transfer-encoding: quoted-printable

Hi All,

 

Till now I have worked with logs which have single reco= rd in one line. I was able to use the specified adapters like CharcaterFileTailing= for processing the logs.

 

But now, I have different requirement, I having logs wh= ich have multiple lines in a single record. Here I want my whole record to be pa= rsed as a single record.

CharacterFileTailingAdapter, FileTailing adapter are no= t fulfilling my purpose. As in CharacterFileTailingAdapter process the log on= the basis of separator as “\n”

and FileTailingAdapter  process the logs as chunks= .

 

For example :

 

Log [

Record 1:

{

[Line1 ………= …]

[Line2 ………= …]

[Line3 ………= …]

}

 

Record 2:

{

[Line1 ………= …]

[Line2 ………= …]

[Line3 ………= …]

}

         &= nbsp;     

       ]

 

Is there any way that I can use specified adapters by c= hukwa or else I have to generate my own Adapter.

 

Please Help J

 

Stuti<= /o:p>

DISCLAIMER=0A= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=0A= This e-mail may contain privileged and confidential information which is the= property of Persistent Systems Ltd. It is intended only for the use of the= individual or entity to which it is addressed. If you are not the intended= recipient, you are not authorized to read, retain, copy, print, distribute= or use this message. If you have received this communication in error, plea= se notify the sender and delete all copies of this message. Persistent Syste= ms Ltd. does not accept any liability for virus infected mails.

--_000_F544E3AA46CA024ABF9609FED980E5F108798B1626EXCHANGEpersi_--