Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1164110116 for ; Fri, 17 Jan 2014 12:42:55 +0000 (UTC) Received: (qmail 66397 invoked by uid 500); 17 Jan 2014 12:42:54 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 66363 invoked by uid 500); 17 Jan 2014 12:42:53 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 66355 invoked by uid 99); 17 Jan 2014 12:42:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jan 2014 12:42:53 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [208.65.145.68] (HELO p01c12o145.mxlogic.net) (208.65.145.68) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jan 2014 12:42:44 +0000 Received: from unknown [202.54.41.44] by p01c12o145.mxlogic.net(mxl_mta-7.2.2-0) with SMTP id b2529d25.0.38460.00-387.89616.p01c12o145.mxlogic.net (envelope-from ); Fri, 17 Jan 2014 05:42:22 -0700 (MST) X-MXL-Hash: 52d9252e4153bef1-994d9863e1b46d4a0797c94e2158f710c3ff742f Received: from puninmsmbx01.puneodc.lntinfotech.com ([169.254.2.74]) by PUNINMSHTCAS02.puneodc.lntinfotech.com ([172.20.8.114]) with mapi; Fri, 17 Jan 2014 18:12:02 +0530 From: Chhaya Vishwakarma To: "user@flume.apache.org" Date: Fri, 17 Jan 2014 18:12:01 +0530 Subject: Re: flume agent not starting Thread-Topic: Re: flume agent not starting Thread-Index: Ac8TgEvzuBGvGkz/TeOrxnxPZTqRzA== Message-ID: <969B118F8FF0104281DFF098C33475405476B2589C@PUNINMSMBX01.puneodc.lntinfotech.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_969B118F8FF0104281DFF098C33475405476B2589CPUNINMSMBX01p_" MIME-Version: 1.0 X-AnalysisOut: [v=2.0 cv=JuxGWrEC c=1 sm=1 a=G92H4EIlNNk5jbqx+VE5aw==:17 a] X-AnalysisOut: [=MHmriYiyTdgA:10 a=BLceEmwcHowA:10 a=tP0R5P8-AAAA:8 a=24K5] X-AnalysisOut: [aGlSWT4A:10 a=zL_KwGp0sNu2zVz60YwA:9 a=CjuIK1q_8ugA:10 a=L] X-AnalysisOut: [KvKWH8enH8-Sgvt:21 a=E9HQiqVrwub4hiaA:21 a=yMhMjlubAAAA:8 ] X-AnalysisOut: [a=SSmOFEACAAAA:8 a=nZTIAECv3W1oykx1CqMA:9 a=gKO2Hq4RSVkA:1] X-AnalysisOut: [0 a=UiCQ7L4-1S4A:10 a=hTZeC7Yk6K0A:10 a=frz4AuCg-hUA:10 a=] X-AnalysisOut: [UnNJTorBs7xr_DZ4:21] X-Spam: [F=0.2000000000; CM=0.500; S=0.200(2010122901)] X-MAIL-FROM: X-SOURCE-IP: [202.54.41.44] X-Virus-Checked: Checked by ClamAV on apache.org --_000_969B118F8FF0104281DFF098C33475405476B2589CPUNINMSMBX01p_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, Agent is starting I am using morphline interceptor to parse events Below is my morphline configuration morphlines : [ { id : morphline1 commands : [ { readMultiLine { regex : "Started session*" what : next charset : UTF-8 } } ] } ] This is my flume configuration file host1.sources =3D src1 host1.sinks =3D sink1 host1.channels =3D ch1 host1.sources.src1.type =3D exec host1.sources.src1.command =3D tail -F /home/user/apache-flume-1.4.0-bin/tr= y.log host1.sources.src1.channels =3D ch1 host1.sources.src1.restart =3D true #host1.sources.src1.batchsize=3D10 host1.sources.src1.interceptors =3D morphlineinterceptor host1.sources.src1.interceptors.morphlineinterceptor.type =3D org.apache.fl= ume.sink.solr.morphline.MorphlineInterceptor$Builder host1.sources.src1.interceptors.morphlineinterceptor.morphlineFile =3D /hom= e/user/apache-flume-1.4.0-bin/morphline.conf host1.sinks.sink1.type =3D file_roll host1.sinks.sink1.channel =3D ch1 host1.sinks.sink1.sink.directory =3D /home/user/apache-flume-1.4.0-bin host1.sinks.sink1.sink.serializer=3D TEXT host1.sinks.sink1.sink.rollInterval=3D0 host1.channels.ch1.capacity=3D1000 host1.channels.ch1.transactionCapacity=3D100 host1.channels.ch1.type=3Dmemory input file content Started session a b c Started session c d e Started session But in /home/user/apache-flume-1.4.0-bin I can see a file named 13899607841= 30-1 but it's not showing any content. I can see only new line characters i= n output file Regards, Chhaya Vishwakarma ________________________________ The contents of this e-mail and any attachment(s) may contain confidential = or privileged information for the intended recipient(s). Unintended recipie= nts are prohibited from taking action on the basis of information in this e= -mail and using or disseminating the information, and must notify the sende= r and delete it from their system. L&T Infotech will not accept responsibil= ity or liability for the accuracy or completeness of, or the presence of an= y virus or disabling code in this e-mail" --_000_969B118F8FF0104281DFF098C33475405476B2589CPUNINMSMBX01p_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

Agent is starting I am using morphline interceptor t= o parse events

 

Below is my morphline configuration

 

= morphlines : [

= {

= id : morphline1

=  

= commands : [

= {

= readMultiLine {

=   regex : "Started session*"

=   what : next

=   charset : UTF-8

= }

= }

= ]

= }

= ]

 

This is my flume configuration file

 

= host1.sources =3D src1

= host1.sinks =3D sink1

= host1.channels =3D ch1

=  

= host1.sources.src1.type =3D exec

= host1.sources.src1.command =3D tail -F /home/user/apache-flume-1.4.0-bin/tr= y.log

= host1.sources.src1.channels =3D ch1

= host1.sources.src1.restart =3D true

= #host1.sources.src1.batchsize=3D10

=  

= host1.sources.src1.interceptors =3D morphlineinterceptor<= /p>

= host1.sources.src1.interceptors.morphlineinterceptor.type =3D org.apache.fl= ume.sink.solr.morphline.MorphlineInterceptor$Builder

= host1.sources.src1.interceptors.morphlineinterceptor.morphlineFile =3D /hom= e/user/apache-flume-1.4.0-bin/morphline.conf

=  

= host1.sinks.sink1.type =3D file_roll

= host1.sinks.sink1.channel =3D ch1

= host1.sinks.sink1.sink.directory =3D /home/user/apache-flume-1.4.0-bin=

= host1.sinks.sink1.sink.serializer=3D TEXT

= host1.sinks.sink1.sink.rollInterval=3D0

=  

= host1.channels.ch1.capacity=3D1000

= host1.channels.ch1.transactionCapacity=3D100

=  

= host1.channels.ch1.type=3Dmemory

=  

input file content

=  

= Started session

= a

= b

= c

= Started session

= c

= d

= e

= Started session

 

But in /home/user/apache-flume-1.4.0-bin I can see a= file named 1389960784130-1 but it’s not showing any content. I can s= ee only new line characters in output file

 

Regards,

Chhaya Vishwakarma

 


The contents of this e-mail= and any attachment(s) may contain confidential or privileged information f= or the intended recipient(s). Unintended recipients are prohibited from tak= ing action on the basis of information in this e-mail and using or disseminating the information, and must notify= the sender and delete it from their system. L&T Infotech will not acce= pt responsibility or liability for the accuracy or completeness of, or the = presence of any virus or disabling code in this e-mail"
 --_000_969B118F8FF0104281DFF098C33475405476B2589CPUNINMSMBX01p_--