Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flume.apache.org
Received-SPF: pass (nike.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
From: Chhaya Vishwakarma <Chhaya.Vishwakarma@lntinfotech.com>
To: Wolfgang Hoschek <whoschek@cloudera.com>
CC: "user@flume.apache.org" <user@flume.apache.org>
Date: Thu, 23 Jan 2014 08:38:21 +0530
Subject: RE: flume agent not starting
Thread-Topic: flume agent not starting
Thread-Index: Ac8XfmwHzQTHvyyWSryTTxBEVrn9ygAadv+A
Message-ID: 
 <969B118F8FF0104281DFF098C3347540576246EB7E@PUNINMSMBX01.puneodc.lntinfotech.com>
References: 
 <969B118F8FF0104281DFF098C33475405476B2589C@PUNINMSMBX01.puneodc.lntinfotech.com>
 <7D3C89B5-43ED-4E7F-B62C-60E0F72A264D@cloudera.com>
 <969B118F8FF0104281DFF098C3347540576246E7B0@PUNINMSMBX01.puneodc.lntinfotech.com>
 <969B118F8FF0104281DFF098C3347540576246E8D3@PUNINMSMBX01.puneodc.lntinfotech.com>
 <FB5CEF89-9284-4CCA-9013-64956008C38C@cloudera.com>
In-Reply-To: <FB5CEF89-9284-4CCA-9013-64956008C38C@cloudera.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi,

I want multiple line as one flume event=20


Regards,
Chhaya Vishwakarma


-----Original Message-----
From: Wolfgang Hoschek [mailto:whoschek@cloudera.com]=20
Sent: Wednesday, January 22, 2014 8:00 PM
To: Chhaya Vishwakarma
Cc: user@flume.apache.org
Subject: Re: flume agent not starting

ExecSource always spits out one flume event per line, no matter what comman=
d is executed.

On Jan 22, 2014, at 9:09 AM, Chhaya Vishwakarma wrote:

> Hi,
>=20
> Is my interceptor configuration correct? Or there is some problem with th=
at ?
> Can someone guide me in this
> Instead of tail I am using CAT now but same error its giving
>=20
> Regards,
> Chhaya Vishwakarma
>=20
>=20
>=20
> -----Original Message-----
> From: Chhaya Vishwakarma [mailto:Chhaya.Vishwakarma@lntinfotech.com]
> Sent: Wednesday, January 22, 2014 10:20 AM
> To: user@flume.apache.org
> Subject: RE: flume agent not starting
>=20
> Hi ,
>=20
> What i should use then for interceptor to work shall I use CAT ??
>=20
> -----Original Message-----
> From: Wolfgang Hoschek [mailto:whoschek@cloudera.com]
> Sent: Tuesday, January 21, 2014 6:30 PM
> To: user@flume.apache.org
> Subject: Re: flume agent not starting
>=20
> 'tail' with exec source spits out one flume event per line into the inter=
ceptor. But readMultiLine expects multiple lines per event, not one line pe=
r event. In other words, by the time the data arrives in the interceptor it=
's already too late for readMultiLine to make sense.
>=20
> Wolfgang.
>=20
>=20
> On Jan 17, 2014, at 2:42 PM, Chhaya Vishwakarma wrote:
>=20
>> Hi,
>>=20
>> Agent is starting I am using morphline interceptor to parse events
>>=20
>> Below is my morphline configuration
>>=20
>> morphlines : [
>> {
>> id : morphline1
>>=20
>> commands : [
>> {
>> readMultiLine {
>>  regex : "Started session*"
>>  what : next
>>  charset : UTF-8
>> }
>> }
>> ]
>> }
>> ]
>>=20
>> This is my flume configuration file
>>=20
>> host1.sources =3D src1
>> host1.sinks =3D sink1
>> host1.channels =3D ch1
>>=20
>> host1.sources.src1.type =3D exec
>> host1.sources.src1.command =3D tail -F
>> /home/user/apache-flume-1.4.0-bin/try.log
>> host1.sources.src1.channels =3D ch1
>> host1.sources.src1.restart =3D true
>> #host1.sources.src1.batchsize=3D10
>>=20
>> host1.sources.src1.interceptors =3D morphlineinterceptor=20
>> host1.sources.src1.interceptors.morphlineinterceptor.type =3D=20
>> org.apache.flume.sink.solr.morphline.MorphlineInterceptor$Builder
>> host1.sources.src1.interceptors.morphlineinterceptor.morphlineFile =3D=20
>> /home/user/apache-flume-1.4.0-bin/morphline.conf
>>=20
>> host1.sinks.sink1.type =3D file_roll
>> host1.sinks.sink1.channel =3D ch1
>> host1.sinks.sink1.sink.directory =3D /home/user/apache-flume-1.4.0-bin=20
>> host1.sinks.sink1.sink.serializer=3D TEXT
>> host1.sinks.sink1.sink.rollInterval=3D0
>>=20
>> host1.channels.ch1.capacity=3D1000
>> host1.channels.ch1.transactionCapacity=3D100
>>=20
>> host1.channels.ch1.type=3Dmemory
>>=20
>> input file content
>>=20
>> Started session
>> a
>> b
>> c
>> Started session
>> c
>> d
>> e
>> Started session
>>=20
>> But in /home/user/apache-flume-1.4.0-bin I can see a file named
>> 1389960784130-1 but it's not showing any content. I can see only new=20
>> line characters in output file
>>=20
>> Regards,
>> Chhaya Vishwakarma
>>=20
>>=20
>> The contents of this e-mail and any attachment(s) may contain confidenti=
al or privileged information for the intended recipient(s). Unintended reci=
pients are prohibited from taking action on the basis of information in thi=
s e-mail and using or disseminating the information, and must notify the se=
nder and delete it from their system. L&T Infotech will not accept responsi=
bility or liability for the accuracy or completeness of, or the presence of=
 any virus or disabling code in this e-mail"
>=20