flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: [Flume 1.7.0] 'parseAsFlumeEvent = false' works in Kafka channel?
Date Fri, 03 Jun 2016 09:49:28 GMT
Morphlines should be ok in both cases but if you disable the FlumeEvents
you will lose metadata, so the morthline should be aware of that.
You can always put whatever you want in the body (e.g. a json with the
headers plus the original body)

If metadata is so important to you, it would be better is you leave
parseAsEvent=true and parse the kafka events as avro


On 3 June 2016 at 10:35, George M. <qazw3456@gmail.com> wrote:

>
> The explanation could be clearer but it boils down to this:
>
>
>
> -If you use parseAsEvent=true (default)
>  Then the events in the channel are avro FlumeEvents. So you have to
> read/write avro but you have all the object metadata (timestamp, headers,
> etc)
>
>
>
> -If you use parseAsEvent=false
>
>   Then the events in the channel is just text (no metadata)
>
>
>
> You have to choose either to use pure text or have a richer FlumeEvent
> object.
>
>
>
>
>
> Ok. But both without morphline interceptors. Is it correct?
>
> Thanks.
>

Mime
View raw message