flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Static Interceptors Not Working
Date Tue, 16 Sep 2014 16:10:46 GMT
Try using HEADER_AND_TEXT as serializer for sink, default is Text
Serializer that writes only the Event body.

On Tue, Sep 16, 2014 at 7:31 PM, christopher palm <cpalm3@gmail.com> wrote:

> All,
>
> I am trying to get the static interceptor to insert key, value information
> in each line that is written
> out in my data sink.
> I have tried this with various configurations, but can't seem to get any
> output from the interceptor
> to show up in the output files produced by Flume in the target data
> directory.
> Below is my latest config, using spooldir as the source and a file_roll
> sink as the output.
>
> Any suggestions as to what I am configuring wrong here?
>
> Thanks,
> Chris
>
> client.channels=ch1
> client.channels.ch1.type=memory
> client.channels.ch1.capacity=100000
> client.channels.ch1.transactionCapacity=100000
>
> client.sources=src-1
> client.sources.src-1.type=spooldir
> client.sources.src-1.spoolDir=/opt/app/solr/flume/sinkIn
> client.sources.src-1.deserializer.maxLineLength=10000
> client.sources.src-1.interceptors = i1
> client.sources.src-1.interceptors.i1.type = static
> client.sources.src-1.interceptors.i1.preserveExisting = false
> client.sources.src-1.interceptors.i1.key = datacenter
> client.sources.src-1.interceptors.i1.value= NYC_01
> client.sinks=k1
> #client.sinks.k1.type=avro
> #client.sinks.k1.hostname=localhost
> #client.sinks.k1.port=42424
> ## Debugging Sink, Comment out AvroSink if you use this one
> # http://flume.apache.org/FlumeUserGuide.html#file-roll-sink
> client.sinks.k1.type = file_roll
> client.sinks.k1.sink.directory = /opt/app/solr/flume/sinkOut
> client.sinks.k1.sink.rollInterval = 0
>
> # Connect soure and sink with channel
> client.sources.src-1.channels=ch1
> client.sinks.k1.channel=ch1
>



-- 
thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

Mime
View raw message