Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0F6B311FA9 for ; Tue, 16 Sep 2014 14:02:11 +0000 (UTC) Received: (qmail 50291 invoked by uid 500); 16 Sep 2014 14:02:10 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 50232 invoked by uid 500); 16 Sep 2014 14:02:10 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 50222 invoked by uid 99); 16 Sep 2014 14:02:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Sep 2014 14:02:10 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of cpalm3@gmail.com designates 74.125.82.173 as permitted sender) Received: from [74.125.82.173] (HELO mail-we0-f173.google.com) (74.125.82.173) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Sep 2014 14:02:05 +0000 Received: by mail-we0-f173.google.com with SMTP id u56so5747012wes.4 for ; Tue, 16 Sep 2014 07:01:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=KtWRcN2TZCZ3gK+189hwKTVZB++ohvzONaMbbvM/q2w=; b=zrcGPCaVsQe8F3HwvtvcnmeI9xSHXdute7pC0ukZXmfee0kYgu7yqEZ/X0PDicKGHE THZGb6Erd6IBbIUhmOAudC1mI/5q1FzBTttdbownwHI9CxMeuhCaCE8OVZOmAqKcLQtG Waq1A2y4OzUAqFLAM0thGv3TavoEJf0PVZlPXNHdH9iKEBkQ3eUDRNsTJQrv2ODp4jM/ 75qyrqZKp9rb7EAmms7DcPGD4wi57ZoNmmM+ofcEBSqfGKdKHGgbAWnruoxIMPp5xy5/ /fy6Mg/t2J/TG4NN5NC+eZsrP+LugX4xtRA8uB6HvDXC46VPvR1ZmVArx4zkHnXvZ3+R 5OLg== MIME-Version: 1.0 X-Received: by 10.180.9.144 with SMTP id z16mr33119677wia.26.1410876100998; Tue, 16 Sep 2014 07:01:40 -0700 (PDT) Received: by 10.194.237.42 with HTTP; Tue, 16 Sep 2014 07:01:40 -0700 (PDT) Date: Tue, 16 Sep 2014 09:01:40 -0500 Message-ID: Subject: Static Interceptors Not Working From: christopher palm To: user Content-Type: multipart/alternative; boundary=001a11c24a5ad2865605032f3033 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c24a5ad2865605032f3033 Content-Type: text/plain; charset=UTF-8 All, I am trying to get the static interceptor to insert key, value information in each line that is written out in my data sink. I have tried this with various configurations, but can't seem to get any output from the interceptor to show up in the output files produced by Flume in the target data directory. Below is my latest config, using spooldir as the source and a file_roll sink as the output. Any suggestions as to what I am configuring wrong here? Thanks, Chris client.channels=ch1 client.channels.ch1.type=memory client.channels.ch1.capacity=100000 client.channels.ch1.transactionCapacity=100000 client.sources=src-1 client.sources.src-1.type=spooldir client.sources.src-1.spoolDir=/opt/app/solr/flume/sinkIn client.sources.src-1.deserializer.maxLineLength=10000 client.sources.src-1.interceptors = i1 client.sources.src-1.interceptors.i1.type = static client.sources.src-1.interceptors.i1.preserveExisting = false client.sources.src-1.interceptors.i1.key = datacenter client.sources.src-1.interceptors.i1.value= NYC_01 client.sinks=k1 #client.sinks.k1.type=avro #client.sinks.k1.hostname=localhost #client.sinks.k1.port=42424 ## Debugging Sink, Comment out AvroSink if you use this one # http://flume.apache.org/FlumeUserGuide.html#file-roll-sink client.sinks.k1.type = file_roll client.sinks.k1.sink.directory = /opt/app/solr/flume/sinkOut client.sinks.k1.sink.rollInterval = 0 # Connect soure and sink with channel client.sources.src-1.channels=ch1 client.sinks.k1.channel=ch1 --001a11c24a5ad2865605032f3033 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
All,

I am trying to get the static interceptor to= insert key, value information in each line that is written
out in my da= ta sink.
I have tried this with various configurations, but can't se= em to get any output from the interceptor
to show up in the output files= produced by Flume in the target data directory.
Below is my latest conf= ig, using spooldir as the source and a file_roll sink as the output.
<= div style=3D"font-family:arial,sans-serif;font-size:12.8000001907349px">
Any suggestions as to what I am configuring wrong here?

<= div style=3D"font-family:arial,sans-serif;font-size:12.8000001907349px">Tha= nks,
Chris

client.channels=3Dch1
client.channe= ls.ch1.type=3Dmemory
client.channels.ch1.capacity=3D100000
<= div>client.channels.ch1.transactionCapacity=3D100000

client.sources=3Dsrc-1
client.sources.src-1.type=3Dspooldir
client.sources.src-1.spoolDir=3D/opt/app/solr/flume/sinkIn
client.sources.src-1.deserializer.maxLineLength=3D10000
client.= sources.src-1.interceptors =3D i1
client.sources.src-1.intercepto= rs.i1.type =3D static
client.sources.src-1.interceptors.i1.preser= veExisting =3D false
client.sources.src-1.interceptors.i1.key =3D= datacenter
client.sources.src-1.interceptors.i1.value=3D NYC_01<= /div>
client.sinks=3Dk1
#client.sinks.k1.type=3Davro
#client.sinks.k1.hostname=3Dlocalhost
#client.sinks.k1.port=3D4= 2424
## Debugging Sink, Comment out AvroSink if you use this one<= /div>
client.sinks.k1.type =3D file_roll
c= lient.sinks.k1.sink.directory =3D /opt/app/solr/flume/sinkOut
cli= ent.sinks.k1.sink.rollInterval =3D 0

# Connect sou= re and sink with channel
client.sources.src-1.channels=3Dch1
client.sinks.k1.channel=3Dch1
--001a11c24a5ad2865605032f3033--