flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Balázs Donát Bessenyei <bes...@cloudera.com>
Subject Re: Review Request 51244: FLUME-2171: Add Interceptor to remove headers from event
Date Mon, 22 Aug 2016 23:10:04 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51244/
-----------------------------------------------------------

(Updated Aug. 22, 2016, 11:10 p.m.)


Review request for Flume.


Changes
-------

git diff --no-prefix
so that changes would show


Bugs: FLUME-2171
    https://issues.apache.org/jira/browse/FLUME-2171


Repository: flume-git


Description
-------

I found Flume OG's decorators to handle event headers useful and some to be missing from Flume
NG. More specifically, we could have an interceptor to remove headers from an event.


Diffs (updated)
-----

  flume-ng-core/src/main/java/org/apache/flume/interceptor/RemoveHeaderInterceptor.java PRE-CREATION

  flume-ng-core/src/test/java/org/apache/flume/interceptor/RemoveHeaderInterceptorTest.java
PRE-CREATION 
  flume-ng-doc/sphinx/FlumeUserGuide.rst c614991 

Diff: https://reviews.apache.org/r/51244/diff/


Testing
-------

All tests (besides the FLUME-2974-related ones) in flume-ng-core run successfully

I've used this config for manual testing:

a1.sources = r1
a1.sources.r1.type = netcat
a1.sources.r1.bind = 0.0.0.0
a1.sources.r1.port = 6666
a1.sources.r1.channels = c1

a1.channels = c1
a1.channels.c1.type = memory
a1.channels.c1.capacity = 10000
a1.channels.c1.transactionCapacity = 10000
a1.channels.c1.byteCapacityBufferPercentage = 20
a1.channels.c1.byteCapacity = 800000

a1.channels = c1
a1.sinks = k1
a1.sinks.k1.type = logger
a1.sinks.k1.channel = c1


a1.sources.r1.interceptors = i1 i2 i3
a1.sources.r1.interceptors.i1.type = timestamp

a1.sources.r1.interceptors.i2.type = host
a1.sources.r1.interceptors.i2.hostHeader = hostname

a1.sources.r1.interceptors.i3.type = remove_header
a1.sources.r1.interceptors.i3.with.name = timestamp


Thanks,

Balázs Donát Bessenyei


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message