flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashish <paliwalash...@gmail.com>
Subject Re: Collect TCP data over TCP stream
Date Fri, 01 Aug 2014 06:25:26 GMT
Can you please clarify a bit more on "made on fly". I interpret this as
running in promiscuous mode to listen for data and create events out of it.
Is this correct or I am completely off the track?

On Fri, Aug 1, 2014 at 11:25 AM, Liu Blade <hafzcdcn@gmail.com> wrote:

> Hi folks,
> Sorry didn't clarify my problem.  The problem has two folds: (1) use which
> way to collect incoming TCP streams from external connections, and it must
> be made on the fly; (2)use which method as Flume source, e.g., syslogTcp,
> Avro.
> It seems syslog is unable to tap into TCP connections. Look forward to
> your opinions.
> Thanks,
> 2014-08-01 11:17 GMT+08:00 Liu Blade <hafzcdcn@gmail.com>:
> Dear all,
>> The scenario is we want to collect data over TCP connection which is send
>> to backend database server. But it is not possible to use an intrusive way,
>> which means we would not collect data on servers.
>> Is that possible to use libpcap/winpcap to tap into TCP stream, convert
>> it to Avro/Thrift, and then send to Flume source?
>> Very appreciate your suggestions. Please indicate if there are better
>> options.
>> Cheers,
>> Blade


Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal

View raw message