Return-Path: 
 <user-return-5721-apmail-flume-user-archive=flume.apache.org@flume.apache.org>
X-Original-To: apmail-flume-user-archive@www.apache.org
Delivered-To: apmail-flume-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 80A18119F3
	for <apmail-flume-user-archive@www.apache.org>;
 Fri,  1 Aug 2014 04:05:43 +0000 (UTC)
Received: (qmail 88769 invoked by uid 500); 1 Aug 2014 04:05:43 -0000
Delivered-To: apmail-flume-user-archive@flume.apache.org
Received: (qmail 88698 invoked by uid 500); 1 Aug 2014 04:05:43 -0000
Mailing-List: contact user-help@flume.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@flume.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@flume.apache.org>
List-Post: <mailto:user@flume.apache.org>
List-Id: <user.flume.apache.org>
Reply-To: user@flume.apache.org
Delivered-To: mailing list user@flume.apache.org
Received: (qmail 88688 invoked by uid 99); 1 Aug 2014 04:05:43 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Aug 2014 04:05:43 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of durgapalmohit@gmail.com
 designates 209.85.215.49 as permitted sender)
Received: from [209.85.215.49] (HELO mail-la0-f49.google.com) (209.85.215.49)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Aug 2014 04:05:37 +0000
Received: by mail-la0-f49.google.com with SMTP id hz20so2711316lab.8
        for <user@flume.apache.org>; Thu, 31 Jul 2014 21:05:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        bh=TP3Poqn8c+ffFLjOYnKpXwgI6Ds8RJ0enoKHfuSRzHo=;
        b=rWS7SS2Lz44MOuYdWX6VB63CP76alxds03/IKAdNEycPMm0lVODKQxTv0eyPyTUj6Y
         SpNUELx33LxCdD3r2h3itdoj+nTK2FyYBxkfyCTzv4fM0Ncl2PjQNZHMffuhF1wTF2fO
         25bJJnpca4cEFj5PuzMvkK76Po1wuKbDS4A3c6qHqkWzpc1Fz03EI7ocJD5kOfvq6TSq
         9qcENGAWG9jmA40dJfxhhLxemxOkFepktvONO7/pTuN3PUCXDdz5pxR5jRF07cB4ttVN
         ysuQ5gT8uaGADaI/reVZo1Hxv3priTDND0OOGSOdzr2G0X1bm994h7Tuis3sDOYfgGLG
         Hbqg==
X-Received: by 10.152.2.202 with SMTP id 10mr2520097law.93.1406865916014; Thu,
 31 Jul 2014 21:05:16 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.114.233.102 with HTTP; Thu, 31 Jul 2014 21:04:55 -0700 (PDT)
In-Reply-To: 
 <CAAFSTDX6qUpYnViYYwYeVbxTQg_+HW=5woct6m6o-wXhBN+kEw@mail.gmail.com>
References: 
 <CAAFSTDX6qUpYnViYYwYeVbxTQg_+HW=5woct6m6o-wXhBN+kEw@mail.gmail.com>
From: Mohit Durgapal <durgapalmohit@gmail.com>
Date: Fri, 1 Aug 2014 09:34:55 +0530
Message-ID: 
 <CAEJUZ792S_7ofZdN3v0tqX9bfBy9rJTVR_tvtVk_MoXCCNfiRQ@mail.gmail.com>
Subject: Re: Collect TCP data over TCP stream
To: user <user@flume.apache.org>
Content-Type: multipart/alternative; boundary=089e013c61682bb6a404ff897f94
X-Virus-Checked: Checked by ClamAV on apache.org

--089e013c61682bb6a404ff897f94
Content-Type: text/plain; charset=UTF-8

I am not sure if that's exactly what you need but have you tried the syslog
tcp source? It can listen and consume events from a tcp queue on a specific
host & port.


On Fri, Aug 1, 2014 at 8:47 AM, Liu Blade <hafzcdcn@gmail.com> wrote:

> Dear all,
>
> The scenario is we want to collect data over TCP connection which is send
> to backend database server. But it is not possible to use an intrusive way,
> which means we would not collect data on servers.
>
> Is that possible to use libpcap/winpcap to tap into TCP stream, convert it
> to Avro/Thrift, and then send to Flume source?
>
> Very appreciate your suggestions. Please indicate if there are better
> options.
>
> Cheers,
> Blade
>
>

--089e013c61682bb6a404ff897f94
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I am not sure if that&#39;s exactly what you need but have=
 you tried the syslog tcp source? It can listen and consume events from a t=
cp queue on a specific host &amp; port.<br></div><div class=3D"gmail_extra"=
>

<br><br><div class=3D"gmail_quote">On Fri, Aug 1, 2014 at 8:47 AM, Liu Blad=
e <span dir=3D"ltr">&lt;<a href=3D"mailto:hafzcdcn@gmail.com" target=3D"_bl=
ank">hafzcdcn@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail=
_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:=
1ex">

<div dir=3D"ltr"><div>Dear all,</div><div><br></div><div>The scenario is we=
 want to collect data over TCP connection which is send to backend database=
 server. But it is not possible to use an intrusive way, which means we wou=
ld not collect data on servers.</div>


<div><br></div><div>Is that possible to use libpcap/winpcap to tap into TCP=
 stream, convert it to Avro/Thrift, and then send to Flume source?</div><di=
v><br></div><div>Very appreciate your suggestions. Please indicate if there=
 are better options.</div>


<div><br></div><div>Cheers,</div><div>Blade</div><div>=C2=A0</div></div>
</blockquote></div><br></div>

--089e013c61682bb6a404ff897f94--