flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Praveen Ramachandra <praveen_ramachan...@yahoo.com>
Subject Re: Collecting data coming over HTTP
Date Wed, 23 Nov 2011 03:27:19 GMT
Hi Tariq,

It is possible, in fact we had two prototypes doing exactly that, it has been quite some time
so trying to re-collect from memory.

You have to write a custom source extending from base source classes of flume. Depending upon
your requirements you can either data an in memory queue that the http sevice handler will
write to. The custom source will pick it from memory and provide it to flume to carry foward.

Another easier approach is the http handler writes to a log file and you can use flume's built-in
utilities to move the data you have in files.

Praveen Ramachandra

 From: Mohammad Tariq <dontariq@gmail.com>
To: flume-user@incubator.apache.org 
Sent: Wednesday, November 23, 2011 2:04 AM
Subject: Collecting data coming over HTTP
Hello list,

   I would like to know whether it is possible to collect data coming
from a server over http using Flume or not????If yes, what should be
the appropriate approach???

    Mohammad Tariq
View raw message