flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Using Flume *only* for tailing?
Date Thu, 27 Jun 2013 23:02:26 GMT
Hi Alex,
Sorry, no, I didn't mean tailing of N files into one file.

What I'm wondering is whether I could "steal" a few Flume classes that handle the tailing
functionality without having to use all of Flume.
Imagine I want to use Flume's tailing functionality in my app, so I want to use Flume as a
library.... not being familiar with Flume's APIs, imagine if in my app I wanted to do this:

FlumeTail ft = new FlumeTail(new MyLineHandler());

class MyLineHandler extends SomeBaseFlumeLineHandler {
  void handleLine(String line) {
    // do whatever I want with that 'line'

So my questions are:
* Is something like the above even possible?
* Could I borrow a few Flume classes just for doing something like the above?

Monitoring for Solr / ElasticSearch / HBase / Hadoop - http://sematext.com/spm 

> From: Alexander Alten-Lorenz <wget.null@gmail.com>
>To: user@flume.apache.org 
>Sent: Wednesday, June 26, 2013 4:19 AM
>Subject: Re: Using Flume *only* for tailing?
>Hi Otis,
>Do you mean tailing into one file? Maybe 100 exec sources => Flume => one text file
in a local filesystem?
>- Alex
>On Jun 25, 2013, at 6:11 PM, Otis Gospodnetic <otis.gospodnetic@gmail.com> wrote:
>> Hi,
>> I'm wondering if Flume (its ExecSource?) can be used separately from
>> the rest of Flume?
>> Specifically, I need to tail a log file from a Java app and then do
>> something with each new line.  I just want my Java app to get each new
>> line from tailing and process it in some custom way.  In other words,
>> I don't really need Flume to be involved in anything beyond tailing
>> files.
>> Is that doable?
>> Thanks,
>> Otis
>> --
>> Solr & ElasticSearch Support -- http://sematext.com/
>> Performance Monitoring -- http://sematext.com/spm
>Alexander Alten-Lorenz
>German Hadoop LinkedIn Group: http://goo.gl/N8pCF
View raw message