chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Commented: (CHUKWA-185) ability to tail a whole directory
Date Tue, 19 May 2009 07:42:45 GMT


Ari Rabkin commented on CHUKWA-185:

The approach I had in mind was the following -- 
Define a "DirTailingAdaptor", that takes as parameters a directory, and enough options to
create a FileTailingAdaptor.  (probably a class name and a data type)

That adaptor should scan the directory; if it sees a new file, it should start a tailing adaptor
on it.
Keep a list of currently running adaptors in the directory.

For now, we can punt on expiring the adaptors -- CHUKWA-204 will solve that problem. 

> ability to tail a whole directory
> ---------------------------------
>                 Key: CHUKWA-185
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: data collection
>    Affects Versions: 0.1.2
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
> Right now, FileTailingAdaptors watch particular files.   It'd be great to be able to
watch a whole path: to say something like /var/logs/*, where new logs created in that directory
get picked up.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message