chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-185) ability to tail a whole directory
Date Fri, 12 Jun 2009 22:35:07 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719007#action_12719007
] 

Ari Rabkin commented on CHUKWA-185:
-----------------------------------

Proposal:  
DirTailingAdaptor should take two parameters; a directory and an optional date.
It will periodically scan the directory and all subdirs, and then start filetailing adaptors
on any file modified since that date, if none is running.  Date defaults to the epoch.

Combined with CHUKWA-204, this will prevent adaptor count from rising without bound, while
still making it easy to snarf a whole directory tree.

I assume this is going into trunk, not 0.2?

> ability to tail a whole directory
> ---------------------------------
>
>                 Key: CHUKWA-185
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-185
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: data collection
>    Affects Versions: 0.1.2
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>
> Right now, FileTailingAdaptors watch particular files.   It'd be great to be able to
watch a whole path: to say something like /var/logs/*, where new logs created in that directory
get picked up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message