chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Commented: (CHUKWA-185) ability to tail a whole directory
Date Mon, 15 Jun 2009 05:22:07 GMT


Ari Rabkin commented on CHUKWA-185:

I have some code, but a couple concerns.

What should we do if a user tries to tail "/"?  Creating millions of adaptors is *probably*
the Wrong Thing.  But I'm okay saying "this is the user's problem".  Another approach is to
only gradually create the FileTailingAdaptors that do the real tailing, so that the user can
kill it if it goes out of control.

When the DirTailer is stopped, should that stop tailing all the files in the directory, or
just stop scanning for new ones?

Is DirTailer responsible for shutting off the FileTailers after a set period, or is that the
responsibility of the Tailers themselves?

> ability to tail a whole directory
> ---------------------------------
>                 Key: CHUKWA-185
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: data collection
>    Affects Versions: 0.1.2
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
> Right now, FileTailingAdaptors watch particular files.   It'd be great to be able to
watch a whole path: to say something like /var/logs/*, where new logs created in that directory
get picked up.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message