chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Commented: (CHUKWA-185) ability to tail a whole directory
Date Mon, 15 Jun 2009 18:02:07 GMT


Ari Rabkin commented on CHUKWA-185:

I had figured we'd solve the expiration problem in FTA, rather than here.  We already have
CHUKWA-204 open for this. However, my patch does need to do something with time windows to
make sure it doesn't restart the adaptors after they stop themselves.  I'll fix that in the
next version.

I'm happy to revisit the TerminatorThread mechanism, but again, that's an FTA problem, and
there's no need to solve that problem and this one at the same time.

As to duplicate data.  Once DirTailer starts a FileTailer, that FileTailer gets checkpointed
in the usual way. And exactly one tailer can get started for each file.  This patch shouldn't
create any duplicate-data issues we didn't already have.

> ability to tail a whole directory
> ---------------------------------
>                 Key: CHUKWA-185
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.1.2, 0.2.0
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>             Fix For: 0.3.0
>         Attachments: CHUKWA-185.patch
> Right now, FileTailingAdaptors watch particular files.   It'd be great to be able to
watch a whole path: to say something like /var/logs/*, where new logs created in that directory
get picked up.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message