nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (NIFI-1170) TailFile "File to Tail" property should support Wildcards
Date Tue, 06 Sep 2016 06:22:21 GMT


ASF GitHub Bot commented on NIFI-1170:

Github user pvillard31 commented on the issue:
    FYI: this is not ready for review. After a talk with @trixpan, I'll put some additional
work into it. I'll let you know when I think this is ready to take into account the use case
described in the JIRA.

> TailFile "File to Tail" property should support Wildcards
> ---------------------------------------------------------
>                 Key: NIFI-1170
>                 URL:
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>    Affects Versions: 0.4.0
>            Reporter: Andre
> Because of challenges around log rotation of high volume syslog and app producers, it
is customary to logging platform developers to promote file variables based file names such
as DynaFiles (rsyslog), Macros(syslog-ng)as alternatives to getting SIGHUPs being sent to
the syslog daemon upon every file rotation.
> (To certain extent, used even NiFi's has similar patterns, like for example, when one
uses Expression Language to set PutHDFS destination file).
> The current TailFile strategy suggests rotation patterns like:
> {code}
> log_folder/app.log
> log_folder/app.log.1
> log_folder/app.log.2
> log_folder/app.log.3
> {code}
> It is possible to fool the system to accept wildcards by simply using a strategy like:
> {code}
> log_folder/test1
> log_folder/server1
> log_folder/server2
> log_folder/server3
> {code}
> And configure *Rolling Filename Pattern* to * but it feels like a hack, rather than catering
for an ever increasingly prevalent use case (DynaFile/macros/etc).
> It would be great if instead, TailFile had the ability to use wildcards on File to Tail

This message was sent by Atlassian JIRA

View raw message