flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLUME-2911) Add includePattern option in SpoolDirectorySource configuration
Date Mon, 10 Oct 2016 17:05:20 GMT

    [ https://issues.apache.org/jira/browse/FLUME-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15562829#comment-15562829

Hudson commented on FLUME-2911:

FAILURE: Integrated in Jenkins build Flume-trunk-hbase-1 #208 (See [https://builds.apache.org/job/Flume-trunk-hbase-1/208/])
FLUME-2911. Add include pattern option in SpoolDir source (mpercy: [http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=7d5ceacac49f5d15bf8f75e0209592c5524a3dda])
* (edit) flume-ng-doc/sphinx/FlumeUserGuide.rst
* (edit) flume-ng-core/src/main/java/org/apache/flume/client/avro/ReliableSpoolingFileEventReader.java
* (edit) flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java
* (edit) flume-ng-core/src/test/java/org/apache/flume/client/avro/TestReliableSpoolingFileEventReader.java
* (edit) flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySourceConfigurationConstants.java

> Add includePattern option in SpoolDirectorySource configuration
> ---------------------------------------------------------------
>                 Key: FLUME-2911
>                 URL: https://issues.apache.org/jira/browse/FLUME-2911
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>    Affects Versions: v1.6.0, v1.7.0
>            Reporter: Andrea Rota
>            Assignee: Andrea Rota
>              Labels: features
>             Fix For: v1.7.0
>         Attachments: FLUME-2911.patch
> Current implementation of SpoolDirectorySource does not allow users to specify a regex
pattern to select which files should be monitored. Instead, the current implementation allows
users to specify which should *not* monitored, via the ignorePattern parameter.
> I implemented the feature, allowing users to specify the include pattern as {{a1.sources.src-1.includePattern=^foo.*$}}
(includes all the files that starts in "foo").
> By default, the includePattern regex is set to {{^.*$}} (all files). Include and exclude
patterns can be used at same time and the results are combined.

This message was sent by Atlassian JIRA

View raw message