apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2447) No indication from AbstractFileInputOperator when directory is empty
Date Thu, 16 Mar 2017 16:41:43 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928391#comment-15928391

ASF GitHub Bot commented on APEXMALHAR-2447:

GitHub user prasannapramod opened a pull request:


    APEXMALHAR-2447 Notification from AbstractFileInputOperator when scanning directory

    APEXMALHAR-2447 Added notification in AbstractFileInputOperator, when scanning the directory
for the first time. Implementations can use this information in different ways such as notifying
downstream operators with a control tuple that a new directory has been scanned.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/prasannapramod/apex-malhar SPOI-9540

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #583


> No indication from AbstractFileInputOperator when directory is empty
> --------------------------------------------------------------------
>                 Key: APEXMALHAR-2447
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2447
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Velineni Lakshmi Prasanna
>            Assignee: Velineni Lakshmi Prasanna
>            Priority: Minor
> AbstractFileInputOperator scans a directory for files and outputs the file contents.
However when the directory is empty nothing is sent. A downstream operator may want some basic
information that the input directory is scanned, so for example, it can create an output folder.
Add a notification to the operator when the directory is scanned for the first time. An implementation,
for example, can use this notification to send a control tuple with the directory path notifying
the downstream that the directory has been visited.

This message was sent by Atlassian JIRA

View raw message