apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Velineni Lakshmi Prasanna (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (APEXMALHAR-2447) No indication from AbstractFileInputOperator when directory is empty
Date Thu, 16 Mar 2017 16:46:41 GMT

     [ https://issues.apache.org/jira/browse/APEXMALHAR-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Velineni Lakshmi Prasanna updated APEXMALHAR-2447:
--------------------------------------------------
    Description: AbstractFileInputOperator scans a directory for files and outputs the file
contents. However, when the directory is empty nothing is sent. A downstream operator may
want some basic information that the input directory is scanned, so for example, it can create
an output folder. Add a notification to the operator when the directory is scanned for the
first time. An implementation, for example, can use this notification to send a control tuple
with the directory path notifying the downstream that the directory has been visited.  (was:
AbstractFileInputOperator scans a directory for files and outputs the file contents. However
when the directory is empty nothing is sent. A downstream operator may want some basic information
that the input directory is scanned, so for example, it can create an output folder. Add a
notification to the operator when the directory is scanned for the first time. An implementation,
for example, can use this notification to send a control tuple with the directory path notifying
the downstream that the directory has been visited.)

> No indication from AbstractFileInputOperator when directory is empty
> --------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2447
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2447
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Velineni Lakshmi Prasanna
>            Assignee: Velineni Lakshmi Prasanna
>            Priority: Minor
>
> AbstractFileInputOperator scans a directory for files and outputs the file contents.
However, when the directory is empty nothing is sent. A downstream operator may want some
basic information that the input directory is scanned, so for example, it can create an output
folder. Add a notification to the operator when the directory is scanned for the first time.
An implementation, for example, can use this notification to send a control tuple with the
directory path notifying the downstream that the directory has been visited.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message