apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2250) AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.
Date Mon, 02 Oct 2017 16:09:00 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16188362#comment-16188362

ASF GitHub Bot commented on APEXMALHAR-2250:

vrozov closed pull request #419: APEXMALHAR-2250: Ignore directories while scanning.
URL: https://github.com/apache/apex-malhar/pull/419
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.
> ---------------------------------------------------------------------------------
>                 Key: APEXMALHAR-2250
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2250
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Tushar Gosavi
> The default DirectoryScanner defined in AbstractFileInputOperator does not handle directories
correctly. If there is a directory in the configured path, it gets added as a file in pendingFile
list and when operator tries to open it for reading
> it fails, the operator keeps retrying for configured number of time and then ignore this
> The fix would be to not return directory name in scanned file names in the first place.

This message was sent by Atlassian JIRA

View raw message