apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Kottapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2250) AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.
Date Tue, 11 Apr 2017 22:27:42 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965048#comment-15965048
] 

Venkatesh Kottapalli commented on APEXMALHAR-2250:
--------------------------------------------------

[~tushargosavi] Can I pick this up or did you start on this?

> AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.
> ---------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2250
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2250
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Tushar Gosavi
>
> The default DirectoryScanner defined in AbstractFileInputOperator does not handle directories
correctly. If there is a directory in the configured path, it gets added as a file in pendingFile
list and when operator tries to open it for reading
> it fails, the operator keeps retrying for configured number of time and then ignore this
file.
> The fix would be to not return directory name in scanned file names in the first place.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message