apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chandni Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2004) TimeBasedDirectoryScanner keep reading same file
Date Sat, 27 Feb 2016 17:50:18 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170668#comment-15170668

Chandni Singh commented on APEXMALHAR-2004:

This was done so that the state in memory doesn't become too big. The assumption was that
if file is changed the timestamp of the parent directory will change as well.

Are you seeing that times of the file is more recent than the parent?

Storing every file reference in memory may be problematic.

> TimeBasedDirectoryScanner keep reading same file
> ------------------------------------------------
>                 Key: APEXMALHAR-2004
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2004
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>    Affects Versions: 3.3.0
>            Reporter: Tushar Gosavi
>            Assignee: Tushar Gosavi
> The recorded last modification time is of the parent directory, If modification time
> last recorded modification time then we will read the file again.
> In case where directory modification time < file modification time, we will keep on
reading the file again and again.
> Fix is to record file modification time instead of parent modification time.

This message was sent by Atlassian JIRA

View raw message