apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chandni Singh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (APEXMALHAR-1600) Investigate if we can seek efficiently to the correct location when we restart after failure for ftp and fs scan operators
Date Thu, 04 Aug 2016 03:38:20 GMT

     [ https://issues.apache.org/jira/browse/APEXMALHAR-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chandni Singh updated APEXMALHAR-1600:
--------------------------------------
    Assignee:     (was: Chandni Singh)

> Investigate if we can seek efficiently to the correct location when we restart after
failure for ftp and fs scan operators
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-1600
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-1600
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Pramod Immaneni
>
> Currently when the fs scan operator fails and restarts it seeks to the starting location
by asking for the previous entries and discarding them. Can this be done in a more efficient
manner in a case-by-case basis, for example a sub class of the operator can keep a count of
the file read offset after returning an entry and that can be used to seek directly to checkpointed
offset.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message