apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2269) AbstractFileInputOperator: During replay, IO errors not handled
Date Mon, 24 Oct 2016 02:17:58 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15600713#comment-15600713
] 

Matt Zhang commented on APEXMALHAR-2269:
----------------------------------------

The function failureHandling() will add the failed file to the failedFiles. So if we hit this
during replay() it will break idempotency as the failedFiles will be different than the original
run. It's better just throw RuntimeException() and restart the replay() from beginning. Revert
to original code. 

> AbstractFileInputOperator: During replay, IO errors not handled
> ---------------------------------------------------------------
>
>                 Key: APEXMALHAR-2269
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2269
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Munagala V. Ramanath
>            Assignee: Matt Zhang
>
> In AbstractFileInputOperator, during replay(), if any IOExceptions occur, they
> are not handled gracefully -- the code simply throws a RuntimeException.
> Code similar to the behavior of emitTuples() needs to be added where
> the falureHandling() method is called.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message