apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandesh (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (APEXMALHAR-2419) KafkaSinglePortExactlyOnceOutputOperator fails on recovery
Date Wed, 22 Feb 2017 18:46:44 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878951#comment-15878951
] 

Sandesh edited comment on APEXMALHAR-2419 at 2/22/17 6:46 PM:
--------------------------------------------------------------

Largest completed window is moving only after a committed call on WindowDataManager but the
expected behavior is, Largest completed Window is the last saved Window ID. Current behaviour
breaks not only this operator but also all the operators that use WindowData Manager for recovery.


was (Author: sandesh):
Largest completed window is moving only after a committed call on WindowDataManager but the
expected behavior is, Largest completed Window is the last saved Window ID. Current behaviour
breaks not only this operator but also all the operators that use this operator.

> KafkaSinglePortExactlyOnceOutputOperator fails on recovery
> ----------------------------------------------------------
>
>                 Key: APEXMALHAR-2419
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2419
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Munagala V. Ramanath
>            Assignee: Sandesh
>
> The KafkaSinglePortExactlyOnceOutputOperator fails on recovery with the message: "Violates
Exactly once. Not all the tuples received after operator reset."
> This is because of this check in endWindow():
> {code}
>    if (!partialWindowTuples.isEmpty() && windowId > windowDataManager.getLargestCompletedWindow())
{
>       throw new RuntimeException("Violates Exactly once. Not all the tuples received
after operator reset.");
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message