apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bhupesh Chawda (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (APEXCORE-654) Recovery window is not updated when Delay Operator is used along with Partitioned Operators
Date Sun, 26 Mar 2017 05:37:41 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942151#comment-15942151
] 

Bhupesh Chawda edited comment on APEXCORE-654 at 3/26/17 5:37 AM:
------------------------------------------------------------------

The recovery window is not updated in cases like the example attached.
The issue seems to be that when delay is part of a checkpoint group, the unifiers are not
considered as part of the same group. This is because logical operator groups are used to
identify strongly connected components and unifiers are not part of the logical plan.


was (Author: bhupesh):
The recovery window is not updated in cases like the example attached.

> Recovery window is not updated when Delay Operator is used along with Partitioned Operators
> -------------------------------------------------------------------------------------------
>
>                 Key: APEXCORE-654
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-654
>             Project: Apache Apex Core
>          Issue Type: Bug
>    Affects Versions: 3.5.0
>         Environment: Hadoop 2.7.2
> Apache Apex 3.5.0
> Apache Apex Malhar 3.6.0
>            Reporter: Ambarish Pande
>            Assignee: Bhupesh Chawda
>              Labels: DelayOperator
>
> Checkpointing is not happening when DefaultDelayOperator is used in a DAG in which some
upstream operators are Partitioned.
> When used without partitioning, I can see the operators being check-pointed properly.
> Here is the link of the App source code and also the built apa file.
> https://github.com/ambarishpande/delay-operator-test



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message