apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2129) ManagedState: Add a disable purging option
Date Fri, 12 Aug 2016 05:08:22 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418378#comment-15418378

ASF GitHub Bot commented on APEXMALHAR-2129:

Github user asfgit closed the pull request at:


> ManagedState: Add a disable purging option
> ------------------------------------------
>                 Key: APEXMALHAR-2129
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2129
>             Project: Apache Apex Malhar
>          Issue Type: Task
>            Reporter: Bhupesh Chawda
>            Assignee: Chandni Singh
> Have an option that can disable purging of data.
> Currently the TimeBucketAssigner moves time boundary periodically based on system time
as well as based on event time. This is error prone and moving time boundary periodically
implies that data will always be purged. 
> The change that needs to be made to TimeBucketAssigner is to just move time boundary
when there are future events that don't fall in that boundary. This will imply that if there
are no events outside the current boundary then data will not be purged.
> ManagedStateImpl uses processing time for an event, so moving boundaries based on system
time is going to happen there nevertheless.

This message was sent by Atlassian JIRA

View raw message