Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 283C5200B51 for ; Mon, 1 Aug 2016 13:30:25 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0F93C160A65; Mon, 1 Aug 2016 11:30:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 598A0160A5D for ; Mon, 1 Aug 2016 13:30:24 +0200 (CEST) Received: (qmail 91267 invoked by uid 500); 1 Aug 2016 11:30:23 -0000 Mailing-List: contact dev-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.apache.org Delivered-To: mailing list dev@apex.apache.org Received: (qmail 91255 invoked by uid 99); 1 Aug 2016 11:30:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Aug 2016 11:30:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2A71D180651 for ; Mon, 1 Aug 2016 11:30:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.646 X-Spam-Level: X-Spam-Status: No, score=-4.646 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.426] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id PTHDaOcyuohj for ; Mon, 1 Aug 2016 11:30:22 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id 98A885FBCA for ; Mon, 1 Aug 2016 11:30:21 +0000 (UTC) Received: (qmail 91101 invoked by uid 99); 1 Aug 2016 11:30:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Aug 2016 11:30:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A9D2D2C0D5D for ; Mon, 1 Aug 2016 11:30:20 +0000 (UTC) Date: Mon, 1 Aug 2016 11:30:20 +0000 (UTC) From: "Bhupesh Chawda (JIRA)" To: dev@apex.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (APEXMALHAR-2129) ManagedState: Add a disable purging option MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 01 Aug 2016 11:30:25 -0000 [ https://issues.apache.org/jira/browse/APEXMALHAR-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401886#comment-15401886 ] Bhupesh Chawda commented on APEXMALHAR-2129: -------------------------------------------- As discussed on dev@apex, we are proceeding with implementing deduper with managed state. In order to handle case of bounded data without any time field, we will need to have the following functionality in the TimeBucketAssigner: 1. Disable purging 2. Disable expiry of tuples - We will need to store and dedup across the entire data set. > ManagedState: Add a disable purging option > ------------------------------------------ > > Key: APEXMALHAR-2129 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2129 > Project: Apache Apex Malhar > Issue Type: Task > Reporter: Bhupesh Chawda > Assignee: Chandni Singh > > Have an option that can disable purging of data. -- This message was sent by Atlassian JIRA (v6.3.4#6332)