Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2EC94200BCC for ; Tue, 29 Nov 2016 20:56:26 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2DD97160B15; Tue, 29 Nov 2016 19:56:26 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7836C160AFC for ; Tue, 29 Nov 2016 20:56:25 +0100 (CET) Received: (qmail 928 invoked by uid 500); 29 Nov 2016 19:56:24 -0000 Mailing-List: contact dev-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.apache.org Delivered-To: mailing list dev@apex.apache.org Received: (qmail 905 invoked by uid 99); 29 Nov 2016 19:56:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2016 19:56:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 3A4301A7B87 for ; Tue, 29 Nov 2016 19:56:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.019 X-Spam-Level: X-Spam-Status: No, score=-7.019 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id dt6X-FyOXkaf for ; Tue, 29 Nov 2016 19:56:22 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 045475F5FC for ; Tue, 29 Nov 2016 19:56:21 +0000 (UTC) Received: (qmail 84404 invoked by uid 99); 29 Nov 2016 19:54:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2016 19:54:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 1D5132C0079 for ; Tue, 29 Nov 2016 19:54:59 +0000 (UTC) Date: Tue, 29 Nov 2016 19:54:59 +0000 (UTC) From: "bright chen (JIRA)" To: dev@apex.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (APEXMALHAR-2359) Optimise fire trigger to avoid go through all data MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 29 Nov 2016 19:56:26 -0000 bright chen created APEXMALHAR-2359: --------------------------------------- Summary: Optimise fire trigger to avoid go through all data Key: APEXMALHAR-2359 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2359 Project: Apache Apex Malhar Issue Type: Improvement Reporter: bright chen Assignee: bright chen KeyedWindowedOperatorImpl.fireNormalTrigger(Window, boolean) currently go through each window and key to check value. The data collection could be very huge as the discard period could be relative long time. If fireOnlyUpdatedPanes is false probably there don't have much space to improve. But if fireOnlyUpdatedPanes is true, we don't have to go through the whole data collection. We only need to go through the window and key which handle after last trigger. -- This message was sent by Atlassian JIRA (v6.3.4#6332)