Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 785922009C6 for ; Tue, 17 May 2016 06:48:01 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 77006160A19; Tue, 17 May 2016 04:48:01 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C2DC9160A16 for ; Tue, 17 May 2016 06:48:00 +0200 (CEST) Received: (qmail 28680 invoked by uid 500); 17 May 2016 04:48:00 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 28667 invoked by uid 99); 17 May 2016 04:47:59 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 May 2016 04:47:59 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 5BAE1C0DD8 for ; Tue, 17 May 2016 04:47:59 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.021 X-Spam-Level: X-Spam-Status: No, score=-4.021 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 1qG2Mjec7itE for ; Tue, 17 May 2016 04:47:58 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 5C6A75F29C for ; Tue, 17 May 2016 04:47:58 +0000 (UTC) Received: (qmail 28639 invoked by uid 99); 17 May 2016 04:47:57 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 May 2016 04:47:57 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 616AFDFC92; Tue, 17 May 2016 04:47:57 +0000 (UTC) From: ilooner To: dev@apex.incubator.apache.org Reply-To: dev@apex.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-apex-malhar pull request: APEXMALHAR-2073 fixed the race... Content-Type: text/plain Message-Id: <20160517044757.616AFDFC92@git1-us-west.apache.org> Date: Tue, 17 May 2016 04:47:57 +0000 (UTC) archived-at: Tue, 17 May 2016 04:48:01 -0000 Github user ilooner commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/276#discussion_r63463982 --- Diff: library/src/main/java/org/apache/apex/malhar/lib/state/managed/IncrementalCheckpointManager.java --- @@ -188,8 +190,12 @@ protected void committed(int operatorId, long windowId) throws IOException, Inte { LOG.debug("data manager committed {}", windowId); for (Long currentWindow : savedWindows.keySet()) { + if (currentWindow <= smallestPendingWindow) { + continue; + } if (currentWindow <= windowId) { - LOG.debug("to transfer {}", windowId); + LOG.debug("to transfer {}", currentWindow); + smallestPendingWindow = currentWindow; --- End diff -- can the name be changed of smallestPendingWindow. It can be slightly misleading. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---