Return-Path: X-Original-To: apmail-apex-dev-archive@minotaur.apache.org Delivered-To: apmail-apex-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 91E531943B for ; Sun, 24 Apr 2016 05:49:17 +0000 (UTC) Received: (qmail 906 invoked by uid 500); 24 Apr 2016 05:49:17 -0000 Delivered-To: apmail-apex-dev-archive@apex.apache.org Received: (qmail 828 invoked by uid 500); 24 Apr 2016 05:49:17 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 817 invoked by uid 99); 24 Apr 2016 05:49:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 24 Apr 2016 05:49:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 774E11A10F3 for ; Sun, 24 Apr 2016 05:49:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.221 X-Spam-Level: X-Spam-Status: No, score=-3.221 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id EMIl-UKs0okD for ; Sun, 24 Apr 2016 05:49:14 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id D15585F484 for ; Sun, 24 Apr 2016 05:49:13 +0000 (UTC) Received: (qmail 792 invoked by uid 99); 24 Apr 2016 05:49:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 24 Apr 2016 05:49:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id EA0A52C0451 for ; Sun, 24 Apr 2016 05:49:12 +0000 (UTC) Date: Sun, 24 Apr 2016 05:49:12 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: dev@apex.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (APEXCORE-439) After dynamic repartition application appears blocked MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/APEXCORE-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255502#comment-15255502 ] ASF GitHub Bot commented on APEXCORE-439: ----------------------------------------- Github user tweise commented on a diff in the pull request: https://github.com/apache/incubator-apex-core/pull/314#discussion_r60839381 --- Diff: engine/src/main/java/com/datatorrent/stram/plan/physical/PhysicalPlan.java --- @@ -979,6 +998,14 @@ public void deployChanges() { this.undeployOpers.removeAll(newOpers.keySet()); //make sure all the new operators are included in deploy operator list this.deployOpers.addAll(this.newOpers.keySet()); + // redeploy dependencies of the new operators excluding the new operators themselves + Set ndeps = getDependents(newOpers.keySet()); + ndeps.removeAll(newOpers.keySet()); + // don't redeploy operators already going to be undeployed + ndeps.removeAll(this.undeployOpers); + // redeploy remaining dependencies + this.undeployOpers.addAll(ndeps); + this.deployOpers.addAll(ndeps); --- End diff -- This shouldn't be required. Next line already includes dependencies. > After dynamic repartition application appears blocked > ----------------------------------------------------- > > Key: APEXCORE-439 > URL: https://issues.apache.org/jira/browse/APEXCORE-439 > Project: Apache Apex Core > Issue Type: Bug > Affects Versions: 3.3.0 > Reporter: Munagala V. Ramanath > Assignee: Munagala V. Ramanath > > When a file input operator (subclass of AbstractFileInputOperator) is dynamically repartitioned, some downstream unifiers are not identified as needing to be redeployed causing the window id to not advance and all downstream operators to be killed and restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)