Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 62BAB18697 for ; Thu, 19 Nov 2015 11:06:30 +0000 (UTC) Received: (qmail 93186 invoked by uid 500); 19 Nov 2015 11:06:28 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 93086 invoked by uid 500); 19 Nov 2015 11:06:28 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 93001 invoked by uid 99); 19 Nov 2015 11:06:28 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Nov 2015 11:06:28 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 3AC39180A2A for ; Thu, 19 Nov 2015 11:06:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.971 X-Spam-Level: X-Spam-Status: No, score=0.971 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 0y6Y7FjQhM3s for ; Thu, 19 Nov 2015 11:06:19 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with SMTP id DAE0143DC8 for ; Thu, 19 Nov 2015 11:06:18 +0000 (UTC) Received: (qmail 90537 invoked by uid 99); 19 Nov 2015 11:06:18 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Nov 2015 11:06:18 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 5C42FE0A83; Thu, 19 Nov 2015 11:06:18 +0000 (UTC) From: tillrohrmann To: issues@flink.incubator.apache.org Reply-To: issues@flink.incubator.apache.org References: In-Reply-To: Subject: [GitHub] flink pull request: [FLINK-3020][streaming] set number of task slo... Content-Type: text/plain Message-Id: <20151119110618.5C42FE0A83@git1-us-west.apache.org> Date: Thu, 19 Nov 2015 11:06:18 +0000 (UTC) Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1360#discussion_r45327211 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/LocalStreamEnvironment.java --- @@ -91,7 +91,11 @@ public JobExecutionResult execute(String jobName) throws Exception { configuration.addAll(jobGraph.getJobConfiguration()); configuration.setLong(ConfigConstants.TASK_MANAGER_MEMORY_SIZE_KEY, -1L); - configuration.setInteger(ConfigConstants.TASK_MANAGER_NUM_TASK_SLOTS, getParallelism()); + + int parallelism = getParallelism() == defaultLocalParallelism ? + defaultLocalParallelism : jobGraph.getMaximumParallelism(); --- End diff -- `defaultLocalParallelism` seems to be the number of available processors. I think this is very unintuitive that the default parallelism is only taken if it equals the number of processors. This means in case of an operator with a higher dop than the #cores, the program will only fail if the user sets the default parallelism to #cores. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---