Return-Path: 
 <dev-return-9506-apmail-flink-dev-archive=flink.apache.org@flink.apache.org>
X-Original-To: apmail-flink-dev-archive@www.apache.org
Delivered-To: apmail-flink-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 8464B18743
	for <apmail-flink-dev-archive@www.apache.org>;
 Thu, 19 Nov 2015 11:18:11 +0000 (UTC)
Received: (qmail 24387 invoked by uid 500); 19 Nov 2015 11:18:11 -0000
Delivered-To: apmail-flink-dev-archive@flink.apache.org
Received: (qmail 24281 invoked by uid 500); 19 Nov 2015 11:18:11 -0000
Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@flink.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@flink.apache.org>
List-Post: <mailto:dev@flink.apache.org>
List-Id: <dev.flink.apache.org>
Reply-To: dev@flink.apache.org
Delivered-To: mailing list dev@flink.apache.org
Received: (qmail 24189 invoked by uid 99); 19 Nov 2015 11:18:11 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Nov 2015 11:18:11 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 0F9C62C1F6E
	for <dev@flink.apache.org>; Thu, 19 Nov 2015 11:18:11 +0000 (UTC)
Date: Thu, 19 Nov 2015 11:18:11 +0000 (UTC)
From: "Maximilian Michels (JIRA)" <jira@apache.org>
To: dev@flink.apache.org
Message-ID: <JIRA.12914433.1447931860000.121600.1447931891061@Atlassian.JIRA>
In-Reply-To: <JIRA.12914433.1447931860000@Atlassian.JIRA>
References: <JIRA.12914433.1447931860000@Atlassian.JIRA>
 <JIRA.12914433.1447931860417@arcas>
Subject: [jira] [Created] (FLINK-3047) Local batch execution: set number of
 task manager slots to the maximum parallelism
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394

Maximilian Michels created FLINK-3047:
-----------------------------------------

             Summary: Local batch execution: set number of task manager slots to the maximum parallelism
                 Key: FLINK-3047
                 URL: https://issues.apache.org/jira/browse/FLINK-3047
             Project: Flink
          Issue Type: Bug
          Components: Batch, Local Runtime
    Affects Versions: 0.10.0
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
            Priority: Minor
             Fix For: 1.0.0, 0.10.1


The number of task slots for local execution are determined by the maximum parallelism found. However, if a default parallelism has been set, this parallelism is used as the upper bound for the number of task slots.

We should change this to always use the maximum parallelism as the number of task slots. Otherwise jobs which include operators with a parallelism higher than the default parallelism fail to execute locally.

For example, this fails

{noformat}
ExecutionEnvironment env = ..

env.setParallelism(2);

DataSet<Integer> set = env.fromElements(1,2,3,4)
    .map(el -> el+1)
    .setParallelism(4);

set.print();
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)