Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 000E8200BF1 for ; Mon, 19 Dec 2016 14:03:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id F2B68160B18; Mon, 19 Dec 2016 13:03:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4A59A160B3B for ; Mon, 19 Dec 2016 14:03:00 +0100 (CET) Received: (qmail 78282 invoked by uid 500); 19 Dec 2016 13:02:59 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 77960 invoked by uid 99); 19 Dec 2016 13:02:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Dec 2016 13:02:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 26DE32C03E9 for ; Mon, 19 Dec 2016 13:02:59 +0000 (UTC) Date: Mon, 19 Dec 2016 13:02:59 +0000 (UTC) From: "Fabian Hueske (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-5342) Setting the parallelism automatically for operators base on cost model MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 19 Dec 2016 13:03:01 -0000 [ https://issues.apache.org/jira/browse/FLINK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761106#comment-15761106 ] Fabian Hueske commented on FLINK-5342: -------------------------------------- Yes, I think the {{TableConfig}} would be a good place to add such a parameter. However, this does not give very fine-grained control, because all joins or aggregations would be executed with the same parallelism. Chaining of map-based operator should not be a problem. Another interesting parameter could be the parallelism of the final result. > Setting the parallelism automatically for operators base on cost model > ---------------------------------------------------------------------- > > Key: FLINK-5342 > URL: https://issues.apache.org/jira/browse/FLINK-5342 > Project: Flink > Issue Type: Improvement > Components: Table API & SQL > Reporter: godfrey he > > On Flink table API, a query will be translated to operators without parallelism. And user do not know even do not care the target operators translated from query. So it's better to set the parallelism automatically for each operator base on cost model. -- This message was sent by Atlassian JIRA (v6.3.4#6332)