From user-return-23882-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Oct 24 11:35:32 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 536AB180638 for ; Wed, 24 Oct 2018 11:35:32 +0200 (CEST) Received: (qmail 96070 invoked by uid 500); 24 Oct 2018 09:35:31 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 96060 invoked by uid 99); 24 Oct 2018 09:35:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Oct 2018 09:35:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 9029A180D74 for ; Wed, 24 Oct 2018 09:35:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.888 X-Spam-Level: * X-Spam-Status: No, score=1.888 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id UfYjg_BPzgoT for ; Wed, 24 Oct 2018 09:35:29 +0000 (UTC) Received: from mail-lj1-f174.google.com (mail-lj1-f174.google.com [209.85.208.174]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 150A45F331 for ; Wed, 24 Oct 2018 09:35:29 +0000 (UTC) Received: by mail-lj1-f174.google.com with SMTP id x3-v6so4087858lji.13 for ; Wed, 24 Oct 2018 02:35:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=enKDV0pXYCAtzW+0kLl73DBBIdN4Lu5Upw9lQj5iNp0=; b=SBuB8k2Sod/OdjhRyQdS6ABQAv34e234E2tSV8XjtjBctqFFO6orCPfOGMDcHVbpdz QnXa58yb1fCCdTIHjZUETilkjplIKGOPJYO9U7qqXGw4fDiGzdFA61UlrEKPfvz+T6hO FHqIbekzd4LK54MpPmmtxTUk27ewRJdxYZrnyu9RA8ZZVHWW4bym4gUMpEyQisSoNnI4 sOjwQJbPoWUj2tTD3fXhByQ/sfUY3TdD7rEmbZ4gVCNOpRMn4zVB9ut1qC+YR3LiN7Ik DkK46TWzwMMjTzNyNzixT8J/5MqjmpAqEN4Eo8/COO5h1PnCPLT8kh1oqdKIcXjbkmeP Wszg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=enKDV0pXYCAtzW+0kLl73DBBIdN4Lu5Upw9lQj5iNp0=; b=GlDpW4OpOie2FPn+2ydMPMlwaFwaPHB0QhjxjtctmUAlNsAk1Jf/q2ZFNPEon7XHGd W9KJS/feQv/nuGoTZ0EnHHq4neufWUvQCX+0Z5lZh4TvFPO50Antw0UiaAGgEHpT35XI jkA5MfLqqdJYWm+oEYA4oqMvbMabFwwotyOW1v5K5uikIibZ/Yle82wdJotbXKVfwF3x mtMG8ZIdY4INIxpns7CVmtEpdbWFZgbJUlZsT6PgUaY8JqHbYMfHtSTfZNQHsfIzv35f ZoDFJnndUPN6izCR5RT+E5gtTX5VfX3Lv4vV7/dg+1O2eH82sbIqJopw6HbEKHRZgR4y LX/w== X-Gm-Message-State: AGRZ1gL/GFgEGaFJr586zYXNd9HQM5zIE0ieiE7dOv4THJwFMS8LAOGV kj2l/qYqN8xeffl1cvcTb7tPufY0ISt0c8x+pfwKFg== X-Google-Smtp-Source: AJdET5cHfcez6ujcKQWNrvCQ/SOwqumXQZS5J3XlgxavZQcuIauLI+WXKji2KSZTKBocSkmA67zYrafqVEBonmgICGI= X-Received: by 2002:a2e:5317:: with SMTP id h23-v6mr1193041ljb.26.1540373728146; Wed, 24 Oct 2018 02:35:28 -0700 (PDT) MIME-Version: 1.0 From: Sayat Satybaldiyev Date: Wed, 24 Oct 2018 11:35:16 +0200 Message-ID: Subject: Flink Task Allocation on Nodes To: user@flink.apache.org Content-Type: multipart/alternative; boundary="000000000000e33a6c0578f634e4" --000000000000e33a6c0578f634e4 Content-Type: text/plain; charset="UTF-8" Is there any way to indicate flink not to allocate all parallel tasks on one node? We have a stateless flink job that reading from 10 partition topic and have a parallelism of 6. Flink job manager allocates all 6 parallel operators to one machine, causing all traffic from Kafka allocated to only one machine. We have a cluster of 6 nodes and ideal to spread one parallel operator to one machine. Is there a way to do than in Flink? --000000000000e33a6c0578f634e4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Is there any way to indicate flink not to allocate all par= allel=C2=A0tasks on one node?=C2=A0 We have a stateless flink job that read= ing from 10 partition topic and have a parallelism of 6. Flink job manager = allocates all 6 parallel operators to one machine, causing all traffic from= Kafka=C2=A0allocated to only one machine. We have a cluster of 6 nodes and= ideal to spread one parallel=C2=A0operator to one machine. Is there a way = to do than in Flink?
--000000000000e33a6c0578f634e4--