From user-return-30805-archive-asf-public=cust-asf.ponee.io@flink.apache.org Mon Nov 11 13:46:00 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 7872D180629 for ; Mon, 11 Nov 2019 14:46:00 +0100 (CET) Received: (qmail 52265 invoked by uid 500); 11 Nov 2019 13:45:58 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 52254 invoked by uid 99); 11 Nov 2019 13:45:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Nov 2019 13:45:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 76863C06CC for ; Mon, 11 Nov 2019 13:45:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id QshZOHxT43Ig for ; Mon, 11 Nov 2019 13:45:54 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::d33; helo=mail-io1-xd33.google.com; envelope-from=flink.devv@gmail.com; receiver= Received: from mail-io1-xd33.google.com (mail-io1-xd33.google.com [IPv6:2607:f8b0:4864:20::d33]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 352727DD69 for ; Mon, 11 Nov 2019 13:45:54 +0000 (UTC) Received: by mail-io1-xd33.google.com with SMTP id k1so14632806ioj.6 for ; Mon, 11 Nov 2019 05:45:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9AUIj232JJOhFHqlj9z49qXFJ7Wud/S4yDhazGK9V0k=; b=VSwCL9AIUBLDE1FfO3lq0/UXFrBTXtP+ha3BsJTxJM+0h8+ke+sfXR9nS7mQfrYkor X8tOeb8Lxwn4vE3GVA4GrUsm9bLlgHMjKQFT8szaZ19dZ5ELgClqDGVbTths3/YJxSjc QiCz2HG0VaJLlFII5UfK7yw+KjJdfWorX9k60lw2f8aL5NoMgnJ+320psFsx/5F6M6J5 QERvwI7lKHgF81apEtSMMIiIJDGPuq63NWPaICjQVjH/s7cIg9kSnJDdYvwZ8jWaK6o6 hRlDPFiSaG+GVJR3qYFx2bIJC9z9Gcw4QqI8fUl3BnmBs7WAqRsMOIwp3ImpRntxT78x sUkQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9AUIj232JJOhFHqlj9z49qXFJ7Wud/S4yDhazGK9V0k=; b=jhlsob+CRtKbOcrZjdA9jrWLDXdCcTG3TdKjaYHxIDqyWmEaMIKo5j8V8QHG/wpCPO 5qKFtguR7KP9KatCABk1bFKy/mRNsYDMKoJtTX6SW53MMb+Udt3ajWyh0RviholuvXqC zMv52GgXIFxiCHw/PB/qeOEpueuu3zm9IG0C/fD9kb+GgZOYfabbiAsLDJFiR/8Plwz9 y4NQx43XoTfCYYYo+9sTC/Bvuy3DUTcaD1gsBvl8cqMJOboomqzhaRHH6D93ns0sDu2A IdIM/EviHwo4moQPGn517U2F1QOs+QMVeRCG3TUvgrVJFPRoPVMGPVWgJzsIJ38aPBx0 MqjQ== X-Gm-Message-State: APjAAAWGzFgMZOI9KkfQrnrZncqfhRKkxUVc5ABotOYUPbDUW/QLM+/A vniMyCTfG41tdc70oAoP39enTza7fqhKuDAvPro= X-Google-Smtp-Source: APXvYqwahn02kU500ad8R1a7zIzdDzwO/WqxEjhBj0oWxnPHdD5UDxySURWwTW59gifQN6RlSoTRGj5Qjiq0sqRza9I= X-Received: by 2002:a6b:908a:: with SMTP id s132mr25170917iod.118.1573479952971; Mon, 11 Nov 2019 05:45:52 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: srikanth flink Date: Mon, 11 Nov 2019 19:15:42 +0530 Message-ID: Subject: Re: Job Distribution Strategy On Cluster. To: vino yang Cc: user Content-Type: multipart/alternative; boundary="000000000000a87ba7059712591e" --000000000000a87ba7059712591e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Vina, I've set parallelism as 6 while max parallelism is 128. Thanks Srikanth On Mon, Nov 11, 2019 at 3:18 PM vino yang wrote: > Hi srikanth, > > What's your job's parallelism? > > In some scenes, many operators are chained with each other. if it's > parallelism is 1, it would just use a single slot. > > Best, > Vino > > srikanth flink =E4=BA=8E2019=E5=B9=B411=E6=9C=886= =E6=97=A5=E5=91=A8=E4=B8=89 =E4=B8=8B=E5=8D=8810:03=E5=86=99=E9=81=93=EF=BC= =9A > >> Hi there, >> >> I'm running Flink with 3 node cluster. >> While running my jobs(both SQL client and jar submission), the jobs are >> being assigned to single machine instead of distribution among the clust= er. >> How could I achieve the job distribution to make use of the computation >> power? >> >> Thanks >> Srikanth >> > --000000000000a87ba7059712591e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Vina,

I've set para= llelism as 6 while max parallelism is 128.

Thanks<= /div>
Srikanth



On Mon, Nov 11, 2= 019 at 3:18 PM vino yang <yangh= ua1127@gmail.com> wrote:
Hi srikanth,

What's= your job's parallelism?

In some scenes, many = operators are chained with each other. if it's parallelism is 1, it wou= ld just use a single slot.

Best,
Vino

srikanth flink <flink.devv@gmail.com> =E4=BA=8E2019=E5=B9=B411=E6=9C=886=E6=97= =A5=E5=91=A8=E4=B8=89 =E4=B8=8B=E5=8D=8810:03=E5=86=99=E9=81=93=EF=BC=9A
<= div>Hi there,

I'm running Flink with 3 node cl= uster.
While running my jobs(both SQL client and jar submission),= the jobs are being assigned to single machine instead of distribution amon= g the cluster. How could I achieve the job distribution to make use of the = computation power?

Thanks
Srikanth
--000000000000a87ba7059712591e--