From user-return-19305-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Apr 11 23:16:55 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 1B92C18064A for ; Wed, 11 Apr 2018 23:16:54 +0200 (CEST) Received: (qmail 3157 invoked by uid 500); 11 Apr 2018 21:16:53 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 3147 invoked by uid 99); 11 Apr 2018 21:16:53 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Apr 2018 21:16:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 304EBC0157 for ; Wed, 11 Apr 2018 21:16:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Tuh1HajFtlg9 for ; Wed, 11 Apr 2018 21:16:52 +0000 (UTC) Received: from mail-it0-f53.google.com (mail-it0-f53.google.com [209.85.214.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id B22505F485 for ; Wed, 11 Apr 2018 21:16:51 +0000 (UTC) Received: by mail-it0-f53.google.com with SMTP id t192-v6so550251itc.1 for ; Wed, 11 Apr 2018 14:16:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=E2ldjf8spODoa/BlEJ+qjyW4TsjFRrFSMpiQy5KE6qA=; b=VoVtbXwTuRQY6/T2NcHw9GXNSFFWKrWgxnMu0v8l+od3/zr5P9dI4kqlLQ+4xyTrI8 ne1BR531b2qbXbvZJUxCcwaxpQeRr7e4hzPyUChucGDy9dtB3wAhxhMF6GZQiVKZU3xU tTQlLeMAeG3cjTZV1mjhVIRx11OZPVobwiHmHMT7oTnSG0XPGCSCbI25O4sVPS10zkqT 2zD+NVqHlJH6iv0DBWGOPJtxMiLizx60uF3vdEE9sur7R4zhkI9JLKiXKjgHXZSM8Bdn dT3ns9qiGg0n7VgY7/yp6VYESSf5Ll7brTNk2VkKvNW7NmA5Wf8fHlos4Ileu615aC6o kziQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=E2ldjf8spODoa/BlEJ+qjyW4TsjFRrFSMpiQy5KE6qA=; b=KEbeQHIJw8PqMDnpaGBmi2x3U1nApzPout43FcC3HGCYD08lH54p6fmzmSq8U2OGgM nWHbEFAGKb1026f4eLpmM1HPc37oX7W1S/gx6j0E3EY0R90u5U7fk/uqaeyBcb+YeaRK /wRekzE/oGTaWN9an8AVhSV71q4snXKieczRRQ2XTh1M8qS2u/5BiQj0yhKjgLw+6SRh mJXpUnXdzg2Y4iIVd6SXRpr+gPCuZXI3ZJFzadMJqp5NM8OUYsTLQBGk9qSXLMPB0DH1 F/c0JalaWetU3hpMwfoSzkJQMNGJ9UzQNtMDeiO1W95v48o+uarTPyqAfHXXHQvjhp/a 1Mng== X-Gm-Message-State: ALQs6tCN3IDwNSt4MQ5wEbM6J4/y1hJ1W/mGkNGQK7AlVLiiDtfAjhXg krG6hqGVegwMJKl2h3QQqEx6c1Wrv2McdwZWYms= X-Google-Smtp-Source: AIpwx4+ZhH92jZtv4eB3bL4OTEqYhrP6VSGNpo7vGIN3jrFFGk/GCRh2i20diBUDiRIjhbkYizTcMa7k9ZwbH3bSjT0= X-Received: by 2002:a24:30c:: with SMTP id e12-v6mr5743003ite.50.1523481410228; Wed, 11 Apr 2018 14:16:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.147.92 with HTTP; Wed, 11 Apr 2018 14:16:49 -0700 (PDT) From: Christophe Jolif Date: Wed, 11 Apr 2018 23:16:49 +0200 Message-ID: Subject: keyBy and parallelism To: user Content-Type: multipart/alternative; boundary="00000000000047578105699928e2" --00000000000047578105699928e2 Content-Type: text/plain; charset="UTF-8" Hi all, Imagine I have a default parallelism of 16 and I do something like stream.keyBy("something").flatMap() Now let's imagine I have less than 16 keys, maybe 8. How many parallel executions of the flatMap function will I get? 8 because I have 8 keys, or 16 because I have default parallelism at 16? (and I will have follow up questions depending on the answer I suspect ;)) Thanks, -- Christophe --00000000000047578105699928e2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi all,

Imagine I have a default parall= elism of 16 and I do something like

stream.keyBy(&= quot;something").flatMap()

Now let's imag= ine I have less than 16 keys, maybe 8.

How many pa= rallel executions of the flatMap function will I get? 8 because I have 8 ke= ys, or 16 because I have default parallelism at 16?

(and I will have follow up questions depending on the answer I suspect ;)= )

Thanks,
--
Christophe
--00000000000047578105699928e2--