Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CC830200C3A for ; Fri, 31 Mar 2017 12:23:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CAF2A160B8C; Fri, 31 Mar 2017 10:23:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 18DE3160B80 for ; Fri, 31 Mar 2017 12:23:09 +0200 (CEST) Received: (qmail 59653 invoked by uid 500); 31 Mar 2017 10:23:09 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 59643 invoked by uid 99); 31 Mar 2017 10:23:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Mar 2017 10:23:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 9AB901A02BB for ; Fri, 31 Mar 2017 10:23:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.48 X-Spam-Level: ** X-Spam-Status: No, score=2.48 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=data-artisans-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id b4weATspWgkN for ; Fri, 31 Mar 2017 10:23:06 +0000 (UTC) Received: from mail-lf0-f43.google.com (mail-lf0-f43.google.com [209.85.215.43]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id E4EC75FC3D for ; Fri, 31 Mar 2017 10:23:05 +0000 (UTC) Received: by mail-lf0-f43.google.com with SMTP id h125so41311482lfe.0 for ; Fri, 31 Mar 2017 03:23:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=data-artisans-com.20150623.gappssmtp.com; s=20150623; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=CAsKAP7UQLGp7l+tVGpMSOLK5YpsxYpbQk4ymJpSbPM=; b=WLufikl6NF1WvXrXBkFB60+Vm/G3Hh+0LkzYpCOcv0q+uRpNYsTRs+ZKN/qF3FCcDt 4R88IEAZ/EjoKdewRfD+3AU0CZEYfE+qTYRt4P2UIubnCxj4cbC7F5+7kX3XK7gFngtb VQFKRRRjIYBXvWINkEhgvY2MIVpaMnGKk5+geXS/tH7LDVeO6/xnvBAsOM+JhlrgTlkJ J7ESBmuaTWXEp+ZSDWKBlomwd3sy2fevZuY33+XUIEmog4UB+8nt+T0oDMMjsD3KOiXP cNG4yVBYl/gvziW8XTj8p2MfsyqXthx3ABWstbcoCdTltSR6V0O73UDRN51yxXkyzrN4 56dw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=CAsKAP7UQLGp7l+tVGpMSOLK5YpsxYpbQk4ymJpSbPM=; b=JwN+W0xmJ9AgzLVOQ/WOTQSeMWtzZe7yNm91CY2ULj9o8kXbDKQ3bPodHGxFUJMAKz 5z/4el0C6XC6QFYAQA5Ym39G1w5b5Yx+s2pTZu46EOXWQNLu5bhu9/p4Q2bOvk40JG9P /PDdfY5/PqyR1hJROocAn92Vva5IDgC/1hxLtDAh27lJg/eAvY9sxxLwIAiQFMHiXRjR D3OrBWfbJvEtnqaP6AkkMsPSKQAJ955uWhhnbRiqfRcoy2FgOXQgcWHmCZlFjMDGkRd4 Bpng0niENH9G0HvakA0lLvoVvo/3YG4JA2WNCmoPZvF+sPVf47mzmYAHBGskjwLx27Dx si/w== X-Gm-Message-State: AFeK/H0PJrViC7geJjPoLkU9vvVzfXId23cC7yredmRHKH2TTpQBZsLEqdOVyM4J4Pf+vKZk X-Received: by 10.28.184.87 with SMTP id i84mr2088759wmf.129.1490955785373; Fri, 31 Mar 2017 03:23:05 -0700 (PDT) Received: from [192.168.178.65] (ipservice-092-219-046-010.092.219.pools.vodafone-ip.de. [92.219.46.10]) by smtp.gmail.com with ESMTPSA id y22sm6158722wry.51.2017.03.31.03.23.04 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 31 Mar 2017 03:23:04 -0700 (PDT) From: Kostas Kloudas Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_B674C2B6-D5A9-4C9A-B0D4-2CBEFE8F8CC1" Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\)) Subject: Re: AsyncFunction and Parallelism Date: Fri, 31 Mar 2017 12:23:03 +0200 In-Reply-To: Cc: user@flink.apache.org To: Nico References: X-Mailer: Apple Mail (2.3259) archived-at: Fri, 31 Mar 2017 10:23:11 -0000 --Apple-Mail=_B674C2B6-D5A9-4C9A-B0D4-2CBEFE8F8CC1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Nico, No, you can have as many parallel tasks doing async IO operations as you = want. What the documentation says is that in each one of these tasks, there is = one thread handling=20 the requests. Hope this helps, Kostas=20 > On Mar 31, 2017, at 12:17 PM, Nico wrote: >=20 > Hi, >=20 > I have a short question regarding the AsyncFunction of Flink 1.2.0. In = the documentation it says: >=20 > "[...] that the AsyncFunction is not called in a multi-threaded = fashion. There exists only one instance of the AsyncFunction and it is = called sequentially for each record in the respective partition of the = stream." >=20 > Does it mean the there is only subtask of the Operator, so the = parallelism is always 1 for this Operator?=20 >=20 > Thank you :) >=20 > Best, > Nico --Apple-Mail=_B674C2B6-D5A9-4C9A-B0D4-2CBEFE8F8CC1 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Hi Nico,

No, you can have as many parallel tasks doing async IO = operations as you want.
What the documentation says = is that in each one of these tasks, there is one thread = handling 
the requests.
Hope this helps,
Kostas 

On = Mar 31, 2017, at 12:17 PM, Nico <nico.franzeck@gmail.com> wrote:

Hi,

I have = a short question regarding the AsyncFunction of Flink 1.2.0. In the = documentation it says:

"[...] that the = AsyncFunction is not called in a multi-threaded = fashion. There exists only one instance of the AsyncFunction and it is called sequentially for each = record in the respective partition of the stream."

Does it mean the = there is only subtask of the Operator, so the parallelism is always 1 = for this Operator?

Thank you :)

Best,
Nico

= --Apple-Mail=_B674C2B6-D5A9-4C9A-B0D4-2CBEFE8F8CC1--