From user-return-30612-archive-asf-public=cust-asf.ponee.io@flink.apache.org Thu Oct 31 08:35:59 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 68288180629 for ; Thu, 31 Oct 2019 09:35:59 +0100 (CET) Received: (qmail 82487 invoked by uid 500); 31 Oct 2019 08:35:57 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 82476 invoked by uid 99); 31 Oct 2019 08:35:57 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Oct 2019 08:35:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 38C15C2DE6 for ; Thu, 31 Oct 2019 08:35:56 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.001 X-Spam-Level: X-Spam-Status: No, score=0.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id GBWlVW21nzvq for ; Thu, 31 Oct 2019 08:35:54 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::c2d; helo=mail-yw1-xc2d.google.com; envelope-from=bastien.dine@gmail.com; receiver= Received: from mail-yw1-xc2d.google.com (mail-yw1-xc2d.google.com [IPv6:2607:f8b0:4864:20::c2d]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id CAD4D7DDE8 for ; Thu, 31 Oct 2019 07:58:46 +0000 (UTC) Received: by mail-yw1-xc2d.google.com with SMTP id s6so1821181ywe.5 for ; Thu, 31 Oct 2019 00:58:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=rVCK2ahdDvcVUQ/Zt+p+AQOMPZuezaoamQ/B8XY1gGQ=; b=EjPzrmLXOEQHjEIhMyW5zxttntYcAU+8Epz5bWOsJ14YFa3Vs/zg+D1dom0NThD4Wf B8eF269AB3/2oP7nCDWlBoKQ8ru+bIwKCrBV8wd9Wc61oMeuaggd/VEOf7Fz0nm1zMPO VMIjjKUcpb578Rhr9NpkYWcQro48WQ2k7yXqtwOGPQEHwbjvgZlTnwHlGvXJsihNzPVg uYvXMG9eZlDQCuDQKPVDTavY1r0bArRggMguU7jvO0XWezN0dDV35u+cdL9BAR+LJX2N AUFtLzklM7qUOK+dpoOH8dEqSGQeJ4dYiDcq7mLSsJavdv8+87kBRvwMti1wLZuE0UvA yG9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=rVCK2ahdDvcVUQ/Zt+p+AQOMPZuezaoamQ/B8XY1gGQ=; b=arAasYAOBnHwihG9aWRM3rWhVn2f2e9fW2mGbAWHOm5GDSucxhz07XrMKboYcu3e1P SwfL6U+IMZE1pcBhwewb2mzWJy9UD9KsR2D/1JGWjsWqj6v1G2biq1FYhgh4sh8+idWt ZYEzfHHh2ZGksNz0iIe5iBWGfHaMdGg39Ec+73nZU2t9yPnAQT0Cr6gP5A42lI3ejsDD BekEv2L8iHJEpK/l+w1Fqf6wue5AR2LZox5j//5cokrGVtRZu/cdZ1Fz6GCMOupUWhBc UQdZAuZoba6bRUisw8ljKCjFryKPD6rsDBObnT2C1zBH9PxC7rxOEvNYUpXml9JzKZrU HS9Q== X-Gm-Message-State: APjAAAVI3zRtAyK9E6bm6O0xjwD4wi7ixTxZ1MI6bAj00GgBWQAibY1P RMNIf1mcxJLoZhajGxdowsHSzG23fv2LWNdFTWFYf8Js X-Google-Smtp-Source: APXvYqwYkrDYUzoPhmWrTmEu4vIsEDS3KHYHe6ovDuvW4Ax4AYIwnFQaFj/bh6KKlw6fB4ZBM+p/xwoSlcOhRtdMqp4= X-Received: by 2002:a0d:d90e:: with SMTP id b14mr2920475ywe.477.1572508719971; Thu, 31 Oct 2019 00:58:39 -0700 (PDT) MIME-Version: 1.0 From: bastien dine Date: Thu, 31 Oct 2019 08:58:29 +0100 Message-ID: Subject: Async operator with a KeyedStream To: user Content-Type: multipart/alternative; boundary="000000000000a903040596303743" --000000000000a903040596303743 Content-Type: text/plain; charset="UTF-8" Hello, I would like to know if you can use a KeyedStream with the Async operator : I want to use the async operator to insert some stuff in my database but I want to limit 1 request per element (with key=id) at a time With a regular keyBy / map, it's working, but it's too slow (i don't have enough ressources to increase my parallelism), As far as I have seen, this is not possible When I write something like Async.orderedWait(myStream.keyBy(myKeyselector)), the keyBy is totally ignored Have you a solution for this? Best Regards, Bastien ------------------ Bastien DINE Data Architect / Software Engineer / Sysadmin bastiendine.io --000000000000a903040596303743 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello,

I would like to know if you can = use a KeyedStream with the Async operator :
I want to use the asy= nc operator to insert some stuff in my database but I want to limit 1 requ= est per element (with key=3Did) at a time
With a regular keyBy / = map, it's working, but it's too slow (i don't have enough resso= urces to increase my parallelism),=C2=A0

As far as= I have=C2=A0seen, this is not possible
When I write something li= ke Async.orderedWait(myStream.keyBy(myKeyselector)), the keyBy is totally i= gnored

Have you a solution for this?
Best Regards,
Bastien

---= ---------------

Bastien DINE
Data Architect / S= oftware Engineer / Sysadmin
bastiendine.io
--000000000000a903040596303743--