From user-return-35789-archive-asf-public=cust-asf.ponee.io@flink.apache.org Mon Jun 15 18:18:53 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E7860180656 for ; Mon, 15 Jun 2020 20:18:52 +0200 (CEST) Received: (qmail 34355 invoked by uid 500); 15 Jun 2020 18:18:51 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 34346 invoked by uid 99); 15 Jun 2020 18:18:50 -0000 Received: from Unknown (HELO mailrelay1-lw-us.apache.org) (10.10.3.159) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Jun 2020 18:18:50 +0000 Received: from mail-ot1-f47.google.com (mail-ot1-f47.google.com [209.85.210.47]) by mailrelay1-lw-us.apache.org (ASF Mail Server at mailrelay1-lw-us.apache.org) with ESMTPSA id BA0F1400DD for ; Mon, 15 Jun 2020 18:18:50 +0000 (UTC) Received: by mail-ot1-f47.google.com with SMTP id v13so13847193otp.4 for ; Mon, 15 Jun 2020 11:18:50 -0700 (PDT) X-Gm-Message-State: AOAM531CXr/7pF0aJz8VfSGCOnrIYSb1Br6icDm6Xi07wyTZB3LX1uev iog3bsaK2CE6flpSNyff3FBGGw9XQuiRs54+cGo= X-Google-Smtp-Source: ABdhPJxaU1VV07apKaiRn2pc4QECFvzIVdUwlKmsB12hA/WiYKjwNrGwY/Lckq8+lmErPHLY21bTnGOX3m/L1Gj8pUI= X-Received: by 2002:a05:6830:3142:: with SMTP id c2mr22111554ots.257.1592245130169; Mon, 15 Jun 2020 11:18:50 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Robert Metzger Date: Mon, 15 Jun 2020 20:18:34 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Shared state between two process functions To: Jaswin Shah Cc: "user@flink.apache.org" , Yun Gao Content-Type: multipart/alternative; boundary="00000000000061170a05a82375bf" --00000000000061170a05a82375bf Content-Type: text/plain; charset="UTF-8" Thanks for sharing some details on the use case: Are you able to move the common computation into one operator that runs before the ProcessFunctions, and you are sending the results there? You can build quite advanced dataflow graphs with Flink to model your problem. On Mon, Jun 15, 2020 at 9:01 AM Jaswin Shah wrote: > Basically, I have multiple processafunctions and they are doing > some.computations based on some historical results and the historical > events and results are common across the process functions due to which I > have a lot of redundant processing in many process functions so, I have > been thinking of some shared state accessible between multiple > keyedprocessfunctions. > > Get Outlook for Android > > ------------------------------ > *From:* Yun Gao > *Sent:* Monday, June 15, 2020 8:27:38 AM > *To:* Jaswin Shah ; user@flink.apache.org < > user@flink.apache.org> > *Subject:* Re: Shared state between two process functions > > Hi Jaswin, > > Currently the state belongs to single operators, thus it should be not > possible to share states between different operators. Could you also share > the original problem want to solve by sharing states ? > > Best, > Yun > > > ------------------Original Mail ------------------ > *Sender:*Jaswin Shah > *Send Date:*Sun Jun 14 18:57:54 2020 > *Recipients:*user@flink.apache.org > *Subject:*Shared state between two process functions > > Hi, > > Is it possible to create the shared state(MapState) between two different > keyedProcessFunction? If it's possible, how can we do that in flink? > > Thanks, > Jaswin > > --00000000000061170a05a82375bf Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thanks for sharing some details on the use case: Are you a= ble to move the common computation into one operator that runs before the P= rocessFunctions, and you are sending the results=C2=A0there?
You can bu= ild quite advanced dataflow graphs with Flink to model your problem.
<= /div>
O= n Mon, Jun 15, 2020 at 9:01 AM Jaswin Shah <jaswin.shah@outlook.com> wrote:
Basically,=C2=A0 I have multiple processafunctions and they are doing some.= computations based on some historical results and the historical events and= results are common across the process functions due to which I have a lot = of redundant processing in many process functions=C2=A0=C2=A0 so, I have been thinking of some shared state access= ible between multiple keyedprocessfunctions.

From= : Yun Gao <yungao.gy@aliyun.com>
Sent: Monday, June 15, 2020 8:27:38 AM
To: Jaswin Shah <jaswin.shah@outlook.com>; user@flink.apache.org <user@flink.apache.org> Subject: Re: Shared state between two process functions
=C2=A0
Hi Jaswin,
=C2=A0 =C2=A0
=C2=A0 =C2=A0Currently the state belongs to single operators, thus it = should be not possible to share states between different operators. Could y= ou also share the original problem want to solve by sharing states ?

Best,
=C2=A0Yun


------------------Original Mail --------------= ----
Sender:Jaswin Shah <jaswin.shah@outlook.com>
Send Date:Sun Jun 14 18:57:54 2020
Subject:Shared state between two process functions
Hi,

Is it possible to create the shared state(MapState) between two different k= eyedProcessFunction? If it's possible, how can we do that in flink?

Thanks,
Jaswin
--00000000000061170a05a82375bf--