flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Shared state between two process functions
Date Mon, 15 Jun 2020 18:18:34 GMT
Thanks for sharing some details on the use case: Are you able to move the
common computation into one operator that runs before the ProcessFunctions,
and you are sending the results there?
You can build quite advanced dataflow graphs with Flink to model your
problem.

On Mon, Jun 15, 2020 at 9:01 AM Jaswin Shah <jaswin.shah@outlook.com> wrote:

> Basically,  I have multiple processafunctions and they are doing
> some.computations based on some historical results and the historical
> events and results are common across the process functions due to which I
> have a lot of redundant processing in many process functions   so, I have
> been thinking of some shared state accessible between multiple
> keyedprocessfunctions.
>
> Get Outlook for Android <https://aka.ms/ghei36>
>
> ------------------------------
> *From:* Yun Gao <yungao.gy@aliyun.com>
> *Sent:* Monday, June 15, 2020 8:27:38 AM
> *To:* Jaswin Shah <jaswin.shah@outlook.com>; user@flink.apache.org <
> user@flink.apache.org>
> *Subject:* Re: Shared state between two process functions
>
> Hi Jaswin,
>
>    Currently the state belongs to single operators, thus it should be not
> possible to share states between different operators. Could you also share
> the original problem want to solve by sharing states ?
>
> Best,
>  Yun
>
>
> ------------------Original Mail ------------------
> *Sender:*Jaswin Shah <jaswin.shah@outlook.com>
> *Send Date:*Sun Jun 14 18:57:54 2020
> *Recipients:*user@flink.apache.org <user@flink.apache.org>
> *Subject:*Shared state between two process functions
>
> Hi,
>
> Is it possible to create the shared state(MapState) between two different
> keyedProcessFunction? If it's possible, how can we do that in flink?
>
> Thanks,
> Jaswin
>
>

Mime
View raw message