flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Igal Shilman <i...@ververica.com>
Subject Re: Using Stateful Functions within a Flink pipeline
Date Wed, 22 Apr 2020 14:56:21 GMT
Hi Annemarie,
There are plans to make stateful functions more easily embeddable within a
Flink Job,
perhaps skipping ingress/egress routing abstracting all together and
basically exposing the
core Flink job that is the heart of stateful functions.
Although these plans are not concrete yet I believe this would be brought
to discussion with the community in the upcoming weeks.

Currently, you can split your pipeline to a preprocessing Flink job, and a
stateful functions job.

Good luck,
Igal.

On Wed, Apr 22, 2020 at 4:26 PM Annemarie Burger <
annemarie.burger@campus.tu-berlin.de> wrote:

> I was wondering if it is possible to use a Stateful Function within a Flink
> pipeline. I know they work with different API's, so I was wondering if it
> is
> possible to have a DataStream as ingress for a Stateful Function.
>
> Some context: I'm working on a streaming graph analytics system, and want
> to
> save the state of the graph within a window. Stateful functions could then
> allow me to process these distributed graph states by making use of the SF
> messaging.
>
> Thanks!
>
>
>
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
>

Mime
View raw message