Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
From: Kostas Kloudas <k.kloudas@data-artisans.com>
Message-Id: <C26F566D-2980-4A56-ADCB-12751994D9A5@data-artisans.com>
Content-Type: multipart/alternative;
 boundary="Apple-Mail=_17507E84-59BB-421E-AB4A-7550E1A2023C"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Re: FlinkCEP: pattern application on a KeyedStream
Date: Thu, 19 Oct 2017 12:04:19 +0200
In-Reply-To: <CANNGFpj+jmtsivOhThJ_B47bgJysBntiLSJ6x9nXU+ci4szwVg@mail.gmail.com>
Cc: user <user@flink.apache.org>
To: Federico D'Ambrosio <federico.dambrosio@smartlab.ws>
References: <CANNGFpj+jmtsivOhThJ_B47bgJysBntiLSJ6x9nXU+ci4szwVg@mail.gmail.com>
archived-at: Thu, 19 Oct 2017 10:04:27 -0000


--Apple-Mail=_17507E84-59BB-421E-AB4A-7550E1A2023C
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Hi Federico,

If I understand your question correctly, then yes, the application of a =
Pattern on a keyed stream=20
is similar to the application of a map function.

It will search for the pattern on each per-key stream of data.
So there will be state (buffer with partial matches, queued elements, =
etc) for every active key.

Cheers,
Kostas

> On Oct 19, 2017, at 11:55 AM, Federico D'Ambrosio =
<federico.dambrosio@smartlab.ws> wrote:
>=20
> Hi all,
>=20
> I was wondering if it is correct to assume the application of a =
pattern on a KeyedStream similar to the application, e.g., of a =
MapFunction when it comes to state.
>=20
> For example, the following
>=20
> val pattern =3D ...
> val keyedStream =3D stream.keyBy("id")
>=20
> val patternKeyedStream =3D CEP.pattern(pattern, keyedStream)
>=20
> val anotherKeyedStream =3D patternKeyedStream.select(...)
>=20
> should only check the pattern on each single partition value.
>=20
> Am I correct in assuming this, or I have misunderstood CEP =
functioning?
>=20
> --=20
> Federico D'Ambrosio


--Apple-Mail=_17507E84-59BB-421E-AB4A-7550E1A2023C
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=us-ascii

<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html =
charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Hi Federico,<div class=3D""><br class=3D""></div><div =
class=3D"">If I understand your question correctly, then yes, the =
application of a Pattern on a keyed stream&nbsp;</div><div class=3D"">is =
similar to the application of a map function.</div><div class=3D""><br =
class=3D""></div><div class=3D"">It will search for the pattern on each =
per-key stream of data.</div><div class=3D"">So there will be state =
(buffer with partial matches, queued elements, etc) for every active =
key.</div><div class=3D""><br class=3D""></div><div =
class=3D"">Cheers,</div><div class=3D"">Kostas</div><div class=3D""><br =
class=3D""><div class=3D""><div><blockquote type=3D"cite" class=3D""><div =
class=3D"">On Oct 19, 2017, at 11:55 AM, Federico D'Ambrosio &lt;<a =
href=3D"mailto:federico.dambrosio@smartlab.ws" =
class=3D"">federico.dambrosio@smartlab.ws</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div dir=3D"ltr" =
class=3D""><div class=3D""><div class=3D""><div class=3D""><div =
class=3D""><div class=3D""><div class=3D"">Hi all,<br class=3D""><br =
class=3D""></div>I was wondering if it is correct to assume the =
application of a pattern on a KeyedStream similar to the application, =
e.g., of a MapFunction when it comes to state.<br class=3D""></div><div =
class=3D""><br class=3D""></div><div class=3D"">For example, the =
following<br class=3D""></div><div class=3D""><br class=3D""></div><span =
style=3D"font-family:monospace,monospace" class=3D"">val pattern =3D =
...<br class=3D""></span></div><span =
style=3D"font-family:monospace,monospace" class=3D"">val keyedStream =3D =
stream.keyBy("id")<br class=3D""><br class=3D""></span></div><span =
style=3D"font-family:monospace,monospace" class=3D"">val =
patternKeyedStream =3D CEP.pattern(pattern, keyedStream)<br class=3D""><br=
 class=3D""></span></div><span style=3D"font-family:monospace,monospace" =
class=3D"">val anotherKeyedStream =3D =
patternKeyedStream.select(...)</span><br class=3D""></div><div =
class=3D""><br class=3D""></div><div class=3D"">should only check the =
pattern on each single partition value.</div><div class=3D""><br =
class=3D""></div><div class=3D"">Am I correct in assuming this, or I =
have misunderstood CEP functioning?<br class=3D""></div><div =
class=3D""><div class=3D""><div class=3D""><div class=3D""><div =
class=3D""><div class=3D""><div class=3D""><div class=3D""><br =
class=3D"">-- <br class=3D""><div class=3D"gmail_signature"><div =
dir=3D"ltr" class=3D""><span class=3D""><div class=3D"">Federico =
D'Ambrosio</div></span></div></div>
</div></div></div></div></div></div></div></div></div>
</div></blockquote></div><br class=3D""></div></div></body></html>=

--Apple-Mail=_17507E84-59BB-421E-AB4A-7550E1A2023C--