Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CAKiyyaGQ2mb+Jg9998k6hHvTywyVOe8WC122rkEbgu3GOLOVuw@mail.gmail.com>
References: <CABxg2KMeOHCLSMXnwT0h_Fa=8ic+LWAts=ipZiYEh6ZQqwCeHg@mail.gmail.com>
 <CAKiyyaGQ2mb+Jg9998k6hHvTywyVOe8WC122rkEbgu3GOLOVuw@mail.gmail.com>
From: Anchit Jatana <development.anchit@gmail.com>
Date: Thu, 29 Sep 2016 10:18:24 -0700
Message-ID: <CABxg2KMh8eRi-wNKo+AuEG_U4GGXgfBcnY3c+8tWYqSGZHQZ1Q@mail.gmail.com>
Subject: Re: How to interact with a running flink application?
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a113c9ea24f6b01053da8aa40
archived-at: Thu, 29 Sep 2016 17:18:30 -0000

--001a113c9ea24f6b01053da8aa40
Content-Type: text/plain; charset=UTF-8

Hi Ufuk,

Thanks for your help, I'm working on using the suggested approach to
address my use case.

Regards,
Anchit


On Wed, Sep 28, 2016 at 12:48 AM, Ufuk Celebi <uce@apache.org> wrote:

> Hey Anchit,
>
> the usual recommendation for this is to use a CoMap/CoFlatMap
> operator, where the second input are the lookup location changes. You
> can then use this input to update the location.
>
> Search for CoMap/CoFlatMap here:
> https://ci.apache.org/projects/flink/flink-docs-master/dev/datastream_api.
> html#datastream-transformations
>
> Best,
>
> Ufuk
>
> On Wed, Sep 28, 2016 at 9:37 AM, Anchit Jatana
> <development.anchit@gmail.com> wrote:
> > Hi All,
> >
> > Brief: I have a use case where I need to interact with a running flink
> > application.
> >
> > Detail:
> >
> > My Flink application has a Kafka source, an operator processing on the
> > content received from the Kafka stream(this operator is using a lookup
> from
> > an external source file to accomplish the processing of the Kafka
> content).
> > If the content of the file kept at the same source location changes, I
> need
> > to notify the operator to update its lookup content loaded in the memory
> and
> > continue its processing of Kafka content with the new loaded lookup
> content
> > without stopping the Flink application.
> >
> > Is there a way where I can "interact with the running Flink Application"
> > through some event or something to notify the application to make some
> > changes in its operation without stopping the application.
> >
> > Thank you!
> >
> > Regards,
> > Anchit
>

--001a113c9ea24f6b01053da8aa40
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi Ufuk,</div><div><br></div>Thanks for your help, I&=
#39;m working on using the suggested approach to address my use case.<div><=
br></div><div>Regards,</div><div>Anchit<br><div><br></div></div></div><div =
class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Wed, Sep 28, 2016 a=
t 12:48 AM, Ufuk Celebi <span dir=3D"ltr">&lt;<a href=3D"mailto:uce@apache.=
org" target=3D"_blank">uce@apache.org</a>&gt;</span> wrote:<br><blockquote =
class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid=
;padding-left:1ex">Hey Anchit,<br>
<br>
the usual recommendation for this is to use a CoMap/CoFlatMap<br>
operator, where the second input are the lookup location changes. You<br>
can then use this input to update the location.<br>
<br>
Search for CoMap/CoFlatMap here:<br>
<a href=3D"https://ci.apache.org/projects/flink/flink-docs-master/dev/datas=
tream_api.html#datastream-transformations" rel=3D"noreferrer" target=3D"_bl=
ank">https://ci.apache.org/<wbr>projects/flink/flink-docs-<wbr>master/dev/d=
atastream_api.<wbr>html#datastream-<wbr>transformations</a><br>
<br>
Best,<br>
<br>
Ufuk<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
On Wed, Sep 28, 2016 at 9:37 AM, Anchit Jatana<br>
&lt;<a href=3D"mailto:development.anchit@gmail.com">development.anchit@gmai=
l.com</a>&gt; wrote:<br>
&gt; Hi All,<br>
&gt;<br>
&gt; Brief: I have a use case where I need to interact with a running flink=
<br>
&gt; application.<br>
&gt;<br>
&gt; Detail:<br>
&gt;<br>
&gt; My Flink application has a Kafka source, an operator processing on the=
<br>
&gt; content received from the Kafka stream(this operator is using a lookup=
 from<br>
&gt; an external source file to accomplish the processing of the Kafka cont=
ent).<br>
&gt; If the content of the file kept at the same source location changes, I=
 need<br>
&gt; to notify the operator to update its lookup content loaded in the memo=
ry and<br>
&gt; continue its processing of Kafka content with the new loaded lookup co=
ntent<br>
&gt; without stopping the Flink application.<br>
&gt;<br>
&gt; Is there a way where I can &quot;interact with the running Flink Appli=
cation&quot;<br>
&gt; through some event or something to notify the application to make some=
<br>
&gt; changes in its operation without stopping the application.<br>
&gt;<br>
&gt; Thank you!<br>
&gt;<br>
&gt; Regards,<br>
&gt; Anchit<br>
</div></div></blockquote></div><br></div>

--001a113c9ea24f6b01053da8aa40--