Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
MIME-Version: 1.0
References: <F1BF43A9-9F31-4BC1-9EDF-B596B84EAC8F@gmail.com>
 <CAAdrtT1PVkt-BM-NN=gJ-DX_6yGjr5FA=mr-KqqzcuDSQ9bVTw@mail.gmail.com>
In-Reply-To: 
 <CAAdrtT1PVkt-BM-NN=gJ-DX_6yGjr5FA=mr-KqqzcuDSQ9bVTw@mail.gmail.com>
From: Aljoscha Krettek <aljoscha@apache.org>
Date: Sat, 23 Apr 2016 05:48:37 +0000
Message-ID: 
 <CANMXwW2Jt2Ym-F55kN1Y902M6_kxiXi0RMT_kQv5PASvJ1rXVg@mail.gmail.com>
Subject: Re: Flink program without a line of code
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary=001a11c339a6402ea50531207f46

--001a11c339a6402ea50531207f46
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi,
I think if the Table API/SQL API evolves enough it should be able to supply
a Flink program as just an SQL query with source/sink definitions.
Hopefully, in the future. :-)

Cheers,
Aljoscha

On Fri, 22 Apr 2016 at 23:10 Fabian Hueske <fhueske@gmail.com> wrote:

> Hi Alex,
>
> welcome to the Flink community!
> Right now, there is no way to specify a Flink program without writing cod=
e
> (Java, Scala, Python(beta)).
>
> In principle it is possible to put such functionality on top of the
> DataStream or DataSet APIs.
> This has been done before for other programming APIs (Flink's own
> libraries Table API, Gelly, FlinkML, and externals Apache Beam / Google
> DataFlow, Mahout, Cascading, ...). However, all of these are again
> programming APIs, some specialized for certain use-cases.
>
> Specifying Flink programs by config files (or graphically) would require =
a
> data model, a DataStream/DataSet program generator and probably a code
> generation component.
>
> Best, Fabian
>
> 2016-04-22 18:41 GMT+02:00 Alexander Smirnov <alexander.smirnoff@gmail.co=
m
> >:
>
>> Hi guys!
>>
>> I=E2=80=99m new to Flink, and actually to this mailing list as well :) t=
his is my
>> first message.
>> I=E2=80=99m still reading the documentation and I would say Flink is an =
amazing
>> system!! Thanks everybody who participated in the development!
>>
>> The information I didn=E2=80=99t find in the documentation - if it is po=
ssible to
>> describe data(stream) transformation without any code (Java/Scala).
>> I mean if it is possible to describe datasource functions, all of the
>> operators, connections between them, and sinks in a plain text
>> configuration file and then feed it to Flink.
>> In this case it would be possible to change data flow without
>> recompilation/redeployment.
>>
>> Is there a similar functionality in Flink? May be some third party plugi=
n?
>>
>> Thank you,
>> Alex
>
>
>

--001a11c339a6402ea50531207f46
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div>I think if the Table API/SQL API evolves enough it=
 should be able to supply a Flink program as just an SQL query with source/=
sink definitions. Hopefully, in the future. :-)</div><div><br></div><div>Ch=
eers,</div><div>Aljoscha</div></div><br><div class=3D"gmail_quote"><div dir=
=3D"ltr">On Fri, 22 Apr 2016 at 23:10 Fabian Hueske &lt;<a href=3D"mailto:f=
hueske@gmail.com">fhueske@gmail.com</a>&gt; wrote:<br></div><blockquote cla=
ss=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;pa=
dding-left:1ex"><div dir=3D"ltr"><div><div><div><div>Hi Alex,<br><br></div>=
welcome to the Flink community! <br></div>Right now, there is no way to spe=
cify a Flink program without writing code (Java, Scala, Python(beta)).<br><=
br></div>In principle it is possible to put such functionality on top of th=
e DataStream or DataSet APIs. <br>This has been done before for other progr=
amming APIs (Flink&#39;s own libraries Table API, Gelly, FlinkML, and exter=
nals Apache Beam / Google DataFlow, Mahout, Cascading, ...). However, all o=
f these are again programming APIs, some specialized for certain use-cases.=
<br><br></div><div>Specifying Flink programs by config files (or graphicall=
y) would require a data model, a DataStream/DataSet program generator and p=
robably a code generation component. <br><br></div><div>Best, Fabian<br></d=
iv></div><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">2016-04-=
22 18:41 GMT+02:00 Alexander Smirnov <span dir=3D"ltr">&lt;<a href=3D"mailt=
o:alexander.smirnoff@gmail.com" target=3D"_blank">alexander.smirnoff@gmail.=
com</a>&gt;</span>:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 =
0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi guys!<br>
<br>
I=E2=80=99m new to Flink, and actually to this mailing list as well :) this=
 is my first message.<br>
I=E2=80=99m still reading the documentation and I would say Flink is an ama=
zing system!! Thanks everybody who participated in the development!<br>
<br>
The information I didn=E2=80=99t find in the documentation - if it is possi=
ble to describe data(stream) transformation without any code (Java/Scala).<=
br>
I mean if it is possible to describe datasource functions, all of the opera=
tors, connections between them, and sinks in a plain text configuration fil=
e and then feed it to Flink.<br>
In this case it would be possible to change data flow without recompilation=
/redeployment.<br>
<br>
Is there a similar functionality in Flink? May be some third party plugin?<=
br>
<br>
Thank you,<br>
Alex</blockquote></div><br></div>
</blockquote></div>

--001a11c339a6402ea50531207f46--