flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashutosh Kumar <kmr.ashutos...@gmail.com>
Subject Re: Apache Beam and Flink
Date Thu, 26 May 2016 08:00:12 GMT
Thanks . So if we use Beam API with flink engine then we can get inter
action between batch and stream ? As i know currently in flink Dataset and
DStream can not talk . Is this correct ?
 Thanks
Ashutosh


On Thu, May 26, 2016 at 1:09 PM, Slim Baltagi <sbaltagi@gmail.com> wrote:

> Hi Ashutosh
>
> Apache Beam provides a Unified API for batch and streaming.
> It also supports multiple ‘runners’: local, Apache Spark, Apache Flink and
> Google Cloud Data Flow (commercial service).
> It is not an alternative to Flink because it is an API and you still need
> an execution engine.
> It can be used as an alternative API to using the two Flink APIs : DataSet
> API and DataStream API.
> It can be complementary to Flink in the way that you use Beam as API and
> Flink as the execution engine.
> Many of Flink committers are also Apache Beam committers!
> The following blogs describe why Apache Beam:
>
>    -  from Flink perspective: http://data-artisans.com/why-apache-beam/
>    -  from Google perspective.
>    https://cloud.google.com/blog/big-data/2016/05/why-apache-beam-a-google-perspective
>
>
> A few recent resources about Apache Beam published this month: May 2016
>
>    - Running Apache Beam (screencast)
>    https://www.youtube.com/watch?v=dwxUbzbwtyI
>    - Introduction to Apache Beam ( presentation)
>    https://skillsmatter.com/skillscasts/8036-apache-flink-may-meetup
>    - Introduction to Apache Beam ( blog)
>    http://www.talend.com/blog/2016/05/02/introduction-to-apache-beam
>
>
> I hope this helps.
>
> Thanks
>
> Slim Baltagi
>
> On May 26, 2016, at 2:20 AM, Ashutosh Kumar <kmr.ashutosh16@gmail.com>
> wrote:
>
> How does apache beam fits with  flink ? Is it an alternative for flink or
> complementary to it ?
>
> Thanks
> Ashutosh
>
>
>

Mime
View raw message