flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Storm compatibility layer for Flink (first beta available)
Date Thu, 02 Apr 2015 19:09:26 GMT
Hey Henry,

you can check out the files here:
https://github.com/mjsax/flink/tree/flink-storm-compatibility/flink-staging/flink-streaming/flink-storm-compatibility
... so yes, they are located in the flink-streaming directory .. which is a
good place for now.
Once we move flink-streaming out of staging, we might want to keep the
storm compat in staging.


On Thu, Apr 2, 2015 at 8:16 PM, Henry Saputra <henry.saputra@gmail.com>
wrote:

> HI Matthias,
>
> Where do you put the code for the Storm compatibility? Under streams
> module directory?
>
> - Henry
>
> On Thu, Apr 2, 2015 at 10:31 AM, Matthias J. Sax
> <mjsax@informatik.hu-berlin.de> wrote:
> > Hi @all,
> >
> > I started to work on an compatibility layer to run Storm Topologies on
> > Flink. I just pushed a first beta:
> > https://github.com/mjsax/flink/tree/flink-storm-compatibility
> >
> > Please check it out, and let me know how you like it. In this first
> > version, I tried to code without changing too many things in the
> > existing code. However, a deeper integration would be nice.
> >
> > There are many things that do not work yet. Currently, only shuffle and
> > fieldsGrouping is supported (and only Storm's default output stream).
> > Furthermore, topologies must be "simple", ie, they cannot be configured
> > with a Config object and Storm meta information (ie, TopologyContext) is
> > also not there.
> >
> > The layer can be used to integrate existing Spouts and/or Bolts as Flink
> > operators into a regular Flink program. Furthermore, a whole Storm
> > topology can be executed by switching from TopologyBuilder to
> > FlinkTopologyBuilder and from LocalCluster/NimbusClient/StormSubmitter
> > to FlinkLocalCluster/FlinkClient/FlinkStormSubmitter.
> >
> > Examples of both cases are given as ITCases.
> >
> >
> > Cheers,
> >   Matthias
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message