flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saikat Maitra <saikat.mai...@gmail.com>
Subject Re: Apache Flink <=> Apache Ignite integration
Date Thu, 31 Mar 2016 15:20:02 GMT
Hi ,

I agree with Roman and Raul.
https://issues.apache.org/jira/browse/IGNITE-813 allows injecting data to
into cache via Data Streamer. Integrating with Ignite FileSystem for source
and sink will allow for bidirectional connector. It will also allow easier
implementation for DataStream transformations over Ignite FileSystem.

Regards
Saikat

On Thu, Mar 31, 2016 at 2:44 PM, Aljoscha Krettek <aljoscha@apache.org>
wrote:

> Hi,
> it should already be possible to use the Ignite FileSystem to store state
> since we just use the HDFS FileSystem interface for that. Of course, one
> would have to properly set up the jars and paths and everything for Flink
> to pick up the IGFS classes.
>
> Cheers,
> Aljoscha
>
> On Wed, 30 Mar 2016 at 16:50 Raul Kripalani <raulk@apache.org> wrote:
>
> > On Wed, Mar 30, 2016 at 2:20 PM, Roman <rshtykh@yahoo.com.invalid>
> wrote:
> >
> > > Raul,
> > >
> > > Small comment from me.
> > >
> > > >* As a Flink sink => inject data directly into a cache via a
> > DataStreamer.
> > > After reviews, IGNITE-813 is exactly this functionality.
> > >
> > >
> > That's cool, Roman! The idea would be to host these (richer) modules as
> > Flink connectors, like they do with others:
> >
> > https://github.com/apache/flink/tree/master/flink-streaming-connectors
> > https://github.com/apache/flink/tree/master/flink-batch-connectors
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message