ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Romain Manni-Bucau (Jira)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-12228) Implement an Apache Beam runner on top of Ignite compute grid?
Date Tue, 24 Sep 2019 17:00:00 GMT
Romain Manni-Bucau created IGNITE-12228:
-------------------------------------------

             Summary: Implement an Apache Beam runner on top of Ignite compute grid?
                 Key: IGNITE-12228
                 URL: https://issues.apache.org/jira/browse/IGNITE-12228
             Project: Ignite
          Issue Type: Wish
            Reporter: Romain Manni-Bucau


Apache Ignite provides a compute grid.

It is therefore feasible to use that to execute a DAG pipeline.

Therefore implementing a Apache Beam runner executing a DAG on an ignite cluster would be
very valuable for users and would provide a very interesting alternative to Spark, Dataflow
etc...which would be very valuable when using data from ignite itself. 

Hoping it can help, here is Hazelcast Jet implementation which is not that far even if Jet
is a bit more advanced in term of DAG support: [https://github.com/apache/beam/tree/master/runners/jet-experimental/src/main/java/org/apache/beam/runners/jet]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message