ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Ozerov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (IGNITE-389) Integration with Spark: IgniteRDD
Date Mon, 13 Apr 2015 09:50:12 GMT

     [ https://issues.apache.org/jira/browse/IGNITE-389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vladimir Ozerov updated IGNITE-389:
-----------------------------------
    Fix Version/s:     (was: sprint-4)
                   sprint-5

> Integration with Spark: IgniteRDD
> ---------------------------------
>
>                 Key: IGNITE-389
>                 URL: https://issues.apache.org/jira/browse/IGNITE-389
>             Project: Ignite
>          Issue Type: New Feature
>          Components: hadoop
>            Reporter: Dmitriy Setrakyan
>            Assignee: Ivan Veselovsky
>            Priority: Blocker
>             Fix For: sprint-5
>
>
> I think we should create an implementation of RDD for Ignite caches (either REPLICATED
or PARTITIONED).
> Please create Spark project from GIT:
> https://github.com/apache/spark
> In core module for Scala you can find {{org.apache.spark.rdd.RDD}} class which is extensible.
We should provide our own implementation of this class. This package has plenty of other examples
on how to create RDD, e.g. HadoopRDD, JdbcRDD, etc.
> This integration should be done in ignite-spark module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message