ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexey Goncharuk (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (IGNITE-389) Integration with Spark: IgniteRDD
Date Thu, 10 Dec 2015 09:04:11 GMT

     [ https://issues.apache.org/jira/browse/IGNITE-389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Alexey Goncharuk updated IGNITE-389:
------------------------------------
    Fix Version/s:     (was: 1.5)
                   1.6

> Integration with Spark: IgniteRDD
> ---------------------------------
>
>                 Key: IGNITE-389
>                 URL: https://issues.apache.org/jira/browse/IGNITE-389
>             Project: Ignite
>          Issue Type: New Feature
>          Components: general
>            Reporter: Dmitriy Setrakyan
>            Assignee: Alexey Goncharuk
>            Priority: Blocker
>             Fix For: 1.6
>
>
> I think we should create an implementation of RDD for Ignite caches (either REPLICATED
or PARTITIONED).
> Please create Spark project from GIT:
> https://github.com/apache/spark
> In core module for Scala you can find {{org.apache.spark.rdd.RDD}} class which is extensible.
We should provide our own implementation of this class. This package has plenty of other examples
on how to create RDD, e.g. HadoopRDD, JdbcRDD, etc.
> This integration should be done in ignite-spark module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message