streams-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Blackmon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (STREAMS-365) Basic spark runtime
Date Mon, 13 Feb 2017 23:46:41 GMT

     [ https://issues.apache.org/jira/browse/STREAMS-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steve Blackmon updated STREAMS-365:
-----------------------------------
    Component/s: Runtimes

> Basic spark runtime
> -------------------
>
>                 Key: STREAMS-365
>                 URL: https://issues.apache.org/jira/browse/STREAMS-365
>             Project: Streams
>          Issue Type: Improvement
>          Components: Runtimes
>            Reporter: Steve Blackmon
>            Assignee: Steve Blackmon
>
> Implement a basic spark runtime that supports integration on streams components and libraries
into spark jobs by 
> a) reading and writing files from hdfs with support from LineUtils
> b) executing object conversions from streams-converters on instances of RDD[Object]
> c) executing StreamsProcessor.process in parallel on instances of RDD[StreamsDatum]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message