streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Blackmon (JIRA)" <>
Subject [jira] [Created] (STREAMS-365) Basic spark runtime
Date Tue, 08 Sep 2015 21:31:46 GMT
Steve Blackmon created STREAMS-365:

             Summary: Basic spark runtime
                 Key: STREAMS-365
             Project: Streams
          Issue Type: Improvement
            Reporter: Steve Blackmon
            Assignee: Steve Blackmon

Implement a basic spark runtime that supports integration on streams components and libraries
into spark jobs by 
a) reading and writing files from hdfs with support from LineUtils
b) executing object conversions from streams-converters on instances of RDD[Object]
c) executing StreamsProcessor.process in parallel on instances of RDD[StreamsDatum]

This message was sent by Atlassian JIRA

View raw message